Skip to content

Pull requests: huggingface/datatrove

New pull request New
11 Open 296 Closed
11 Open 296 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

refactor(filters): use Counter(x) fast path in GopherRepetitionFilter
#493 opened Jun 28, 2026 by mattfaltyn Loading…
3 of 4 tasks
2
Fix extractor sandbox hang when the extract function raises an error
#492 opened Jun 13, 2026 by discobot Loading…
1
2
Fix incomplete stats.json when relaunching a LocalPipelineExecutor job
#491 opened Jun 13, 2026 by discobot Loading…
1
Fix JsonlWriter crash on pandas.Timestamp metadata
#490 opened Jun 12, 2026 by discobot Loading…
1
Require explicit eos_token in MegatronDocumentTokenizer (and fail clearly on an EOS missing from the vocab)
#489 opened Jun 3, 2026 by maxsloef-goodfire Loading…
fix(security): 2 improvements across 2 files
#488 opened May 26, 2026 by tomaioo Loading…
2
chore: enable Dependabot weekly GitHub Actions bumps dependabot
#487 opened May 26, 2026 by hf-dependantbot-rollout Bot Loading…
feat: Add full inference server response to InferenceResult
#410 opened Dec 19, 2025 by hynky1999 Collaborator Loading…
3
fix bos token missing
#346 opened Feb 13, 2025 by jquesnelle Loading…
1
4
Add open-source text extraction libraries
#293 opened Sep 27, 2024 by garrethlee Loading…
Mersenne prime hashing fix.
#200 opened May 28, 2024 by Apsod Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.