Skip to content

Pull requests: huggingface/datatrove

New pull request New
10 Open 184 Closed
10 Open 184 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

correct metadata parsing for finemath
#355 opened Mar 24, 2025 by VivienCabannes Loading…
fix bos token missing
#346 opened Feb 13, 2025 by jquesnelle Loading…
1
[draft] Add chunking option to DocumentTokenizer
#344 opened Feb 12, 2025 by craffel Loading…
1
Fix signatures priority queue initialization in MinhashBuildIndex
#334 opened Jan 30, 2025 by nelson-liu Loading…
1
Add RayPipelineExecutor
#331 opened Jan 27, 2025 by nelson-liu Loading…
1
Resolve issue 308
#309 opened Nov 29, 2024 by habanoz Loading…
[BUG Fix] Launching dependent LocalPipelineExecutors with skip_completed=False lead to waiting
#300 opened Oct 30, 2024 by silverriver Loading…
3
Add open-source text extraction libraries
#293 opened Sep 27, 2024 by garrethlee Loading…
Mersenne prime hashing fix.
#200 opened May 28, 2024 by Apsod Loading…
Linewise filters
#125 opened Mar 14, 2024 by guipenedo • Draft
ProTip! Adding no:label will show everything without a label.