Skip to content

Pull requests: modelscope/data-juicer

New pull request New
16 Open 290 Closed
16 Open 290 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] format conversion tools for post tuning datasets documentation Improvements or additions to documentation enhancement New feature or request
#514 opened Dec 18, 2024 by HYLcool • Draft
1 of 2 tasks
@HYLcool
Dev/feed back analysis dj:op issues/PRs about some specific OPs documentation Improvements or additions to documentation enhancement New feature or request
#513 opened Dec 13, 2024 by BeachWang • Draft
@BeachWang
[Feature] add auto mode for analyzer dj:core issues/PRs about the core functions of Data-Juicer enhancement New feature or request
#512 opened Dec 13, 2024 by HYLcool Loading…
@HYLcool
[WIP] support ray actor
#511 opened Dec 11, 2024 by Cathy0908 Loading…
@Cathy0908 @chenyushuo
@pan-x-c @yxdyc
[WIP] Add minhash deduplicator based on RAY. dj:dist issues/PRs about distributed data processing dj:op issues/PRs about some specific OPs
#502 opened Nov 28, 2024 by chenyushuo Loading…
add grouper and aggregator op for system_prompt agent related to agent
#500 opened Nov 27, 2024 by BeachWang Loading…
@BeachWang
Add minhash deduplicator based on RAY and Redis
#489 opened Nov 15, 2024 by pan-x-c Loading…
5
支持RangeSpecifiedFieldSelector使用指定字段的值域进行数据选择
#432 opened Sep 21, 2024 by 2108038773 • Draft
1
Automatically split input dataset in ray mode
#415 opened Sep 4, 2024 by pan-x-c Loading…
1
3
[WIP]Add text tagging by prompt mapper op dj:op issues/PRs about some specific OPs
#408 opened Aug 30, 2024 by garyzhang99 Loading…
1 task
@garyzhang99
8
Add text_pair_similarity_filter dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
#405 opened Aug 28, 2024 by Qirui-jiao • Draft
3
Add sentence_augmentation_mapper dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
#401 opened Aug 22, 2024 by Qirui-jiao • Draft
13
Add mllm_mapper dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
#400 opened Aug 22, 2024 by Qirui-jiao • Draft
18
Add sdxl_prompt2prompt_mapper dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
#395 opened Aug 21, 2024 by Qirui-jiao • Draft
2
[Ready] Add image_segment_mapper dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
#394 opened Aug 21, 2024 by Qirui-jiao Loading…
@drcege
9
Add GPT-4V as evaluator dj:multimodal issues/PRs about multimodal data processing enhancement New feature or request stale-pr
#276 opened Mar 22, 2024 by drcege • Draft DJ-SORA
@drcege
13
ProTip! no:milestone will show everything without a milestone.