Skip to content

Issues: mosaicml/streaming

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

54 Open 131 Closed
54 Open 131 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Expose StreamingDataset world (or world_size and rank) as argument enhancement New feature or request
#854 opened Dec 19, 2024 by lukemelas
Will cache eviction logic take previously-existing shards into account?
#844 opened Dec 5, 2024 by jamin-chen
3
Support for Lance enhancement New feature or request
#832 opened Nov 20, 2024 by oceanusxiv
3
Pipeline Parallelism (Supported? How to?) enhancement New feature or request
#827 opened Nov 14, 2024 by casper-hansen
3
Cannot Load MDS Dataset bug Something isn't working
#824 opened Nov 11, 2024 by naston
36
UnicodeDecodeError: ... Efficient way to debug the dataset with streaming? enhancement New feature or request
#820 opened Nov 1, 2024 by TAYmit
4
write to S3 is very slow bug Something isn't working
#812 opened Oct 25, 2024 by charliedream1
3
Choose JPEG compression level enhancement New feature or request
#811 opened Oct 24, 2024 by cabreraalex
1
1
MosaicML-Streaming on Databricks
#801 opened Oct 10, 2024 by gtmdotme
9
Support for on-the-fly filtering enhancement New feature or request
#800 opened Oct 9, 2024 by ColinToft
1
Make epoch_sample_ids cachable enhancement New feature or request
#792 opened Sep 28, 2024 by janEbert
2
Dataset does not work after stopping training bug Something isn't working
#781 opened Sep 15, 2024 by gluonfield
1
Sparse Numpy Arrays enhancement New feature or request
#780 opened Sep 10, 2024 by Matagi1996
JointWriter: Allow shard file appending bug Something isn't working
#775 opened Sep 5, 2024 by janEbert
2
MemoryError: Unable to allocate bug Something isn't working
#771 opened Sep 2, 2024 by gluonfield
1
File exists: '/000000_epoch_shape' when using the ddp strategy from pytorch lightning bug Something isn't working
#767 opened Aug 25, 2024 by elbamos
23
Estimate total shards at the beginning of data conversion enhancement New feature or request
#742 opened Aug 3, 2024 by abhijithneilabraham
1
huge temp files while uploading data using MDS writer bug Something isn't working
#734 opened Jul 24, 2024 by MaxxP0
2
Download optimal for device_per_stream batching method.
#726 opened Jul 16, 2024 by huxuan
4
Replication changes sample order bug Something isn't working
#725 opened Jul 15, 2024 by CodeCreator
3
'File exists: "/00000_locals"' when integrated with deepspeed training scripts bug Something isn't working
#717 opened Jul 8, 2024 by Clement25
4
All processes allocate memory on rank 0 during StreamingDataset initialization in a distributed setting bug Something isn't working
#716 opened Jul 2, 2024 by ohallstrom
4
Optional dependency for different storages? enhancement New feature or request
#709 opened Jun 24, 2024 by huxuan
2
Suboptimal usage of 8xH100 GPUs - Streaming dataloader speed significantly fluctuates across batches bug Something isn't working
#686 opened May 25, 2024 by VSehwag
7
Last entry in the dataset is causing "Relative sample index $x is not present" error bug Something isn't working
#677 opened May 20, 2024 by isidentical
3
ProTip! Exclude everything labeled bug with -label:bug.