Search results

Try <code>obstore</code> for LitData Chunks

enhancementNew feature or requestNew feature or request

Status: Open.

#663 In Lightning-AI/litData;

· bhimrazy opened on Jul 27, 2025

Support Cycling a CombinedStreamingDataset

enhancementNew feature or requestNew feature or request

Status: Open.

#658 In Lightning-AI/litData;

· shaoyuancc opened on Jul 22, 2025

Support for subclasses of <code>StreamingDataset</code> with different length

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#642 In Lightning-AI/litData;

· philgzl opened on Jun 30, 2025

Explore Optimizing and Running Tests in Parallel for Faster CI in <code>litdata</code>

ci / tests

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#612 In Lightning-AI/litData;

· bhimrazy opened on Jun 4, 2025

Add example for hugging face dataset optimization and benchmarks reports

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#558 In Lightning-AI/litData;

· bhimrazy opened on Apr 17, 2025

<code>OutOfBoundsError</code> when streaming parquet files with <code>low_memory=True</code>

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

waiting on authorWaiting for user input or feedback.Waiting for user input or feedback.

Status: Open.

Bug

#553 In Lightning-AI/litData;

· kyoungrok0517 opened on Apr 13, 2025

Cycle option for StreamingDataLoader

enhancementNew feature or requestNew feature or request

waiting on authorWaiting for user input or feedback.Waiting for user input or feedback.

Status: Open.

Feature

#524 In Lightning-AI/litData;

· Aceticia opened on Mar 24, 2025

Local cache dir not fully clearing in DDP multi-node training.

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#512 In Lightning-AI/litData;

· JackUrb opened on Mar 12, 2025

Add batch sampler for StreamDataloader to enable flexiable training strategy.

enhancementNew feature or requestNew feature or request

Status: Open.

#509 In Lightning-AI/litData;

· xinsir6 opened on Mar 11, 2025

CI error: <code>All chunks should've been deleted</code> keeps coming back

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#437 In Lightning-AI/litData;

· deependujha opened on Dec 20, 2024

Restart training with new data, mid-epoch

enhancementNew feature or requestNew feature or request

Status: Open.

#436 In Lightning-AI/litData;

· schopra8 opened on Dec 17, 2024

Clear Examples of use with different dataset types and code changes.

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

Status: Open.

#409 In Lightning-AI/litData;

· Woodr7 opened on Nov 4, 2024