Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
ca8370d
now we have an impl
finbarrtimbers Nov 17, 2025
aba8948
Cleaned up code
finbarrtimbers Nov 17, 2025
180272e
updated code
finbarrtimbers Nov 17, 2025
8696410
Added streaming data loader file.
finbarrtimbers Nov 17, 2025
9cc8cab
Cleaned up init order
finbarrtimbers Nov 17, 2025
4a68d0c
Clean up
finbarrtimbers Nov 17, 2025
ee012ab
Cleaned up PR
finbarrtimbers Nov 17, 2025
0941163
Cleaned up code. deleted unused code.
finbarrtimbers Nov 17, 2025
0c5a98d
deleted code
finbarrtimbers Nov 17, 2025
3271f4f
Updated code
finbarrtimbers Nov 17, 2025
504d13f
Fix StreamingDataLoaderConfig to pass runtime values as parameters
finbarrtimbers Nov 17, 2025
2fa3a11
Move pack_length validation to StreamingDataLoaderConfig
finbarrtimbers Nov 18, 2025
7e049b3
Move max_prompt_token_length and response_length to StreamingDataLoad…
finbarrtimbers Nov 18, 2025
c2b96fa
Move validation to StreamingDataLoaderConfig.__post_init__
finbarrtimbers Nov 18, 2025
56823d9
Move async_steps and num_samples_per_prompt_rollout to StreamingDataL…
finbarrtimbers Nov 18, 2025
6e562d8
Fix validation references in __post_init__
finbarrtimbers Nov 18, 2025
77ed3dd
Move inference_batch_size computation to setup_runtime_variables
finbarrtimbers Nov 18, 2025
3544474
Format code with ruff
finbarrtimbers Nov 18, 2025
5273b09
fixed code.
finbarrtimbers Nov 18, 2025
f71f3d2
fixed bug in metrics
finbarrtimbers Nov 18, 2025
fe2aec0
Fixed error
finbarrtimbers Nov 18, 2025
cb9ae42
added percent_solved_hist
finbarrtimbers Nov 18, 2025
4059fe5
Fixed metrics
finbarrtimbers Nov 18, 2025
346995c
fixed metrics
finbarrtimbers Nov 18, 2025
144a86f
updated code
finbarrtimbers Nov 18, 2025
19645a2
updated the code to remove extra args param.
finbarrtimbers Nov 18, 2025
e97335c
fixed tests
finbarrtimbers Nov 18, 2025
0c464c8
Fixed tests.
finbarrtimbers Nov 18, 2025
f6e420a
Fixed sharding
finbarrtimbers Nov 19, 2025
dec1b4b
Added barrier
finbarrtimbers Nov 19, 2025
1bdd302
using same accumulation steps
finbarrtimbers Nov 19, 2025
72a15e7
Updated metrics averaging.
finbarrtimbers Nov 20, 2025
cfcfb5e
updated code with debug logs
finbarrtimbers Nov 21, 2025
cc12a31
now trying to run again
finbarrtimbers Nov 21, 2025
f977121
uses global dataset index
finbarrtimbers Nov 21, 2025
2bae3fc
Merge branch 'oc-dataloader' into oc-dataloader-rebased
finbarrtimbers Nov 24, 2025
a09b73a
Remove duplicate add_prompt_to_generator and load_data_from_packing_t…
finbarrtimbers Nov 24, 2025
eee872a
Fix duplicate async_steps argument in argparse
finbarrtimbers Nov 24, 2025
e18f3af
Remove remaining duplicate fields from Args class
finbarrtimbers Nov 24, 2025
911bf44
Remove pack_length validation from Args
finbarrtimbers Nov 24, 2025
fc1c863
Add missing inference_batch_size field to Args class
finbarrtimbers Nov 24, 2025
96b32f7
Remove reference to deprecated use_fp8_kv_cache field
finbarrtimbers Nov 24, 2025
e02704c
Fix num_samples_per_prompt_rollout field access
finbarrtimbers Nov 24, 2025
6271708
dynamically calculates require metrics
finbarrtimbers Nov 25, 2025
1b1ffbc
updated to get num verifiers
finbarrtimbers Nov 25, 2025
1312255
Merge branch 'main' into oc-dataloader
finbarrtimbers Nov 25, 2025
b4f751f
Fixed code
finbarrtimbers Nov 25, 2025
b32acc1
tests pass
finbarrtimbers Nov 25, 2025
d6f8309
fixed sharding
finbarrtimbers Nov 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading