Release v0.2.0: bwm_ephys 1.2.0 with waveforms and ACGs - #13
Merged
Conversation
Bumps bwm_ephys archive to 1.2.0, which adds clusters.pqt (621 733 × 59), peak-channel waveforms, and log-binned ACGs at the dataset root. Updates download script, skill references, and adds CHANGELOG files. Adds changelog and versioning scheme to CONTRIBUTING.md.
rossant
reviewed
Jun 3, 2026
rossant
left a comment
rossant
left a comment
Member
There was a problem hiding this comment.
Worth adding some provenance notes for the new clusters parquet table?
Member
Author
|
Good point, I've added the links to the slurm repository where we keep those large tables generation jobs ! |
rossant
reviewed
Jun 5, 2026
rossant
left a comment
rossant
left a comment
Member
There was a problem hiding this comment.
I pushed a small validation branch here: cyrille/validate-bwm-ephys-1.2, feel free to merge it.
It seems that some metadata files inside the archive still mention the old version: provenance.yaml and manifest.json still say 1.1.0, and manifest.json does not list the new cluster/waveform/ACG files.
We should perhaps fix those archive metadata files, update the SHA1, and then merge or cherry-pick the validation branch into this PR?
- provenance.yaml: dataset_version 1.1.0 → 1.2.0 - manifest.json: dataset_version 1.1.0 → 1.2.0, add 4 missing root files - scripts/download_datasets.py: update SHA1 to match corrected archive
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
bwm_ephysarchive to 1.2.0: addsclusters.pqt(621 733 × 59 cols), peak-channel waveforms (clusters.waveforms_peak.npy), log-binned ACGs (clusters.acgs_log.npy), and shared lag-time axis (acgs_log.times.npy) at the dataset root.scripts/download_datasets.pywith new URL and SHA1.skills/ibl-loadreferences to document the new files and loading guidance forbwm_ephys ≥ 1.2.0.CHANGELOG.mdandCHANGELOG_DATA.mdwith Keep a Changelog conventions.docs/CONTRIBUTING.md.Test plan
uv run python scripts/download_datasets.pyon a clean checkout and verify extraction + SHA1.clusters.pqtand confirm 621 733 rows and 59 columns.(621733, 128).