s3-connector-for-pytorch v1.0.0

v1.0.0 (November 22, 2023)

• The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.

New features

• S3IterableDataset and S3MapDataset, which allow building either an iterable-style or map-style dataset, using your S3
  stored data, by specifying an S3 URI (a bucket and optional prefix) and the region the bucket is in.
• Support for multiprocess data loading for the above datasets.
• S3Checkpoint, an interface for saving and loading model checkpoints directly to and from an S3 bucket.

Breaking changes

• No breaking changes.

PyPi Project

https://pypi.org/project/s3torchconnector/