This repository was archived by the owner on Nov 11, 2022. It is now read-only.
Version 0.4.20150602
Pre-release
Pre-release
·
133 commits
to 01bd710a8275e4d0a6e78291d1ce450871f31f1c
since this release
- Added a dependency on the gcloud core component version 2015.02.05 or newer. Update to the latest version of gcloud by running gcloud components update. See Application Default Credentials for more details on how credentials can be specified.
- Removed previously deprecated Flatten.create(). Use Flatten.pCollections() instead.
- Removed previously deprecated Coder.isDeterministic(). Implement Coder.verifyDeterministic() instead.
- Replaced DoFn.Context#createAggregator with DoFn#createAggregator.
- Added support for querying the current value of an Aggregator. See PipelineResult for more information.
- Added experimental DoFnWithContext to simplify accessing additional information from a DoFn.
- Removed experimental RequiresKeyedState.
- Added CannotProvideCoderException to indicate inability to infer a coder, instead of returning null in such cases.
- Added CoderProperties for assembling test suites for user-defined coders.
- Replaced a constructor of PDone with a static factory PDone.in(Pipeline).
- Updated string formatting of the TIMESTAMP values returned by the BigQuery source, when using DirectPipelineRunner or when BigQuery data is used as a side input, which aligns it with the case when BigQuery data is used as a main input.
- Added a requirement that the value returned by Source.Reader.getCurrent() must be immutable and remain valid indefinitely.
- Replaced some usage of Source with BoundedSource. For example, Read.from() transform can now only be applied to BoundedSource objects.
- Moved experimental late-data handling, i.e., the data that arrives to the streaming pipeline after the watermark has passed it, from PubSubIO to Window. Late data will default to being dropped at the first GroupByKey following a Read operation. To allow late data through use Window.Bound#withAllowedLateness.
- Added experimental support for accumulating elements within a window across panes.