Releases: apache/opendal
v0.50.2
Release List
Name | Version | Next |
---|---|---|
core | 0.50.1 | 0.50.2 |
integrations/cloud_filter | 0.0.2 | 0.0.3 |
integrations/compat | 1.0.0 | 1.0.1 |
integrations/dav-server | 0.2.1 | 0.2.2 |
integrations/fuse3 | 0.0.8 | 0.0.9 |
integrations/object_store | 0.48.1 | 0.48.2 |
integrations/parquet | 0.2.1 | 0.2.2 |
integrations/spring | - | - |
integrations/unftp-sbe | 0.0.8 | 0.0.9 |
integrations/virtiofs | - | - |
bin/oay | 0.41.12 | 0.41.13 |
bin/ofs | 0.0.13 | 0.0.14 |
bin/oli | 0.41.12 | 0.41.13 |
bindings/c | 0.45.0 | 0.45.1 |
bindings/cpp | 0.45.12 | 0.45.13 |
bindings/dotnet | 0.1.10 | 0.1.11 |
bindings/go | 0.1.4 | 0.1.5 |
bindings/haskell | 0.44.12 | 0.44.13 |
bindings/java | 0.47.4 | 0.47.5 |
bindings/lua | 0.1.10 | 0.1.11 |
bindings/nodejs | 0.47.6 | 0.47.7 |
bindings/ocaml | - | - |
bindings/php | 0.1.10 | 0.1.11 |
bindings/python | 0.45.11 | 0.45.12 |
bindings/ruby | 0.1.10 | 0.1.11 |
bindings/swift | - | - |
bindings/zig | - | - |
What's Changed
Added
- feat(services/ftp): List dir shows last modified timestamp by @erickguan in #5213
- feat(bindings/d): add D bindings support by @kassane in #5181
- feat(bindings/python): add sync
File.readline
by @TennyZhuang in #5271 - feat(core/services-azblob): support user defined metadata by @jorgehermo9 in #5274
- feat(core/services-s3): try load endpoint from config by @TennyZhuang in #5279
Changed
Fixed
- fix: add all-features flag for opendal_compat doc build by @XmchxUp in #5234
- fix(integrations/compat): Capability has different fields by @Xuanwo in #5236
- fix(integration/compat): Fix opendal 0.50 OpList has new field by @Xuanwo in #5238
- fix(integrations/compat): Fix dead loop happened during list by @Xuanwo in #5240
Docs
- docs: Move our release process to github discussions by @Xuanwo in #5217
- docs: change "Github" to "GitHub" by @MohammadLotfiA in #5250
CI
- ci(asf): Don't add
[DISCUSS]
prefix for discussion by @Xuanwo in #5210 - build: enable services-mysql for Java and Python bindings by @tisonkun in #5222
- build(binding/python): Support Python 3.13 by @Zheaoli in #5248
Chore
- chore(bin/*): remove useless deps by @koushiro in #5212
- chore: tidy up c binding build and docs by @tisonkun in #5243
- chore(core/layers): adjust await point to simplify combinator code by @koushiro in #5255
- chore(core/blocking_operator): deduplicate deprecated
is_exist
logic by @simonsan in #5261 - chore(deps): bump actions/cache from 3 to 4 by @dependabot in #5262
- chore: run object_store tests in CI by @jorgehermo9 in #5268
New Contributors
- @MohammadLotfiA made their first contribution in #5250
- @simonsan made their first contribution in #5261
Full Changelog: v0.50.1...v0.50.2
v0.50.1
Upgrade
Bindings C upgrade to v0.45
Change to use Cmake
to build the C binding.
Release List
Name | Version | Next |
---|---|---|
core | 0.50.0 | 0.50.1 |
integrations/cloud_filter | 0.0.1 | 0.0.2 |
integrations/compat | - | 1.0.0 |
integrations/dav-server | 0.2.0 | 0.2.1 |
integrations/fuse3 | 0.0.7 | 0.0.8 |
integrations/object_store | 0.48.0 | 0.48.1 |
integrations/parquet | 0.2.0 | 0.2.1 |
integrations/spring | - | - |
integrations/unftp-sbe | 0.0.7 | 0.0.8 |
integrations/virtiofs | - | - |
bin/oay | 0.41.11 | 0.41.12 |
bin/ofs | 0.0.12 | 0.0.13 |
bin/oli | 0.41.11 | 0.41.12 |
bindings/c | 0.44.13 | 0.45.0 |
bindings/cpp | 0.45.11 | 0.45.12 |
bindings/dotnet | 0.1.9 | 0.1.10 |
bindings/go | 0.1.3 | 0.1.4 |
bindings/haskell | 0.44.11 | 0.44.12 |
bindings/java | 0.47.3 | 0.47.4 |
bindings/lua | 0.1.9 | 0.1.10 |
bindings/nodejs | 0.47.5 | 0.47.6 |
bindings/ocaml | - | - |
bindings/php | 0.1.9 | 0.1.10 |
bindings/python | 0.45.10 | 0.45.11 |
bindings/ruby | 0.1.9 | 0.1.10 |
bindings/swift | - | - |
bindings/zig | - | - |
What's Changed
Added
- feat(core/redis): Replace client requests with connection pool by @jackyyyyyssss in #5117
- feat: add copy api for lakefs service. by @liugddx in #5114
- feat(core): add version(bool) for List operation to include version d… by @meteorgan in #5106
- feat(bindings/python): export ConcurrentLimitLayer by @TennyZhuang in #5140
- feat(bindings/c): add writer operation for Bindings C and Go by @yuchanns in #5141
- feat(ofs): introduce ofs macos support by @oowl in #5136
- feat: Reduce stat operation if we are reading all by @Xuanwo in #5146
- feat: add NebulaGraph config by @GG2002 in #5147
- feat(integrations/spring): add spring serialize method by @shoothzj in #5154
- feat: support write,read,delete with template by @shoothzj in #5156
- feat(bindings/java): support ConcurrentLimitLayer by @tisonkun in #5168
- feat: Add if_none_match for write by @ForestLH in #5129
- feat: Add OpenDAL Compat by @Xuanwo in #5185
- feat(core): abstract HttpFetch trait for raw http client by @everpcpc in #5184
- feat: Support NebulaGraph by @GG2002 in #5116
- feat(bindings/cpp): rename is_exist to exists as core did by @PragmaTwice in #5198
- feat(bindings/c): add opendal_operator_exists and mark is_exist deprecated by @PragmaTwice in #5199
- feat(binding/java): prefix thread name with opendal-tokio-worker by @tisonkun in #5197
Changed
- refactor(services/cloudflare-kv): remove unneeded async and result on parse_error by @tsfotis in #5128
- refactor(*): remove unneeded async and result on parse_error by @tsfotis in #5131
- refactor: align C binding pattern by @tisonkun in #5160
- refactor: more consistent C binding pattern by @tisonkun in #5162
- refactor(integration/parquet): Use ParquetMetaDataReader instead by @Xuanwo in #5170
- refactor: resolve c pointers const by @tisonkun in #5171
- refactor(types/operator): rename is_exist to exists by @photino in #5193
Fixed
- fix(services/huggingface): Align with latest HuggingFace API by @morristai in #5123
- fix(bindings/c): use
ManuallyDrop
instead offorget
to make sure pointer is valid by @ethe in #5166 - fix(services/s3): Mark xml deserialize error as temporary during list by @Xuanwo in #5178
Docs
- docs: add spring integration configuration doc by @shoothzj in #5053
- docs: improve Node.js binding's test doc by @tisonkun in #5159
- docs(bindings/c): update docs for CMake replacing by @PragmaTwice in #5186
CI
- ci(bindings/nodejs): Fix diff introduced by napi by @Xuanwo in #5121
- ci: Disable aliyun drive test until #5163 addressed by @Xuanwo in #5164
- ci: add package cache for build-haskell-doc by @XmchxUp in #5173
- ci: add cache action for ci_bindings_ocaml & build-ocaml-doc by @XmchxUp in #5174
- ci: Fix failing CI on ocaml and python by @Xuanwo in #5177
- build(bindings/c): replace the build system with CMake by @PragmaTwice in #5182
- build(bindings/cpp): fetch and build dependencies instead of finding system libs by @PragmaTwice in #5188
- ci: Remove not needed --break-system-packages by @Xuanwo in #5196
- ci: Send discussions to [email protected] by @Xuanwo in #5201
Chore
- chore(bindings/python): deprecate via_map method by @TennyZhuang in #5134
- chore: update binding java artifact name in README by @tisonkun in #5137
- chore(fixtures/s3): Upgrade MinIO version by @ForestLH in #5142
- chore(deps): bump clap from 4.5.17 to 4.5.18 in /bin/ofs by @dependabot in #5149
- chore(deps): bump crate-ci/typos from 1.24.3 to 1.24.6 by @dependabot in #5150
- chore(deps): bump anyhow from 1.0.87 to 1.0.89 in /bin/oay by @dependabot in #5151
- chore(deps): bump anyhow from 1.0.87 to 1.0.89 in /bin/oli by @dependabot in #5152
- chore: fix typos in tokio_executor.rs by @tisonkun in #5157
- chore: hint when java tests are skipped by @tisonkun in #5158
- chore: Include license in the packaged crate by @davide125 in #5176
New Contributors
- @BaurzhanSakhariev made their first contribution in #5120
- @tsfotis made their first contribution in #5128
- @ForestLH made their first contribution in #5142
- @ethe made their first contribution in #5166
- @XmchxUp made their first contribution in #5173
- @davide125 made their first contribution in #5176
- @photino made their first contribution in #5193
Full Changelog: v0.50.0...v0.50.1
v0.50.0
Release List
Name | Version | Next |
---|---|---|
core | 0.49.2 | 0.50.0 |
integrations/dav-server | 0.1.0 | 0.1.1 |
integrations/fuse3 | 0.0.6 | 0.0.7 |
integrations/object_store | 0.47.0 | 0.47.1 |
integrations/parquet | 0.1.2 | 0.2.0 |
integrations/unftp-sbe | 0.0.6 | 0.0.7 |
bin/oay | 0.41.10 | 0.41.11 |
bin/ofs | 0.0.11 | 0.0.12 |
bin/oli | 0.41.10 | 0.41.11 |
bindings/c | 0.44.12 | 0.44.13 |
bindings/cpp | 0.45.10 | 0.45.11 |
bindings/dotnet | 0.1.8 | 0.1.9 |
bindings/go | 0.1.2 | 0.1.3 |
bindings/haskell | 0.44.10 | 0.44.11 |
bindings/java | 0.47.2 | 0.47.3 |
bindings/lua | 0.1.8 | 0.1.9 |
bindings/nodejs | 0.47.4 | 0.47.5 |
bindings/php | 0.1.8 | 0.1.9 |
bindings/python | 0.45.9 | 0.45.10 |
bindings/ruby | 0.1.8 | 0.1.9 |
Upgrade to OpenDAL Core v0.50
Public API
services-postgresql
's connect string now supports only URL format
Previously, it supports both URL format and key-value format. After switching the implementation from tokio-postgres
to sqlx
, the service now supports only the URL format.
list
now returns path itself
Previously, list("a/b")
would not return a/b
even if it does exist. Since v0.50.0, this behavior has been changed. OpenDAL will now return the path itself if it exists. This change applies to all cases, whether the path is a directory or a file.
Refactoring of the metrics-related layer
In OpenDAL v0.50.0, we did a refactor on all metrics-related layers. They are now sharing the same underlying implemenationts. PrometheusLayer
, PrometheusClientLayer
and MetricsLayer
are now have similar public APIs and exactly the same metrics value.
What's Changed
Added
- feat(core)!: make list return path itself by @meteorgan in #4959
- feat(services/oss): support role_arn and oidc_provider_arn by @tisonkun in #5063
- feat(services): add lakefs support by @liugddx in #5086
- feat: add list api for lakefs service. by @liugddx in #5092
- feat: add write api for lakefs service. by @liugddx in #5100
- feat: add delete api for lakefs service. by @liugddx in #5107
Changed
- refactor: use sqlx for sql services by @tisonkun in #5040
- refactor(core)!: Add observe layer as building block by @Xuanwo in #5064
- refactor(layers/prometheus): rewrite prometheus layer based on observe mod by @koushiro in #5069
- refactor(bindings/java): replace
num_cpus
withstd::thread::available_parallelism
by @miroim in #5080 - refactor(layers/prometheus): provide builder APIs by @koushiro in #5072
- refactor(layers/prometheus-client): provide builder APIs by @koushiro in #5073
- refactor(layers/metrics): rewrite metrics layer using observe layer by @koushiro in #5098
Fixed
- fix(core): TimeoutLayer now needs enable tokio time by @Xuanwo in #5057
- fix(core): Fix failed list related tests by @Xuanwo in #5058
- fix(services/memory): blocking_scan right range by @meteorgan in #5062
- fix(core/services/mysql): Fix mysql Capability by @jackyyyyyssss in #5067
- fix: fix rust 1.76 error due to temporary value being dropped by @aawsome in #5071
- fix(service/fs): error due to temporary value being dropped by @miroim in #5079
- fix(core/services/hdfs): Fix the HDFS write failure when atomic_write_dir is set by @meteorgan in #5039
- fix(services/icloud): adjust error handling code to avoid having to write out result type explicitly by @koushiro in #5091
- fix(services/monoiofs): handle async cancel during file open by @NKID00 in #5094
Docs
CI
- ci(bindings/go): add golangci-lint by @yuchanns in #5060
- ci(bindings/zig): Fix build and test of zig on 0.13 by @Xuanwo in #5102
- ci: Don't publish with all features by @Xuanwo in #5108
- ci: Fix upload-artifacts doesn't include hidden files by @Xuanwo in #5112
Chore
- chore(bindings/go): bump ffi and sys version by @shoothzj in #5055
- chore: Bump backon to 1.0.0 by @Xuanwo in #5056
- chore(services/rocksdb): fix misuse rocksdb prefix iterator by @meteorgan in #5059
- chore(README): add Go binding badge by @yuchanns in #5074
- chore(deps): bump crate-ci/typos from 1.23.6 to 1.24.3 by @dependabot in #5085
- chore(layers/prometheus-client): export
PrometheusClientLayerBuilder
type by @koushiro in #5093 - chore(layers): check the examples when running tests by @koushiro in #5104
- chore(integrations/parquet): Bump parquet to 53 by @Xuanwo in #5109
- chore: Bump OpenDAL to 0.50.0 by @Xuanwo in #5110
New Contributors
- @jackyyyyyssss made their first contribution in #5067
- @aawsome made their first contribution in #5071
- @liugddx made their first contribution in #5086
Full Changelog: v0.49.2...v0.50.0
v0.49.2
Release List
Name | Version |
---|---|
core | 0.49.2 |
integrations/dav-server | 0.1.0 |
integrations/fuse3 | 0.0.6 |
integrations/object_store | 0.47.0 |
integrations/parquet | 0.1.2 |
integrations/unftp-sbe | 0.0.6 |
bin/oay | 0.41.10 |
bin/ofs | 0.0.11 |
bin/oli | 0.41.10 |
bindings/c | 0.44.12 |
bindings/cpp | 0.45.10 |
bindings/dotnet | 0.1.8 |
bindings/go | 0.1.2 |
bindings/haskell | 0.44.10 |
bindings/java | 0.47.2 |
bindings/lua | 0.1.8 |
bindings/nodejs | 0.47.4 |
bindings/php | 0.1.8 |
bindings/python | 0.45.9 |
bindings/ruby | 0.1.8 |
What's Changed
Added
- feat(ovfs): support read and write by @zjregee in #5016
- feat(bin/ofs): introduce
integrations/cloudfilter
for ofs by @ho-229 in #4935 - feat(integrations/spring): add AutoConfiguration class for Spring Mvc and Webflux by @shoothzj in #5019
- feat(services/monoiofs): impl read and write, add behavior test by @NKID00 in #4944
- feat(core/services-s3): support user defined metadata by @haoqixu in #5030
- feat: align
fn root
semantics; fix missing root for some services; rm duplicated normalize ops by @yjhmelody in #5035 - feat(core): expose configs always by @tisonkun in #5034
- feat(services/monoiofs): append, create_dir, copy and rename by @NKID00 in #5041
Changed
- refactor(core): new type to print context and reduce allocations by @evenyag in #5021
- refactor(layers/prometheus-client): remove useless
scheme
field fromPrometheusAccessor
andPrometheusMetricWrapper
type by @koushiro in #5026 - refactor(layers/prometheus-client): avoid multiple clone of labels by @koushiro in #5028
- refactor(core/services-oss): remove the
starts_with
by @haoqixu in #5036
Fixed
- fix(layers/prometheus-client): remove duplicated
increment_request_total
of write operation by @koushiro in #5023 - fix(services/monoiofs): drop JoinHandle in worker thread by @NKID00 in #5031
CI
- ci: Add contents write permission for build-website by @Xuanwo in #5017
- ci: Fix test for service ghac by @Xuanwo in #5018
- ci(integrations/spring): add spring boot bean load test by @shoothzj in #5032
Chore
- chore: fix path typo in release docs by @tisonkun in #5038
- chore: align the
token
method semantics by @yjhmelody in #5045
New Contributors
- @MahdiBaghbani made their first contribution in #5020
- @haoqixu made their first contribution in #5030
- @yjhmelody made their first contribution in #5035
Full Changelog: v0.49.1...v0.49.2
v0.49.1
Release List
Name | Next |
---|---|
core | 0.49.1 |
integrations/dav-server | 0.0.8 |
integrations/fuse3 | 0.0.5 |
integrations/object_store | 0.46.1 |
integrations/parquet | 0.1.1 |
integrations/unftp-sbe | 0.0.5 |
bin/oay | 0.41.9 |
bin/ofs | 0.0.10 |
bin/oli | 0.41.9 |
bindings/c | 0.44.11 |
bindings/cpp | 0.45.9 |
bindings/dotnet | 0.1.7 |
bindings/go | 0.1.1 |
bindings/haskell | 0.44.9 |
bindings/java | 0.47.1 |
bindings/lua | 0.1.7 |
bindings/nodejs | 0.47.3 |
bindings/php | 0.1.7 |
bindings/python | 0.45.8 |
bindings/ruby | 0.1.7 |
What's Changed
Added
- feat(ovfs): add lookup and unit tests by @zjregee in #4997
- feat(gcs): allow setting a token directly by @jdockerty in #4978
- feat(integrations/cloudfilter): introduce behavior tests by @ho-229 in #4973
- feat(integrations/spring): add spring project module by @shoothzj in #4988
- feat(fs): expose the metadata for fs services by @Aitozi in #5005
- feat(ovfs): add file creation and deletion by @zjregee in #5009
Fixed
- fix(integrations/spring): correct parent artifactId by @shoothzj in #5007
- fix(bindings/python): Make sure read until EOF by @Bicheka in #4995
Docs
- docs: Fix version detect in website by @Xuanwo in #5003
- docs: add branding, license and trademarks to integrations by @PsiACE in #5006
- docs(integrations/cloudfilter): improve docs and examples by @ho-229 in #5010
CI
Chore
- chore(deps): bump fastrace to 0.7.1 by @andylokandy in #5008
- chore(bindings): Disable mysql service for java and python by @Xuanwo in #5013
- chore: Bump version to 0.49.1 - Round 2 by @Xuanwo in #5014
New Contributors
Full Changelog: v0.49.0...v0.49.1
v0.49.0
Release List
Name | Next |
---|---|
core | 0.49.0 |
integrations/dav-server | 0.0.7 |
integrations/fuse3 | 0.0.4 |
integrations/object_store | 0.46.0 |
integrations/parquet | 0.1.0 |
integrations/unftp-sbe | 0.0.4 |
bin/oay | 0.41.8 |
bin/ofs | 0.0.9 |
bin/oli | 0.41.8 |
bindings/c | 0.44.10 |
bindings/cpp | 0.45.8 |
bindings/dotnet | 0.1.6 |
bindings/go | 0.1.0 |
bindings/haskell | 0.44.8 |
bindings/java | 0.47.0 |
bindings/lua | 0.1.6 |
bindings/nodejs | 0.47.2 |
bindings/php | 0.1.6 |
bindings/python (*) | 0.45.8 |
bindings/ruby | 0.1.6 |
- (*): We expected to release Python
0.45.8
, but due to #5000, we were unable to. We will release it next time.
OpenDAL Core Upgrade to v0.49
Public API
Configurator
now returns associated builder instead
Configurator
used to return impl Builder
, but now it returns associated builder type directly. This will allow users to use the builder in a more flexible way.
impl Configurator for MemoryConfig {
- fn into_builder(self) -> impl Builder {
+ type Builder = MemoryBuilder;
+ fn into_builder(self) -> Self::Builder {
MemoryBuilder { config: self }
}
}
LoggingLayer
now accepts LoggingInterceptor
LoggingLayer
now accepts LoggingInterceptor
trait instead of configuration. This change will allow users to customize the logging behavior more flexibly.
pub trait LoggingInterceptor: Debug + Clone + Send + Sync + Unpin + 'static {
fn log(
&self,
info: &AccessorInfo,
operation: Operation,
context: &[(&str, &str)],
message: &str,
err: Option<&Error>,
);
}
Users can now implement the log in the way they want.
OpenDAL Java Binding Upgrade to v0.47
Breaking change
artifactId of the opendal-java
has changed from to opendal
to align with the convention of entire OpenDAL project.
<dependencies>
<dependency>
<groupId>org.apache.opendal</groupId>
- <artifactId>opendal-java</artifactId>
+ <artifactId>opendal</artifactId>
<version>${opendal.version}</version>
</dependency>
<dependency>
<groupId>org.apache.opendal</groupId>
- <artifactId>opendal-java</artifactId>
+ <artifactId>opendal</artifactId>
<version>${opendal.version}</version>
<classifier>${os.detected.classifier}</classifier>
</dependency>
</dependencies>
What's Changed
Added
- feat(o): Add cargo-o layout by @Xuanwo in #4934
- feat: impl
put_multipart
inobject_store
by @Rachelint in #4793 - feat: introduce opendal
AsyncWriter
for parquet integrations by @WenyXu in #4958 - feat(services/http): implement presigned request for backends without authorization by @NickCao in #4970
- feat(bindings/python): strip the library for minimum file size by @NickCao in #4971
- feat(gcs): allow unauthenticated requests by @jdockerty in #4965
- feat: introduce opendal
AsyncReader
for parquet integrations by @WenyXu in #4972 - feat(services/s3): add role_session_name in assume roles by @nerdroychan in #4981
- feat: support root path for moka and mini-moka by @meteorgan in #4984
- feat(ovfs): export VirtioFs struct by @zjregee in #4983
- feat(core)!: implement an interceptor for the logging layer by @evenyag in #4961
- feat(ovfs): support getattr and setattr by @zjregee in #4987
Changed
- refactor(java)!: Rename artifacts id opendal-java to opendal by @Xuanwo in #4957
- refactor(core)!: Return associated builder instead by @Xuanwo in #4968
- refactor(raw): Merge all operations into one enum by @Xuanwo in #4977
- refactor(core): Use kv based context to avoid allocations by @Xuanwo in #4986
Fixed
- fix(services/memory): MemoryConfig implement Debug by @0x676e67 in #4942
- fix(layers/promethues-client): doc link by @koushiro in #4951
- fix(gcs): do not skip signing with
allow_anonymous
by @jdockerty in #4979
Docs
CI
- ci: Bump nextest to 0.9.72 by @Xuanwo in #4932
- ci: setup cloudfilter by @ho-229 in #4936
- ci: Try fix opendal-lua build by @Xuanwo in #4952
Chore
- chore(deps): bump crate-ci/typos from 1.22.9 to 1.23.6 by @dependabot in #4948
- chore(deps): bump tokio from 1.39.1 to 1.39.2 in /bin/oli by @dependabot in #4949
- chore(deps): bump bytes from 1.6.1 to 1.7.0 in /bin/ofs by @dependabot in #4947
- chore(deps): bump tokio from 1.39.1 to 1.39.2 in /bin/oay by @dependabot in #4946
- chore(core): fix nightly lints by @xxchan in #4953
- chore(integrations/parquet): add README by @WenyXu in #4980
- chore(core): Bump redis version by @Xuanwo in #4985
- chore: Bump package versions by @Xuanwo in #4989
New Contributors
- @0x676e67 made their first contribution in #4942
- @Rachelint made their first contribution in #4793
- @koushiro made their first contribution in #4951
- @NickCao made their first contribution in #4970
- @jdockerty made their first contribution in #4965
- @nerdroychan made their first contribution in #4981
Full Changelog: v0.48.0...v0.49.0
v0.48.0
Release List
Name | Version |
---|---|
core | 0.48.0 |
integrations/cloudfilter | 0.0.0 |
integrations/dav-server | 0.0.6 |
integrations/fuse3 | 0.0.3 |
integrations/object_store | 0.45.0 |
integrations/unftp-sbe | 0.0.3 |
bin/oay | 0.41.7 |
bin/ofs | 0.0.8 |
bin/oli | 0.41.7 |
bindings/c | 0.44.9 |
bindings/cpp | 0.45.7 |
bindings/dotnet | 0.1.5 |
bindings/haskell | 0.44.7 |
bindings/java | 0.46.4 |
bindings/lua | 0.1.5 |
bindings/nodejs | 0.47.1 |
bindings/php | 0.1.5 |
bindings/python | 0.45.7 |
bindings/ruby | 0.1.5 |
OpenDAL Core Upgrade to v0.48
Public API
Typo in customized_credential_load
Since v0.48, the customed_credential_load
function has been renamed to customized_credential_load
to fix the typo of customized
.
- builder.customed_credential_load(v);
+ builder.customized_credential_load(v);
S3 service rename security_token
to session_token
In 2014 Amazon switched from AWS_SECURITY_TOKEN
to AWS_SESSION_TOKEN
. To be consistent with the naming of AWS STS, we have renamed the security_token
field to session_token
in the S3 service.
- builder.security_token(v);
+ builder.session_token(v);
Operator from_iter
and via_iter
replaces from_map
and via_map
Since v0.48, Operator's new APIs from_iter
and via_iter
methods have deprecated the from_map
and via_map
methods.
- Operator::from_map::<Fs>(map)?.finish();
+ Operator::from_iter::<Fs>(map)?.finish();
New API from_iter
and via_iter
should cover all use cases of from_map
and via_map
.
Service builder now takes ownership
Since v0.48, all service builder now takes ownership self
instead of &mut self
. This change will allow users to configure the service in a more flexible way.
- let mut builder = S3::default();
- builder.bucket("test");
- builder.root("/path/to/root");
+ let builder = S3::default().bucket("test").root("/path/to/root");
let op = Operator::new(builder)?.finish();
Raw API
oio::Write::write
will write the whole buffer
Starting from version 0.48, oio::Write::write
now writes the entire buffer. This update aligns the API more closely with oio::Read::read
and simplifies the implementation of concurrent writing.
trait Write {
- fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<usize>>;
+ fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<()>>;
}
write
will now return Result<()>
instead of Result<usize>
. The number of bytes written can be obtained from the buffer's length.
Access::metadata()
will return Arc<AccessInfo>
Starting from version 0.48, Access::metadata()
will return Arc<AccessInfo>
instead of AccessInfo
. This change is intended to improve performance and reduce memory usage.
trait Access {
- fn metadata(&self) -> AccessInfo;
+ fn metadata(&self) -> Arc<AccessInfo>;
}
MinitraceLayer
renamed to FastraceLayer
The MinitraceLayer
has been renamed to FastraceLayer
to respond to the transition from minitrace
to fastrace
.
- use opendal::layers::MinitraceLayer;
+ use opendal::layers::FastraceLayer;
Use Configurator
to replace Builder::from_config
Since v0.48, the Builder::from_config
and Builder::from_map
method has been replaced by the Configurator
trait. The Configurator
trait provides a more flexible and extensible way to configure OpenDAL.
Service implementers should update their code to use the Configurator
trait instead:
impl Configurator for MemoryConfig {
fn into_builder(self) -> impl Builder {
MemoryBuilder { config: self }
}
}
impl Builder for MemoryBuilder {
const SCHEME: Scheme = Scheme::Memory;
type Config = MemoryConfig;
fn build(self) -> Result<impl Access> {
...
}
}
What's Changed
Added
- feat(services/fs): Support fs config by @meteorgan in #4853
- feat(services): init monoiofs by @NKID00 in #4855
- feat(core/types): avoid a copy in
Buffer::to_bytes()
by cloning contiguous bytes by @LDeakin in #4858 - feat(core): Add object versioning for OSS by @Lzzzzzt in #4870
- feat: fs add concurrent write by @hoslo in #4817
- feat(services/s3): Add object versioning for S3 by @Lzzzzzt in #4873
- feat(integrations/cloudfilter): read only cloud filter by @ho-229 in #4856
- feat(bindings/go): Add full native support from C to Go. by @yuchanns in #4886
- feat(bindings/go): add benchmark. by @yuchanns in #4893
- feat(core): support user defined metadata for oss by @meteorgan in #4881
- feat(service/fastrace): rename minitrace to fastrace by @andylokandy in #4906
- feat(prometheus-client): add metric label about
root
on using PrometheusClientLayer by @flaneur2020 in #4907 - feat(services/monoiofs): monoio wrapper by @NKID00 in #4885
- feat(layers/mime-guess): add a layer that can automatically set
Content-Type
based on the extension in the path. by @czy-29 in #4912 - feat(core)!: Make config data object by @tisonkun in #4915
- feat(core)!: from_map is now fallible by @tisonkun in #4917
- ci(bindings/go): always test against the latest core by @yuchanns in #4913
- feat(!): Allow users to build operator from config by @Xuanwo in #4919
- feat: Add from_iter and via_iter for operator by @Xuanwo in #4921
Changed
- refactor(services/s3)!: renamed security_token to session_token by @Zyyeric in #4875
- refactor(core)!: Make oio::Write always write all given buffer by @Xuanwo in #4880
- refactor(core)!: Return
Arc<AccessInfo>
for metadata by @Lzzzzzt in #4883 - refactor(core!): Make service builder takes ownership by @Xuanwo in #4922
- refactor(integrations/cloudfilter): implement Filter instead of SyncFilter by @ho-229 in #4920
Fixed
- fix(services/s3): NoSuchBucket is a ConfigInvalid for OpenDAL by @tisonkun in #4895
- fix: oss will not use the port by @Lzzzzzt in #4899
Docs
- docs(core): update README to add
MimeGuessLayer
. by @czy-29 in #4916 - docs(core): Add upgrade docs for 0.48 by @Xuanwo in #4924
- docs: fix spelling by @jbampton in #4925
- docs(core): Fix comment for into_futures_async_write by @Xuanwo in #4928
CI
- ci: Add issue template and pr template for opendal by @Xuanwo in #4884
- ci: Remove CI reviewer since it doesn't work by @Xuanwo in #4891
Chore
- chore!: fix typo customed should be customized by @tisonkun in #4847
- chore: Fix spelling by @jbampton in #4864
- chore: remove unneeded duplicate word by @jbampton in #4865
- chore: fix spelling by @jbampton in #4866
- chore: fix spelling by @NKID00 in #4869
- chore: Make compfs able to test by @Xuanwo in #4878
- chore(services/compfs): remove allow(dead_code) by @George-Miao in #4879
- chore: Make rust 1.80 clippy happy by @Xuanwo in #4927
- chore: Bump crates versions by @Xuanwo in #4929
New Contributors
- @meteorgan made their first contribution in #4853
- @LDeakin made their first contribution in #4858
- @Lzzzzzt made their first contribution in #4870
- @Zyyeric made their first contribution in #4875
- @czy-29 made their first contribution in #4912
Full Changelog: v0.47.3...v0.48.0
v0.47.3
Release List
Name | Version | Next |
---|---|---|
core | 0.47.2 | 0.47.3 |
integrations/dav-server | 0.0.4 | 0.0.5 |
integrations/fuse3 | 0.0.1 | 0.0.2 |
integrations/object_store | 0.44.2 | 0.44.3 |
integrations/unftp-sbe | 0.0.1 | 0.0.2 |
bin/oay | 0.41.5 | 0.41.6 |
bin/ofs | 0.0.6 | 0.0.7 |
bin/oli | 0.41.5 | 0.41.6 |
bindings/c | 0.44.7 | 0.44.8 |
bindings/cpp | 0.45.5 | 0.45.6 |
bindings/dotnet | 0.1.3 | 0.1.4 |
bindings/haskell | 0.44.5 | 0.44.6 |
bindings/java | 0.46.2 | 0.46.3 |
bindings/lua | 0.1.3 | 0.1.4 |
bindings/nodejs | 0.47.0 | 0.47.0 |
bindings/php | 0.1.3 | 0.1.4 |
bindings/python | 0.45.5 | 0.45.6 |
bindings/ruby | 0.1.3 | 0.1.4 |
What's Changed
Changed
- refactor: Move ChunkedWrite logic into WriteContext by @Xuanwo in #4826
- refactor(services/aliyun-drive): directly implement
oio::Write
. by @yuchanns in #4821
Fixed
- fix(integration/object_store): Avoid calling API inside debug by @Xuanwo in #4846
- fix(integration/object_store): Fix metakey requested is incomplete by @Xuanwo in #4844
Docs
- docs(integration/unftp-sbe): Polish docs for unftp-sbe by @Xuanwo in #4838
- docs(bin): Polish README for all bin by @Xuanwo in #4839
Chore
- chore(deps): bump crate-ci/typos from 1.22.7 to 1.22.9 by @dependabot in #4836
- chore(deps): bump quick-xml from 0.32.0 to 0.35.0 in /bin/oay by @dependabot in #4835
- chore(deps): bump nix from 0.28.0 to 0.29.0 in /bin/ofs by @dependabot in #4833
- chore(deps): bump metrics from 0.20.1 to 0.23.0 in /core by @TennyZhuang in #4843
- chore: Bump version for 0.47.3 by @Xuanwo in #4852
Full Changelog: v0.47.2...v0.47.3
v0.47.2
Relelase List
Name | Version | Next |
---|---|---|
core | 0.47.1 | 0.47.2 |
integrations/cloudfilter | 0.0.0 | 0.0.0 |
integrations/dav-server | 0.0.3 | 0.0.4 |
integrations/fuse3 | 0.0.0 | 0.0.1 |
integrations/object_store | 0.44.1 | 0.44.2 |
integrations/unftp-sbe | 0.0.0 | 0.0.1 |
integrations/virtiofs | 0.0.0 | 0.0.0 |
bin/oay | 0.41.4 | 0.41.5 |
bin/ofs | 0.0.5 | 0.0.6 |
bin/oli | 0.41.4 | 0.41.5 |
bindings/c | 0.44.6 | 0.44.7 |
bindings/cpp | 0.45.4 | 0.45.5 |
bindings/dotnet | 0.1.2 | 0.1.3 |
bindings/go | 0.0.0 | 0.0.0 |
bindings/haskell | 0.44.4 | 0.44.5 |
bindings/java | 0.46.1 | 0.46.2 |
bindings/lua | 0.1.2 | 0.1.3 |
bindings/nodejs | 0.46.2 | 0.47.0 |
bindings/ocaml | 0.0.0 | 0.0.0 |
bindings/php | 0.1.2 | 0.1.3 |
bindings/python | 0.45.4 | 0.45.5 |
bindings/ruby | 0.1.2 | 0.1.3 |
bindings/swift | 0.0.0 | 0.0.0 |
bindings/zig | 0.0.0 | 0.0.0 |
- bindings/nodejs 0.47.0 release failed, we will get it fixed in next release.
Breaking changes
Binding Node.js Public API
Now, the append
operation has been removed. You can use below code instead.
op.write("path/to/file", Buffer.from("hello world"), { append: true });
What's Changed
Added
- feat(services/compfs): basic
Access
impl by @George-Miao in #4693 - feat(unftp-sbe): impl
OpendalStorage
by @George-Miao in #4765 - feat(services/compfs): implement auxiliary functions by @George-Miao in #4778
- feat: make AwaitTreeLayer covers oio::Read and oio::Write by @PsiACE in #4787
- feat: Nodejs add devbox by @bxb100 in #4791
- feat: make AsyncBacktraceLayer covers oio::Read and oio::Write by @PsiACE in #4789
- feat(nodejs): add
WriteOptions
for write methods by @bxb100 in #4785 - feat: setup cloud filter integration by @ho-229 in #4779
- feat: add position write by @hoslo in #4795
- fix(core): write concurrent doesn't set correctly by @hoslo in #4816
- feat(ovfs): add filesystem to handle message by @zjregee in #4720
- feat(unftp-sbe): add derives for
OpendalMetadata
by @George-Miao in #4819 - feat(core/gcs): Add concurrent write for gcs back by @Xuanwo in #4820
Changed
- refactor(nodejs)!: Remove append api by @bxb100 in #4796
- refactor(core): Remove unused layer
MadsimLayer
by @zzzk1 in #4788
Fixed
- fix(services/aliyun-drive): list dir without trailing slash by @yuchanns in #4766
- fix(unftp-sbe): remove buffer for get by @George-Miao in #4775
- fix(services/aliyun-drive): write op cannot overwrite existing files by @yuchanns in #4781
- fix(core/services/onedrive): remove @odata.count for onedrive list op by @imWildCat in #4803
- fix(core): Gcs's RangeWrite doesn't support concurrent write by @Xuanwo in #4806
- fix(tests/behavior): skip test of write_with_overwrite for ghac by @yuchanns in #4823
- fix(docs): some typos in website and nodejs binding docs by @suyanhanx in #4814
- fix(core/aliyun_drive): Fix write_multi_max_size might overflow by @Xuanwo in #4830
Docs
- doc(unftp-sbe): adds example and readme by @George-Miao in #4777
- doc(nodejs): update upgrade.md by @bxb100 in #4799
- docs: Add README and rustdoc for fuse3_opendal by @Xuanwo in #4813
- docs: use version variable in gradle, same to maven by @shoothzj in #4824
CI
- ci: set behavior test ci for aliyun drive by @suyanhanx in #4657
- ci: Fix lib-darwin-x64 no released by @Xuanwo in #4798
- ci(unftp-sbe): init by @George-Miao in #4809
- ci: Build docs for all integrations by @Xuanwo in #4811
- ci(scripts): Add a script to generate version list by @Xuanwo in #4827
Chore
- chore(ci): disable aliyun_drive for bindings test by @suyanhanx in #4770
- chore(unftp-sbe): remove Cargo.lock by @George-Miao in #4805
- chore: Bump version to 0.47.2 by @Xuanwo in #4829
- chore: Bump to 0.47.2 (Round 2) by @Xuanwo in #4831
New Contributors
Full Changelog: v0.47.1...v0.47.2
v0.47.1
What's Changed
Added
- feat(core): sets default chunk_size and sends buffer > chunk_size directly by @evenyag in #4710
- feat(services): add optional access_token for AliyunDrive by @yuchanns in #4740
- feat(unftp-sbe): Add integration for unftp-sbe by @George-Miao in #4753
Changed
- refactor(ofs): Split fuse3 impl into fuse3_opendal by @Xuanwo in #4721
- refactor(ovfs): Split ovfs impl into virtiofs_opendal by @zjregee in #4723
- refactor(*): tiny refactor to the Error type by @waynexia in #4737
- refactor(aliyun-drive): rewrite writer part by @yuchanns in #4744
- refactor(object_store): Polish implementation details of object_store by @Xuanwo in #4749
- refactor(dav-server): Polish dav-server integration details by @Xuanwo in #4751
- refactor(core): Remove unused
size
forRangeWrite
. by @reswqa in #4755
Fixed
- fix(s3): parse MultipartUploadResponse to check error in body by @waynexia in #4735
- fix(services/aliyun-drive): unable to list
/
by @yuchanns in #4754
Docs
- docs: keep docs updated and tidy by @tisonkun in #4709
- docs: fixup broken links by @tisonkun in #4711
- docs(website): update release/verify docs by @suyanhanx in #4714
- docs: Update release.md link correspondingly by @tisonkun in #4717
- docs: update readme for fuse3_opendal & virtiofs_opendal by @zjregee in #4730
- docs: Polish README and links to docs by @Xuanwo in #4741
- docs: Enhance maintainability of the service section by @Xuanwo in #4742
- docs: Polish opendal rust core README by @Xuanwo in #4745
- docs: Refactor rust core examples by @Xuanwo in #4757
CI
- ci: verify build website on site content changes by @tisonkun in #4712
- ci: Fix cert for redis and add docs for key maintenance by @Xuanwo in #4718
- ci(nodejs): Disable services-all on windows by @Xuanwo in #4762
Chore
- chore: use more portable binutils by @tisonkun in #4713
- chore(deps): bump clap from 4.5.6 to 4.5.7 in /bin/ofs by @dependabot in #4728
- chore(deps): bump url from 2.5.0 to 2.5.1 in /bin/oay by @dependabot in #4729
- chore(binding/python): Upgrade pyo3 to 0.21 by @reswqa in #4734
- chore: Make 1.79 clippy happy by @Xuanwo in #4731
- chore(docs): Add new line in lone services by @Xuanwo in #4743
- chore: Bump versions to prepare v0.47.1 release by @Xuanwo in #4759
- chore: Bump to version 0.47.1 with changelog update by @Xuanwo in #4760
- chore: Bump to 0.47.1-rc.2 by @Xuanwo in #4763
New Contributors
Full Changelog: v0.47.0...v0.47.1