v1.20.0

[romange]

Dragonfly v1.20.0

Some prominent changes include:

• Improvements around client side caching (chore: recommit client tracking #3136 feat: client tracking optout #3158)
  Specifically, rueidis is now supported (Incompatibility between DragonflyDB and redis/rueidis client #2454)
• Improvements around search and vector search APIs, FT.ALTER is now supported (feat(search): Tag field options (separator, case sensitivity) #3144, feat(search): basic FT.ALTER #3148, chore: improve ft.create for vector search #3178, chore(search): Add __vector_score alias #3186)
• JSON.MSET is added (feat(json): MSET #3167)
• Expiry notifications are now supported (feat(server): expiry notifications #3154)

What's Changed

• test(cluster_mgr): Add tests for cluster_mgr.py by @chakaz in test(cluster_mgr): Add tests for cluster_mgr.py #3129
• chore: get rid of kv_args and replace it with slices to full_args by @romange in chore: get rid of kv_args and replace it with slices to full_args #3101
• fix: Fix live-lock in connection test by @chakaz in fix: Fix live-lock in connection test #3135
• chore: call breaker_cb_ on shutdown by @romange in chore: call breaker_cb_ on shutdown #3128
• chore: Add option to disable aws dependency by @dranikpg in chore: Add option to disable aws dependency #3077
• feat(cluster): Add important logs by @chakaz in feat(cluster): Add important logs #3138
• chore: a small cleanup by @romange in chore: a small cleanup #3140
• test: skip test_cluster_migration_cancel, it is broken by @BorysTheDev in test: skip test_cluster_migration_cancel, it is broken #3146
• chore: update helio by @kostasrim in chore: update helio #3150
• fix: fix bug in cluster/slot_set by @BorysTheDev in fix: fix bug in cluster/slot_set #3143
• chore: recommit client tracking by @kostasrim in chore: recommit client tracking #3136
• feat(search): Tag field options (separator, case sensitivity) by @dranikpg in feat(search): Tag field options (separator, case sensitivity) #3144
• feat(search): basic FT.ALTER by @dranikpg in feat(search): basic FT.ALTER #3148
• chore: Introduce pipeline back-pressure by @romange in chore: Introduce pipeline back-pressure #3152
• fix: lua and client tracking by @kostasrim in fix: lua and client tracking #3163
• feat: client tracking optout by @kostasrim in feat: client tracking optout #3158
• feat: add noloop subcommand in client tracking by @kostasrim in feat: add noloop subcommand in client tracking #3164
• fix(ci): docker not using iouring by @kostasrim in fix(ci): docker not using iouring #3169
• fix(ci): add missing docker option on reg tests workflow by @kostasrim in fix(ci): add missing docker option on reg tests workflow #3172
• fix: acl compatibility by @kostasrim in fix: acl compatibility #3147
• chore: Streamer is rewritten with async interface by @romange in chore: Streamer is rewritten with async interface #3108
• feat(json): MSET by @dranikpg in feat(json): MSET #3167
• fix(cluster): Wait for flow creation before cancelling it by @chakaz in fix(cluster): Wait for flow creation before cancelling it #3159
• chore: improve ft.create for vector search by @romange in chore: improve ft.create for vector search #3178
• feat: add incoming migration error processing by @BorysTheDev in feat: add incoming migration error processing #3175
• chore: add parsing support for the rest of VECTOR parameters by @romange in chore: add parsing support for the rest of VECTOR parameters #3179
• fix(cluster): Wait before all access to slot migrations by @chakaz in fix(cluster): Wait before all access to slot migrations #3180
• fix(server): fix bug in replication on cached mode by @adiholden in fix(server): fix bug in replication on cached mode #3156
• chore: small acl compat changes by @kostasrim in chore: small acl compat changes #3177
• chore: allow calling Context::ReportError from I/O dispatch fiber by @romange in chore: allow calling Context::ReportError from I/O dispatch fiber #3182
• chore: add a lexer test covering KNN query by @romange in chore: add a lexer test covering KNN query #3185
• chore(search): Add __vector_score alias by @dranikpg in chore(search): Add __vector_score alias #3186
• chore: Refactor string span management by @dranikpg in chore: Refactor string span management #3165
• chore(ci): run replication tests on arm by @kostasrim in chore(ci): run replication tests on arm #3168
• chore(search): improve parser error reporting by @romange in chore(search): improve parser error reporting #3184
• fix(reply_builder): remove virtual modifier in SendError(ErrorReply) method by @BagritsevichStepan in fix(reply_builder): remove virtual modifier in SendError(ErrorReply) method #3191
• fix(cluster): Support FLUSHALL while slot migration is in progress by @chakaz in fix(cluster): Support FLUSHALL while slot migration is in progress #3173
• fix: fix RegisterOnChange methods for journal and db_slice by @BorysTheDev in fix: fix RegisterOnChange methods for journal and db_slice #3171
• fix(generic_family): fix RenameGeneric command for non-string data types by @BagritsevichStepan in fix(generic_family): fix RenameGeneric command for non-string data types #3181
• fix(server): Rename confusing flag replica_reconnect_on_master_restart by @chakaz in fix(server): Rename confusing flag replica_reconnect_on_master_restart #3193
• fix(unit tests): fix generic family info test by @adiholden in fix(unit tests): fix generic family info test #3187
• test: improve cluster_fuzzy_migration test by @BorysTheDev in test: improve cluster_fuzzy_migration test #3197
• chore(core): Remove DfImpl inside ScoredMap by @dranikpg in chore(core): Remove DfImpl inside ScoredMap #3199
• chore(tiering): Remove IoMgr by @dranikpg in chore(tiering): Remove IoMgr #3198
• test(cluster): Make sure migration maintains TTL by @chakaz in test(cluster): Make sure migration maintains TTL #3188
• feat(cluster): Support STICK bit in slot migration by @chakaz in feat(cluster): Support STICK bit in slot migration #3200
• chore: Re-enable previously flaky test by @chakaz in chore: Re-enable previously flaky test #3196
• feat(acl): add support of multiple passwords by @kostasrim in feat(acl): add support of multiple passwords #3189
• chore(tiering): More advanced tiering tests by @dranikpg in chore(tiering): More advanced tiering tests #3201
• chore: add replica-priority flag by @kostasrim in chore: add replica-priority flag #3204
• chore: fix tiering regtest test by @dranikpg in chore: fix tiering regtest test #3208
• feat(generic_family): Assemble RESTORE and STICK commands into one commmand during replication of the RENAME command by @BagritsevichStepan in feat(generic_family): Assemble RESTORE and STICK commands into one commmand during replication of the RENAME command #3209
• core(search): Add EF_RUNTIME parameter by @dranikpg in core(search): Add EF_RUNTIME parameter #3206
• fix(sanitizers): failing json test by @kostasrim in fix(sanitizers): failing json test #3176
• feat(server): expiry notifications by @dranikpg in feat(server): expiry notifications #3154
• fix: replicaof_reject_on_load flake by @kostasrim in fix: replicaof_reject_on_load flake #3203
• fix(cluster): Don't miss keys when migrating slots by @chakaz in fix(cluster): Don't miss keys when migrating slots #3218
• fix(tiering): Fix pending leak during immediate stash error by @dranikpg in fix(tiering): Fix pending leak during immediate stash error #3219
• chore: provide basic logging to catch possible command errors by @romange in chore: provide basic logging to catch possible command errors #3213
• chore: disable tiering test by @dranikpg in chore: disable tiering test #3236
• fix(transaction): Don't transactionalize empty EVAL inside EXEC by @dranikpg in fix(transaction): Don't transactionalize empty EVAL inside EXEC #3231
• fix: fix deadlock in DFLYCLUSTER CONFIG command and outgoing migration finaliztion by @BorysTheDev in fix: fix deadlock in DFLYCLUSTER CONFIG command and outgoing migration finaliztion #3239
• chore(tiered): minor fixes + expose buffer allocation type stats by @romange in chore(tiered): minor fixes + expose buffer allocation type stats #3234
• fix(pytest): timed ticker for simpler conditions by @dranikpg in fix(pytest): timed ticker for simpler conditions #3242
• fix(server): Fix SCAN deadlock by @dranikpg in fix(server): Fix SCAN deadlock #3235
• chore: introduce back-pressure to tiered storage by @romange in chore: introduce back-pressure to tiered storage #3243
• chore: improve dfly_bench by @romange in chore: improve dfly_bench #3244
• chore(tiering): External alloc free page chaining by @dranikpg in chore(tiering): External alloc free page chaining #3237
• fix: total_stash_overflows statistic by @romange in fix: total_stash_overflows statistic #3248
• chore: update action versions by @romange in chore: update action versions #3250
• chore(lua): Return which undeclared key was accessed by @chakaz in chore(lua): Return which undeclared key was accessed #3245
• chore: replace session wide fixtures with scope by @kostasrim in chore: replace session wide fixtures with scope #3251
• chore: pull helio and adjust mimalloc for 32MiB segments by @kostasrim in chore: pull helio and adjust mimalloc for 32MiB segments #3174
• chore: add more logs around the duplicate value case in small_bins by @romange in chore: add more logs around the duplicate value case in small_bins #3254
• fix: fix move error during migration finalization by @BorysTheDev in fix: fix move error during migration finalization #3253
• chore: upload all the logs from /tmp by @romange in chore: upload all the logs from /tmp #3263
• fix(tiering): Throttle snapshot load by @dranikpg in fix(tiering): Throttle snapshot load #3249
• chore: initiate grow preemptively by @romange in chore: initiate grow preemptively #3267
• chore(monitoring): add more dashboards + memcached by @romange in chore(monitoring): add more dashboards + memcached #3268
• fix(json_family): fix JSON.GET commmand for JSON legacy mode by @BagritsevichStepan in fix(json_family): fix JSON.GET commmand for JSON legacy mode #3261
• chore: dfly_bench can send traffic to memcached by @romange in chore: dfly_bench can send traffic to memcached #3271
• chore: print effective QPS of the server. by @romange in chore: print effective QPS of the server. #3274
• chore: debugging fixes by @romange in chore: debugging fixes #3275
• chore: more debug checks around tiered storage by @romange in chore: more debug checks around tiered storage #3277
• chore(license): Fix typo in LICENSE.md text by @softmoth in chore(license): Fix typo in LICENSE.md text #3283
• fix(test): Verify that save has not finished by @chakaz in fix(test): Verify that save has not finished #3278
• Create scorecard.yml by @romange in Create scorecard.yml #3270
• chore: Disable cluster_mgr_test by @chakaz in chore: Disable cluster_mgr_test #3279
• fix: Increase key count to make test more robust by @chakaz in fix: Increase key count to make test more robust #3286
• fix: properly clean tiered state upon flash by @romange in fix: properly clean tiered state upon flash #3281
• fix(bug): crash on takeover and info replication by @adiholden in fix(bug): crash on takeover and info replication #3282

New Contributors

• @softmoth made their first contribution in chore(license): Fix typo in LICENSE.md text #3283

Huge thanks to all the contributors! ❤️

Full Changelog: v1.19.0...v1.20.0

---

This discussion was created from the release v1.20.0.

[kostasrim]

🚀 🚀 🚀

[ishergin]

Why AWS snapshots were disabled by default? #3077

[romange]

1.20.1 was released and it fixes this issue