Celery Release Notes

What's Changed

• Chore(deps): Bump cryptography from 50.0.1 to 50.0.2 by @dependabot[bot] in #10815
• Chore(deps): Update boto3 requirement from >=1.43.98 to >=1.43.108 by @dependabot[bot] in #10820
• Fix send_task ETA and expiration calculations across DST transitions by @phanky1 in #10813
• Chore(deps): Bump azure-storage-blob from 12.30.3 to 12.31.0 by @dependabot[bot] in #10825
• Chore(deps): Bump tox from 4.64.3 to 4.64.9 by @dependabot[bot] in #10832
• Align pymemcache minimum version with RetryingClient support by @phanky1 in #10831
• docs: fix broker_use_ssl setting target swallowed into previous paragraph by @SatvikMishra08 in #10847
• docs: fix unresolved mailing-list/IRC links in contributing guide and introduction by @SatvikMishra08 in #10848
• Fix: honor regen source replacement during cached iteration by @phanky1 in #10823
• Fix prefork write generators raising StopIteration (PEP 479) by @ayushin in #10842
• fix(canvas): keep eager group apply off the result backend by @jayzhou2309 in #10750
• Fix MongoDB result cleanup across DST transitions by @phanky1 in #10852
• Avoid geometric message growth in standalone chord bodies by @MokiMeow in #10824
• Fix IndexError when a chain is an empty group followed by an empty chain by @MehrazRumman in #10834
• Build chains in a single pass instead of folding with | by @LD-RW in #10840
• fix(redis): add result_chord_expires for chord keys by @ChristianMurphy in #10827
• fix(backends): avoid get_state for plain chain failures by @Namraa310806 in #10836
• Send the worker hostname as the worker_process_init sender by @IslamElsayed in #10849
• Reset autoscale keepalive for immediate tasks by @zhechen-cs in #10839
• Don't call setup_defaults twice when creating a Worker by @Mannava-Daasaradhi in #10828
• fix: redact Azure credentials in diagnostic output by @Namraa310806 in #10822
• Fix duplicate nodes in a chain's as_tuple() after a group by @halilunay in #10829
• feat(redis): add result_failure_expires setting by @ChristianMurphy in #10826
• Fix errback arity classification with stored signature arguments by @sergioperezcheco in #10838
• docs: fix stray RST markup in changelog entries by @SatvikMishra08 in #10851
• Chore(deps): Bump github/codeql-action from 4.38.2 to 4.38.3 by @dependabot[bot] in #10860
• Chore(deps): Update pymemcache requirement from >=3.5.0 to >=4.0.0 by @dependabot[bot] in #10859
• feat(worker): add task_retry_on_worker_lost to limit requeues after worker loss by @abdullahmujahidali in #10843
• Fix Celery Beat relative schedule rounding across DST transitions by @HassanRady in #10818
• fix(cache): keep chords alive past result_expires by @ChristianMurphy in #10830
• Fix chain/group repr mangling task names and arguments by @LemonCondor in #10855
• Keep a nested group from taking its parent group's id by @halilunay in #10857
• Chore(deps): Bump azure-identity from 1.25.3 to 1.26.0 by @dependabot[bot] in #10863
• Accept Pydantic models when calling a pydantic=True task by @Om-singhaI in #10844
• Skip exited children in AsynPool._help_stuff_finish by @esauser in #10861
• Fix/database backend cleanup timezone by @Namraa310806 in #10866
• Only copy declared stamps into task execution options by @phanky1 in #10853
• Fire chain link once on the last task in eager chains by @superh123 in #10864
• Fix worker expiration checks during DST fall back by @phanky1 in #10868
• Pass preload options to commands that do not accept them by @Cherith1222 in #10837
• Fix exponential message growth in chains of groups by @Grivn in #10873
• Remove unused AQLQueryError import from arangodb backend by @TheNetherWatcher in #10878
• Fix task execution after ETA conversion failure by @Namraa310806 in #10876
• Chore(deps): Update boto3 requirement from >=1.43.108 to >=1.43.113 by @dependabot[bot] in #10869
• Fix invalid Bandit baseline JSON and validate it before commit by @maple-pwn in #10766
• Update kombu version to 5.7.0rc1 by @auvipy in #10882
• Release Preparation for v5.7.0rc1 Release Candidate by @auvipy in #10887

New Contributors

• @SatvikMishra08 made their first contribution in #10847
• @ayushin made their first contribution in #10842
• @jayzhou2309 made their first contribution in #10750
• @MokiMeow made their first contribution in #10824
• @LD-RW made their first contribution in #10840
• @ChristianMurphy made their first contribution in #10827
• @IslamElsayed made their first contribution in #10849
• @zhechen-cs made their first contribution in #10839
• @Mannava-Daasaradhi made their first contribution in #10828
• @halilunay made their first contribution in #10829
• @sergioperezcheco made their first contribution in #10838
• @LemonCondor made their first contribution in #10855
• @Om-singhaI made their first contribution in #10844
• @esauser made their first contribution in #10861
• @Cherith1222 made their first contribution in #10837
• @Grivn made their first contribution in #10873
• @TheNetherWatcher made their first contribution in #10878
• @maple-pwn made their first contribution in #10766

Full Changelog: v5.7.0b1...v5.7.0rc1

What's Changed

• Add a smoke test workflow that runs against py-amqp, Kombu and Billiard main by @GangEunzzang in #10676
• fix(backends/couchbase): missing document raises instead of returning None by @simpleqt in #10680
• Preserve propagate in nested native result joins by @GangEunzzang in #10689
• Chore(deps): Update boto3 requirement from >=1.43.93 to >=1.43.98 by @dependabot[bot] in #10695
• Fix cache directory ownership in Docker builds by @phanky1 in #10707
• Modify apt-get install to add libmemcached-dev and libev-dev by @auvipy in #10709
• Chore(deps): Update click requirement from <9.0,>=8.1.2 to >=8.5.0,<9.0 by @dependabot[bot] in #10696
• Chore(deps): Update tox requirement from >=4.61.4 to ==4.64.3 by @dependabot[bot] in #10684
• fix: add missing spaces in three backend exception messages by @simpleqt in #10650
• docs: fix the malformed celery[tblib] bundle term in README by @simpleqt in #10651
• Fix escaped percent signs in node formatting by @jakezwang in #10663
• fix(backends): keep forget() idempotent on elasticsearch and couchdb by @simpleqt in #10697
• Docs: broker_heartbeat_checkrate default is 3.0, not 2.0 by @ZainnQureshii in #10710
• Use the merged retry policy for before_task_publish and task-sent events by @phanky1 in #10708
• Replace deprecated codecs.open in celery upgrade settings by @Barry-Lenhart in #10706
• Apply index lists like -c:1,2 to named nodes in celery multi by @Dev-next-gen in #10661
• fix(backends): keep forget() idempotent on azureblockblob and cosmosdb by @inchang-ing in #10714
• Redis result backend: don't hold the pubsub lock while waiting for messages by @GangEunzzang in #10715
• fix(backend): handle missing ArangoDB documents on delete by @Namraa310806 in #10701
• fix(redis): defer re-entrant cancel_for to avoid GC-driven pub/sub deadlock by @MehrazRumman in #10716
• ci: stop installing sphinx-autobuild in test envs and harden pip against index timeouts by @MehrazRumman in #10721
• fix(utils): BufferMap ignores bufmaxsize and miscounts total by @simpleqt in #10705
• Pin cassandra-driver version specification by @auvipy in #10732
• Chore(deps): Bump ephem from 4.2 to 4.2.1 by @dependabot[bot] in #10729
• Chore(deps): Bump github/codeql-action from 4.38.1 to 4.38.2 by @dependabot[bot] in #10730
• Chore(deps): Update python-dateutil requirement from >=2.8.2 to >=2.9.0.post0 by @dependabot[bot] in #10727
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10723
• Chore(deps): Bump pytest-rerunfailures from 16.6.1 to 16.7 by @dependabot[bot] in #10740
• Chore(deps): Bump azure-storage-blob from 12.30.1 to 12.30.3 by @dependabot[bot] in #10741
• Add opt-in remote control (inspect ping) support to celery beat by @Ozone317 in #10422
• fix(worker): flush buffered events with hub.call_soon() by @oliverhaas in #10736
• Publish the Cassandra session only once the connection is ready by @Dev-next-gen in #10657
• docs: update default value of interval_max in retry_policy by @Aswin1105 in #10717
• Avoid calling isoformat() on protocol v1 ETA and expiration strings by @phanky1 in #10720
• Refactor owned_by to use dictionary comprehension by @auvipy in #10742
• Make worker_concurrency cgroup-aware via --concurrency=auto by @sashu2310 in #10328
• fix(canvas): apply countdown and eta to the chord header by @00200200 in #10735
• fix(consumer): preserve pending operation order by @HassanRady in #10734
• multi: expand ~ in --workdir for spawned workers by @Ryanakml in #10739
• Chore(deps): Bump flake8 from 7.3.0 to 7.4.1 by @dependabot[bot] in #10747
• Chore(deps): Bump google-cloud-firestore from 2.30.0 to 2.32.0 by @dependabot[bot] in #10748
• Chore(deps): Update google-cloud-storage requirement from >=2.10.0 to >=3.15.0 by @dependabot[bot] in #10753
• Fix(utils): don't cut regen iteration short when consumed elsewhere mid-loop by @MehrazRumman in #10756
• fix: handle AttributeError in iterate_file_descriptors_safely after connection loss by @rmotgi1227 in #10318
• docs: remote control commands get a state object, not ControlDispatch by @Zir0-93 in #10770
• Fail the chords after a chord whose header failed by @Borzik in #10767
• Stop firstmethod() from swallowing AttributeError by @phanky1 in #10774
• Fix geometric message bloat in a chain of implicit chords by @Borzik in #10743
• fix(events): synchronize EventDispatcher shutdown with publishing by @HassanRady in #10745
• fix(backends): upsert CosmosDB results so later states are stored by @devjoinedthechat in #10746
• docs: document PGMQ broker with SQLAlchemy results in PostgreSQL by @tavallaie in #10777
• fix(canvas): resolve the app of a chain or chord through its tasks by @Mohamed-Elshesheny in #10749
• Docs: correct the default value of worker_task_log_format by @hossam1244 in #10786
• Tell apart signal receivers bound to different instances by @wfatih in #10699
• fix(result): keep EagerResult.name when copied or pickled by @MehrazRumman in #10773
• fix(canvas): don't raise in chain.app when the first task's canvas holds a dict by @MehrazRumman in #10792
• Modify Codecov action configuration by @auvipy in #10799
• Simplify Codecov upload conditions in workflow by @auvipy in #10800
• Update click versions in default.txt by @auvipy in #10801
• Update billiard version to 4.3.1 or higher by @auvipy in #10802
• Fix Beat scheduler connection cleanup on shutdown by @HassanRady in #10776
• Add pymemcache support by @TheoCouss in #9977
• Finish a half-read child result on prefork shutdown and ack during the join by @tuliodesouza in #10768
• Chore(deps-dev): Bump isort from 9.0.1 to 9.0.2 by @dependabot[bot] in #10754
• Chore(deps): Bump gevent from 26.8.0 to 26.9.0 by @dependabot[bot] in #10807
• Chore(deps): Update elastic-transport requirement from <=9.2.1 to <=9.4.2 by @dependabot[bot] in #10806
• Update kombu version to 5.7.0b1 by @auvipy in #10809
• Fix countdown, expiration, and Beat intervals across DST transitions by @phanky1 in #10769
• Remove version constraints for redis in requirements by @auvipy in #10810
• test(consumer): pin reconnect prefetch reduction to green-pool capacity (regression test for #10803) by @ShahafChen in #10804
• fix(result): raise TaskRevokedError from EagerResult.get() after revoke() by @MehrazRumman in #10772
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10805
• Fix leaf-value collection in the AsyncResult.collect example by @mottopanikeiku in #10811
• Limit the Django fixup's signal handlers to its own app by @MehrazRumman in #10731
• Release v5.7.0b1 beta 1 by @auvipy in #10812

New Contributors

• @jakezwang made their first contribution in #10663
• @ZainnQureshii made their first contribution in #10710
• @Barry-Lenhart made their first contribution in #10706
• @inchang-ing made their first contribution in #10714
• @Aswin1105 made their first contribution in #10717
• @00200200 made their first contribution in #10735
• @HassanRady made their first contribution in #10734
• @Ryanakml made their first contribution in #10739
• @rmotgi1227 made their first contribution in #10318
• @Zir0-93 made their first contribution in #10770
• @devjoinedthechat made their first contribution in #10746
• @tavallaie made their first contribution in #10777
• @Mohamed-Elshesheny made their first contribution in #10749
• @hossam1244 made their first contribution in #10786
• @wfatih made their first contribution in #10699
• @TheoCouss made their first contribution in #9977
• @tuliodesouza made their first contribution in #10768
• @ShahafChen made their first contribution in #10804
• @mottopanikeiku made their first contribution in #10811

Full Changelog: v5.7.0a1...v5.7.0b1

What's Changed
Fix Django worker recursion bug + defensive checks for pool_cls.module by @maycuatroi1 in #10048
Update elasticsearch requirement from <=9.1.2 to <=9.2.1 by @dependabot[bot] in #10053
Revert "Update elasticsearch requirement from <=9.1.2 to <=9.2.1" by @auvipy in #10054
Docs: Update user_preload_options example to use click. by @jorsyk in #10056
Fix invalid configuration key "bootstrap_servers" in Kafka demo by @jorsyk in #10060
Fix broken images on PyPI page by @Timour-Ilyas in #10066
Remove broken reference. in #10071
Removed --dist=loadscope from smoke tests by @Nusnus in #10073
Docs: Clarify task_retry signal args may be None by @GangEunzzang in #10076
Update example for Django by @sbc-khacnha in #10081
Update CI matrix to exclude Python 3.9 by @auvipy in #9980
Update default Python versions in Integration test by @auvipy in #10088
Update default Python versions in smoke-tests.yml by @auvipy in #10089
Remove Python 3.9 from tox configuration by @auvipy in #10087
Update Python and OS versions in Read the Docs config by @auvipy in #10090
Make tests compatible with pymongo >= 4.16 by @cjwatson in #10074
Remove Python 3.9 from Dockerfile by @auvipy in #10092
Revise Python compatibility for Celery versions by @auvipy in #10093
Update Python version requirement to 3.10 by @auvipy in #10091
fix: source install of cassandra-driver by @Izzette in #10105
fix: register task cross-reference role in Sphinx extension by @veeceey in #10100
fix: avoid cycle detection in native delayed delivery by @Izzette in #10095
fix(asynpool): avoid AttributeError when proc lacks _sentinel_poll by @mriddle in #10086
Update elastic-transport requirement from <=9.1.0 to <=9.2.1 by @dependabot[bot] in #10052
fix dusk_astronomical horizon sign (+18 -> -18) by @Mr-Neutr0n in #10121
Bump pytest from 8.4.2 to 9.0.2 by @dependabot[bot] in #10055
Fix#10106 onupdate col use lambda func by @ChickenBenny in #10108
Fix warm shutdown RuntimeError with eventlet>=0.37.0 (#10083) by @ChickenBenny in #10123
Fix 10109 db backend connection health by @ChickenBenny in #10124
Bump grpcio from 1.75.1 to 1.76.0 by @dependabot[bot] in #9962
Bump cryptography from 46.0.3 to 46.0.5 by @dependabot[bot] in #10132
Database Backend filter unsupport sql engine arguments with nullpool #7355 by @ChickenBenny in #10134
fix(beat): correct argument order in Service.reduce by @bysiber in #10137
ci: declare explicit read-only token permissions in workflow jobs by @Rohan5commit in #10139
chore: 'boto3to' to 'boto3 to' by @cuiweixie in #10133
Database Backend: Add missing index on date_done (Fixes #10097) by @ChickenBenny in #10098
docs: fix typo in CONTRIBUTING.rst by @Rohan5commit in #10141
Refer to Flower / Prometheus for monitoring by @WilliamDEdwards in #10140
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10143
docs: remove duplicated words in broker and routing docs by @Rohan5commit in #10146
docs: fix stale version reference and grammar in README by @kelsonbrito50 in #10145
docs: fix wording in Celery 5.3 worker pool notes by @Rohan5commit in #10149
docs: fix duplicated wording in 3.1 changelog entry by @Rohan5commit in #10152
feat(task): decouple acks_on_failure and acks_on_timeout by @abdullahmujahidali in #10150
docs: fix changelog typo in context manager wording by @Rohan5commit in #10144
Fix/10096 worker fails to reconnect after redis failover by @ChickenBenny in #10151
Add class_getitem to generic classes by @brianhelba in #10038
Improve on_after_finalize signal documentation by @Br1an67 in #10155
Database Backend Should Support the retry config parameters #6540 by @ChickenBenny in #10130
Add non-commutative example to clarify partial arg ordering in canvas docs by @Br1an67 in #10157
Bump google-cloud-firestore from 2.22.0 to 2.23.0 by @dependabot[bot] in #10126
Remove redundant test_isa_mapping test (fixes #10077) by @daniel7an in #10103
Upgrade pytest-celery to >=1.3.0 and adopt PYTEST_CELERY_PKG build arg by @Nusnus in #10162
Chore(deps): Update elasticsearch requirement from <=9.1.2 to <=9.3.0 by @dependabot[bot] in #10164
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10161
Bump isort from 6.1.0 to 7.0.0 by @dependabot[bot] in #10051
Bump sphinx-click from 6.0.0 to 6.1.0 by @dependabot[bot] in #10050
Add redis-py DriverInfo support to Redis backend by @vchomakov in #10040
Remove deprecated args from redis get_connection call by @JaeHyuckSa in #10036
Fix #6912 rpc backend reconnection error by @ChickenBenny in #10179
Fix NameError with TYPE_CHECKING annotations on Python 3.14+ (PEP 649) by @drichardson in #10165
docs: Add elaboration on prefetch multiplier settings (worker_prefetch_multiplier) and worker_eta_task_limit by @tsangwailam in #10181
Fix O(K²) message bloat in a chain of chords by @Borzik in #10171
Fix mock connection interfaces to prevent TypeError during exception handling by @ChickenBenny in #10178
fix(trace): dispatch chain/callbacks on dedup fast-path for redelivered tasks by @aurangzaib048 in #10159
Extract reconnect_on_error to BaseResultConsumer by @ChickenBenny in #10189
pep 649 by @ericbuehl in #10187
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10186
Fix#9722 friendly status errors for CLI by @ChickenBenny in #10190
docs: clarify after_return behavior for retried tasks by @KianAnbarestani in #10192
Add exists() method to AsyncResult by @veeceey in #10142
Add compression header to message protocol docs by @Br1an67 in #10156
docs: fix duplicated word in bootsteps comment by @Rohan5commit in #10153
Remove outdated autoreloader section from extending docs by @Br1an67 in #10154
Fix: prioritize request ignore_result over task definition by @patri27826 in #10184
Add Google Cloud PubSub dependency group by @dpgraham4401 in #10216
Chore(deps): Bump nick-fields/retry from 3 to 4 by @dependabot[bot] in #10213
fix: clear the timer while catch the exception by @ChickenBenny in #10218
fix(worker): add hub.reset() to synloop on connection error by @antonio-mello-ai in #10204
Replace remaining deprecated datetime.utcnow() calls by @as567-code in #10224
Fix#10022 request time limits by @ChickenBenny in #10206
fix: send the task failure in hard timeout by @ChickenBenny in #10226
Add engine_callback to database backend SessionManager by @avolant in #10135
feat(redis): support configuring additional connection errors by @abdullahmujahidali in #10158
fix: move dedup integration tests to smoke tests by @aurangzaib048 in #10232
fix: move prefork shutdown test to smoke tests by @aurangzaib048 in #10236
fix: move remaining start_worker() integration tests to smoke tests by @aurangzaib048 in #10239
fix: prevent graceful shutdown regression in connection recovery (GH-9705) by @aurangzaib048 in #10242
perf(examples): set a timeout on tasks HTTP calls by @EhteshamSid in #10244
docs: document return value of AsyncResult.get() and ResultSet.join() by @antonio-mello-ai in #10240
docs: clarify broker-specific semantics of task priority by @antonio-mello-ai in #10238
fix(base): add timeout to broker pool acquisition to prevent indefinite blocking by @aurangzaib048 in #10174
fix#4834 (canvas): fix chord error handling when body is a chain by @aurangzaib048 in #10247
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10249
Fix warm shutdown not cancelling prefetched tasks in thread pool by @Aamirofficiall in #10183
chore: add Python 3.14 trove classifier by @sk- in #10176
Replace archived blacksmith python action with upstream python action by @c32-4e3-844-41ed9dc5d in #10265
Update apt-get install command in integration tests by @auvipy in #10267
Adjust retry settings in integration-tests.yml by @auvipy in #10268
Update apt-get install command in workflow by @auvipy in #10266
Bump codecov actions 5 -> 6 by @c32-4e3-844-41ed9dc5d in #10264
docs: clarify .delay() usage with signatures in the user guide section by @kittywaresz in #10258
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10261
Add all integration tests to the CI matrix by @Izzette in #10259
Add libev-dev to Dockerfile dependencies by @auvipy in #10270
Using patching.modules after module test fixture leaks across test cases by @treszkai in #10256
docs: clarify Django settings with the CELERY namespace by @angelojbgama in #10272
fix(consumer): skip prefetch reduction when per-consumer QoS is in effect by @aurangzaib048 in #10253
fix(events): skip publish when producer is None to stop memory leak after broker reconnect by @Song-Junho97 in #10277
Bump grpcio from 1.76.0 to 1.78.0 by @dependabot[bot] in #10136
chore(deps): update sphinx-autobuild requirement from !=2024.9.3,>=2021.3.14 to !=2024.9.3,>=2024.10.3 by @dependabot[bot] in #10279
fix#8542: honour per-task serializer and execution options (send_task). by @Krishnachaitanyakc in #10217
fix(events): stop leaking exceptions and cancel stale Heart timers by @Song-Junho97 in #10280
Deferred ack synloop bug by @jberclaz in #10263
Fix head_from_fun following wrapped on Python 3.14+ by @dannon in #10281
Add missing stacklevel=2 to 12 warnings.warn() calls by @stef41 in #10260
Chore(deps): Bump pytest-github-actions-annotate-failures from 0.3.0 to 0.4.0 by @dependabot[bot] in #10168
fix(defaults): default to exclusive queues for RabbitMQ 4.3.0 compatibility by @Nusnus in #10287
Revert "fix(defaults): default to exclusive queues for RabbitMQ 4.3.0 compatibility" by @Nusnus in #10289
fix(defaults,rpc): RabbitMQ 4.3.0 compatibility by @Nusnus in #10290
Removed socket.timeout from reconnection conditions by @constantinblanariu in #10285
fix(worker): skip Broadcast queues in native delayed delivery binding by @mina58 in #10293
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10292
fix(worker): guard heartbeat control command against None event_dispatcher by @SAY-5 in #10295
Chore(deps): Update python-memcached requirement from >=1.61 to >=1.62 by @dependabot[bot] in #10282
Chore(deps): Bump pytest from 9.0.2 to 9.0.3 by @dependabot[bot] in #10297
Chore(deps): Update gevent requirement from >=1.5.0 to >=26.4.0 by @dependabot[bot] in #10301
docs: clarify chord errback signatures by @paulkagiri in #10300
Chore(deps): Bump pytest-order from 1.3.0 to 1.4.0 by @dependabot[bot] in #10305
fix(redis): keep _reconnect_pubsub compatible with redis-py < 5.3.0 by @SAY-5 in #10298
Update boto3 requirement from >=1.26.143 to >=1.43.6 and moto 5.2 by @dependabot[bot] in #10306
docs: fix duplicated word in changelog by @lphuc2250gma in #10309
Allow Redis backend SSL config with redis URLs by @cyphercodes in #10313
Skip empty groups in chains by @puneetdixit200 in #10321
Add documentation to workers guide around signal exception bytecode stuff by @sastraxi in #10276
Fix worker consuming unexpected queues after connection loss by @phanky1 in #10335
Apply backend retry policy to all DatabaseBackend DB operations by @arkadiuszbach in #10334
Explain prefetching with late acknowledgments by @wayyoungboy in #10343
Handle DST gaps in make_aware by @puneetdixit200 in #10324
Fix Consumer.on_close() wiping in-flight reservations and breaking worker_disable_prefetch by @arkadiuszbach in #10345
chore(deps): bump cryptography from 46.0.5 to 46.0.7 in /requirements/extras by @dependabot[bot] in #10350
Fix: wrap new-style errback calls in try/except to prevent silent chain halt by @r266-tech in #10214
Fix Queues.deselect leaking routing-only queues into consumers by @phanky1 in #10348
fix(redis): prevent _pending_messages memory leak in ResultConsumer by @goingforstudying-ctrl in #10342
Fix free worker stalling after broker reconnect (AsynPool.flush clearing _busy_workers) by @arkadiuszbach in #10346
Revert "fix(redis): prevent _pending_messages memory leak in ResultConsumer" by @Nusnus in #10354
Fix add_consumer not restoring consume_from for known queues by @phanky1 in #10352
chore(deps): bump codecov/codecov-action from 6 to 7 by @dependabot[bot] in #10349
docs(tasks): warn that rate-limited tasks block the worker's prefetch by @DHUKK in #10291
Redis ResultConsumer: clean up leaked _pending_messages after on_wait_for_pending by @goingforstudying-ctrl in #10366
chore(deps): bump cryptography from 46.0.7 to 48.0.1 in /requirements/extras by @dependabot[bot] in #10368
Mark rejected tasks as failed when not requeued by @hmnfalahi in #10369
Tolerate task cancellation errors after connection loss by @phanky1 in #10382
chore(deps): bump actions/checkout from 6 to 7 by @dependabot[bot] in #10362
Fix queue selection by alias to store the real queue name by @phanky1 in #10358
Raise a clear error instead of a bare ValueError when fast_trace_task's worker registry is empty by @harshitayadavv in #10397
Update reserved requests to use new event dispatcher on reconnect by @phanky1 in #10383
Preserve group errback mutability by @lxingy3 in #10385
Fix pidbox consumer cleanup during reset cycles by @zainnadeem786 in #10363
Defer default queue lookup for explicitly routed tasks by @phanky1 in #10357
Preserve re-buffered events during dispatcher flush by @phanky1 in #10401
Docs: clarify which tasks the celery_worker pytest fixture can run by @sahilkanger in #10378
Preserve exception cause when re-raising in a few spots by @tejas-ae in #10257
fix(canvas): propagate chained task failures to the chord body by @eyupcanakman in #10323
Move custom-worker integration tests to the smoke suite by @Nusnus in #10410
Guard integration tests by @Nusnus in #10411
Finalize ResultSet barrier when iter_native begins by @phanky1 in #10407
Fix preload options for control command by @theShmoo in #10403
fix(canvas): restore GroupResult fan-out in chain as_tuple() (#8903 regression) by @jberclaz in #10408
Handle UUID task ids in key-value store backend key generation by @MahinAnowar in #10406
Stop eager chain execution on Ignore and Reject by @phanky1 in #10404
docs: fix incorrect parameter names in docstrings by @eeshsaxena in #10392
Handle EPERM from os.kill in multi stopwait node liveness check by @Ozone317 in #10414
Preserve group-buffered events when flush republish fails by @chuenchen309 in #10417
chore(deps): bump actions/setup-python from 6 to 7 by @dependabot[bot] in #10423
fix: upgrade http:// to https:// in README.rst by @hanu-14 in #10419
chore(deps): bump useblacksmith/setup-docker-builder from 1 to 2 by @dependabot[bot] in #10430
Fix inconsistencies in systemd service examples by @phanky1 in #10425
fix: don't drop buffered events appended during publish by @oliverhaas in #10435
Preserve absolute event timestamps in Gossip by @phanky1 in #10418
Respect result_extended in the RPC result backend by @phanky1 in #10431
Warn when routing options are set as task attributes by @phanky1 in #10453
chore(deps): bump github/codeql-action from 4 to 4.37.4 by @dependabot[bot] in #10454
RPC result backend recirculates final results on every state poll by @goingforstudying-ctrl in #10459
chore(deps): bump github/codeql-action from 4.37.4 to 4.37.6 by @dependabot[bot] in #10469
Raise ImproperlyConfigured with install hint when ephem is missing for solar schedules by @locker95 in #10470
Normalize aware datetimes into the schedule timezone in crontab.remaining_delta by @MahinAnowar in #10420
Reheap beat entries that request to retry later by @phanky1 in #10468
Move task_sent and Result deprecations to the 6.0 timeline by @phanky1 in #10455
Fix shared retry_kwargs mutation in autoretry by @Namraa310806 in #10461
fix(worker): mask credentials in alternates returned by inspect stats by @AleksaMCode in #10485
chore(deps): bump useblacksmith/setup-docker-builder from 2 to 2.0.1 by @dependabot[bot] in #10450
chore(deps): bump cryptography from 48.0.1 to 50.0.0 in /requirements/extras by @dependabot[bot] in #10483
Add MemoryError regression for request callbacks by @sahilmathur254 in #10482
chore(deps): bump useblacksmith/setup-docker-builder from 2.0.1 to 2.1.0 by @dependabot[bot] in #10496
Fix ineffective traceback clearing in timeout handling by @Namraa310806 in #10493
Fix Redis result consumer redundant unsubscribe by @Namraa310806 in #10497
Pin socket_timeout in integration test Redis client by @bchrobot in #10498
Add datefmt support to ColorFormatter and TaskFormatter by @rahul2002m in #10488
Fix autoscale and disable-prefetch for green worker pools by @arkadiuszbach in #10361
feature: add celery_beat_task header in task options by @alirafiei75 in #9702
Enable heartbeat on the event dispatcher connection by @phanky1 in #10500
Fix TypeError when slicing a regen built from a generator by @MahinAnowar in #10501
Make result_compression actually compress stored results by @dylanpulver in #10504
fix: preserve negative UTC offsets in LocalTimezone.fromutc by @waterWang in #10519
fix: handle invalid worker environment values by @Namraa310806 in #10513
Fix certificate expiration during verification by @Namraa310806 in #10510
chore(deps): bump github/codeql-action from 4.37.6 to 4.37.8 by @dependabot[bot] in #10515
Fix KeyError in MongoDB backend for results stored without a request by @dylanpulver in #10503
Fix pre-commit formatting error in test_time by @Namraa310806 in #10520
fix: crontab.remaining_delta skips later minute slots on an earlier day by @phanky1 in #10494
Honor a timeout of 0 in wait_for and ResultSet.join instead of waiting forever by @ckarnell in #10487
Mask broker_read_url and broker_write_url in filter_hidden_settings by @phanky1 in #10398
Add task_repr_maxlevels setting to control argsrepr/kwargsrepr depth by @phanky1 in #10371
docs(whatsnew): clarify gevent/eventlet pool requirement in Celery 5 migration guide by @zainnadeem786 in #10360
handle beat_cron_starting_deadline correctly for non-uniform crontabs by @phanky1 in #10315
tests: Add explicit tests for worker broker retry behavior by @LOGESHWAR123 in #10356
chore(deps): update mock requirement from >=1.3 to >=5.2.0 by @dependabot[bot] in #10308
Document EventReceiver's first argument under the name it actually has by @darkdi in #10460
chore(deps): bump pytest from 9.0.3 to 9.1.1 by @dependabot[bot] in #10522
Update README.rst by @auvipy in #10521
docs(gevent): document monkey-patching entrypoint requirement (#10067) by @harmehak0173 in #10481
docs: describe canvas calling behavior accurately by @Whning0513 in #10447
docs: clarify acks late versus retry behavior by @Whning0513 in #10448
docs: link worker settings to CLI options by @Whning0513 in #10445
docs: Fix grammar errors in extending user guide by @LaRoyBot in #10429
docs: show SQS FIFO message properties directly by @Whning0513 in #10446
docs: document scheduling groups and workflows periodically by @sahilkanger in #10428
docs: document purpose of bulk_task_producer.py example by @Mahir-Panchal in #10399
Replace static analysis hack in init.py with TYPE_CHECKING guard by @tobyh-canva in #10409
Fix typo by @leetrout in #10365
docs: document single-argument link_error errback used by send_task by @sahilkanger in #10427
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10296
chore(deps): update pytest-subtests requirement from >=0.14.1 to >=0.15.0 by @dependabot[bot] in #10523
Chore(deps-dev): Bump isort from 7.0.0 to 8.0.1 by @dependabot[bot] in #10170
Chore(deps): Bump sphinx-click from 6.1.0 to 6.2.0 by @dependabot[bot] in #10169
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in #10537
Remove redundant maybe_signature call in unlock_chord by @phanky1 in #10395
Cache extension entry-point discovery to fix apply_async CPU overhead by @ghirailghiro in #10516
Bound State._tasks_to_resolve to fix unbounded memory growth by @ghirailghiro in #10534
Fix DjangoTask selection for Celery subclasses without a custom task class by @phanky1 in #10529
Honor a timeout of 0 in get_many instead of polling forever by @dylanpulver in #10524
Chore(deps): Bump pytest-cov from 7.0.0 to 7.1.0 by @dependabot[bot] in #10540
Chore(deps): Bump github/codeql-action from 4.37.8 to 4.37.9 by @dependabot[bot] in #10542
Fix the delay beat returns when the heap top changes by @phanky1 in #10531
Chore(deps): Update elasticsearch requirement from <=9.3.0 to <=9.5.0 by @dependabot[bot] in #10541
Fix: DatabaseBackend now honors result_serializer (#3025) by @ghirailghiro in #10536
Honour config_from_object(silent=True) on the lazy config load by @ArockiaRajamanickam in #10532
Chore(deps): Update pyarango requirement from >=2.0.2 to >=2.1.1 by @dependabot[bot] in #10544
Chore(deps): Bump cryptography from 50.0.0 to 50.0.1 by @dependabot[bot] in #10543
Change kombu dependency to pypi release by @auvipy in #10549
Update kombu dependency to use pypi release only by @auvipy in #10552
Modify default Python versions in workflow by @auvipy in #10551
Update CI matrix to exclude Python 3.10 and 3.14t by @auvipy in #10550
Parameterize integration test Dockerfile by Python version by @auvipy in #7610
Fix connection leak in the celery_worker pytest fixture by @phanky1 in #10512
Update default Python versions in smoke tests by @auvipy in #10556
Apply ChainMap._key consistently across its methods by @phanky1 in #10545
[Bug] chord hangs when a member is revoked through app.control.revoke by @goingforstudying-ctrl in #10527
Chore(deps): Update pytest-rerunfailures requirement from >=15.0 to >=16.6 by @dependabot[bot] in #10547
Show original and prefixed keys in configuration KeyError by @phanky1 in #10559
Forward chord body routing options to chord_unlock by @phanky1 in #10442
Fix beat sleeping too long when is_due changes the heap by @phanky1 in #10558
Chore(deps): Update wheel requirement from >=0.33.1 to >=0.48.0 by @dependabot[bot] in #10557
Chore(deps): Bump grpcio from 1.78.0 to 1.83.1 by @dependabot[bot] in #10539
Fix celery worker shutdown timeout example by @mgaitan in #10416
Fix --detach stalling in Docker containers with high fdmax (#9886) by @GangEunzzang in #10080
Fix crontab state restoration across persistence cycles by @MarthalaJagruthiReddy in #10563
Document how the Redis broker stores messages by @GebleaAlex in #10566
Return Option objects consistently from find() by @phanky1 in #10565
Propagate setup logging signal errors by @GruffElixir in #10568
Honour broker connection retry settings when purging at startup by @MahinAnowar in #10567
Fix Signature.clone() sharing kwargs with the original signature by @tritsystem in #10571
fix(worker): bound already-open broker sockets before connection teardown (GH-9705) by @aurangzaib048 in #10570
Chore(deps): Update click-repl requirement from >=0.2.0 to >=0.3.0 by @dependabot[bot] in #10572
Chore(deps): Bump pytest-order from 1.4.0 to 1.5.0 by @dependabot[bot] in #10573
Chore(deps): Bump useblacksmith/setup-docker-builder from 2.1.0 to 2.2.0 by @dependabot[bot] in #10574
Revert "[Bug] chord hangs when a member is revoked through app.control.revoke" by @phanky1 in #10564
Chore(deps): Update pytest-rerunfailures requirement from >=16.6 to >=16.6.1 by @dependabot[bot] in #10580
Chore(deps): Update cassandra-driver requirement from <4,>=3.25.0 to >=3.30.1,<4 by @dependabot[bot] in #10581
docs: repoint dead :ref: targets to the getting-help/bug-tracker labels by @simpleqt in #10578
prefork is not safe anymore by @superboum in #10339
docs(result): drop doubled 'in in' in the ResultSet class comment by @simpleqt in #10577
Chore(deps): Update sphinx requirement from >=7.0.0 to >=8.1.3 by @dependabot[bot] in #10548
Detect spawned pool children in process_initializer by @GangEunzzang in #10583
Allow worker_pool_start_method='spawn' with the asynchronous prefork pool by @GangEunzzang in #10584
Keep preconfigured values out of configuration defaults by @phanky1 in #10575
Document interaction between rate_limit and countdown/eta by @istoolsfox in #10595
Chore(deps): Bump pytest-github-actions-annotate-failures from 0.4.0 to 0.4.2 by @dependabot[bot] in #10591
Chore(deps): Bump google-cloud-firestore from 2.23.0 to 2.30.0 by @dependabot[bot] in #10590
Chore(deps): Update tox requirement from >=3.8.4 to >=4.61.2 by @dependabot[bot] in #10589
Clean up Docker examples in the contributing guide by @phanky1 in #10587
Chore(deps): Update azure-storage-blob requirement from >=12.15.0 to >=12.30.1 by @dependabot[bot] in #10601
Honor zero timeouts in the result drainer by @phanky1 in #10603
Keep the execv flag from leaking between tests by @GangEunzzang in #10596
Make ConfigurationView membership match key lookup by @phanky1 in #10586
Respect map order in ConfigurationView lookups by @phanky1 in #10597
Chore(deps): Update exceptiongroup requirement from >=1.3.0 to >=1.3.1 by @dependabot[bot] in #10600
Include _keys in ConfigurationView.swap_with() by @phanky1 in #10604
Chore(deps): Update click-didyoumean requirement from >=0.3.0 to >=0.3.1 by @dependabot[bot] in #10599
Add runtime in success signal by @sasirven in #9516
Retain fallback context managers until exit by @GangEunzzang in #10610
Preserve explicitly supplied empty timer schedules by @GangEunzzang in #10609
Fix: query_task doesn't find tasks scheduled with an ETA/countdown (#5321) by @ghirailghiro in #10535
Docs: add missing @app.task decorator to chain example by @rmnvg in #10613
Fix Redis result compression with decode_responses enabled by @phanky1 in #10612
docs: fix 'allows to' grammar in dont_autoretry_for docs by @mrchatam in #10615
docs: fix 'Allows to' grammar in configuration settings by @mrchatam in #10617
fix(canvas): propagate aggregate_duplicates through nested stamp merges by @MehrazRumman in #10616
Deny access to private attributes and dunders via registered() by @ndaprela in #10602
Fix argument forwarding through nested chains in eager execution by @aprylewu in #10611
Replacing a task with a chain which contains a group now returns a result instead of hanging by @auvipy in #9604
Fix linked signature option isolation during deepcopy by @Yukibei in #10594
added new regression test to check issue #3885 by @auvipy in #10622
Prevent add_defaults() from crashing when config_from_object() fails on an already configured app by @phanky1 in #10621
fix(backends.database): store task children with database backend (#8336) by @VimalN2005 in #10606
Prevent spawned worker crashes with explicit lazy=True by @phanky1 in #10619
Redact SAS tokens and lowercase account keys in AzureBlockBlobBackend.as_uri by @Dev-next-gen in #10620
Preserve configuration when copying settings by @GangEunzzang in #10623
Warn when two callables collide under one task name (#10576) by @vasilisnasopoulos in #10598
Chore(deps): Bump github/codeql-action from 4.37.9 to 4.38.0 by @dependabot[bot] in #10630
Task.replace() crashes with tuple-backed chains by @phanky1 in #10626
Chore(deps): Update gevent requirement from >=26.4.0 to >=26.8.0 by @dependabot[bot] in #10629
Prevent apply_async() from mutating cached execution options by @phanky1 in #10624
Chore(deps): Bump pycouchdb from 1.16.0 to 1.17.1 by @dependabot[bot] in #10627
Chore(deps-dev): Bump isort from 8.0.1 to 9.0.1 by @dependabot[bot] in #10628
try python 3.15 pre release on the CI by @auvipy in #10636
Chore(deps): Update sphinx2rst requirement from >=1.0 to >=1.1.0 by @dependabot[bot] in #10639
Chore(deps): Bump mypy from 1.19.1 to 2.3.1 by @dependabot[bot] in #10638
Set default max priority in Queues.setitem() when the queue has none by @phanky1 in #10645
backends.by_url() should accept backend classes by @phanky1 in #10635
Fix celery multi crashing on a single node name containing a dash by @Dev-next-gen in #10643
Rebuild the GCS storage client after a fork when Firestore is touched first by @Dev-next-gen in #10641
Chore(deps): Update tox requirement from >=4.61.2 to >=4.61.4 by @dependabot[bot] in #10640
Chore(deps): Update pydantic requirement from >=2.4 to ==2.13.5 by @dependabot[bot] in #10654
Fix empty group/chain handling in chains and group headers (#9772) by @MehrazRumman in #10646
Chore(deps): Update sphinx-celery requirement from >=2.1.1 to >=2.1.3 by @dependabot[bot] in #10656
Remove explicit garbage collection from test fixture teardown by @phanky1 in #10648
Support queue aliases in Queues.deselect() by @phanky1 in #10649
Chore(deps): Update boto3 requirement from >=1.43.6 to >=1.43.93 by @dependabot[bot] in #10655
Update click-repl version to 0.4.0 by @auvipy in #10658
Fix intermittent failure in backend teardown integration test by @phanky1 in #10662
Update billiard version requirement to 4.3.0 by @auvipy in #10659
Update billiard dependency in dev requirements by @auvipy in #10670
Keep a cancelled task unacked when the child reports SystemExit by @GangEunzzang in #10667
Skip empty groups in eager chains by @superh123 in #10644
Return the exact fractional utcoffset() instead of rounding it by @bodapatisaikrishna in #10625
Chore(deps): Update pre-commit requirement from >=4.0.1 to >=4.6.2 by @dependabot[bot] in #10665
Store failures raised as BaseException subclasses with the JSON serializer by @GangEunzzang in #10672
fix(backends.database): store stamping metadata with extended results (#8887) by @VimalN2005 in #10605
Chore(deps): Update azure-identity requirement from >=1.19.0 to ==1.25.3 by @dependabot[bot] in #10666
Chore(deps): Update flake8 requirement from >=3.8.3 to ==7.3.0 by @dependabot[bot] in #10664
Fix package version specifications in test.txt and upgrade moto by @auvipy in #10660
fix(app.utils): handle multi-server URLs in sanitize_url and bugreport (#8014) by @VimalN2005 in #10607
Refresh AMQP task routes for all configuration update forms by @phanky1 in #10673
Redis result backend: serialize pubsub access between the drainer and result cleanup by @goingforstudying-ctrl in #10671
Wait for the replacement child in the smoke respawn test by @GangEunzzang in #10674
Queues.setitem() should apply the default routing key by @phanky1 in #10669
Add the request context to task_failure in case of lost worker by @caspervdw in #9720
Fix revoked tasks running anyway after mingle merged revoke stamps from another host by @yauhpl-alt in #10668
Update kombu version to 5.7.0a1 by @auvipy in #10677
Expect the prefetch reduction to be skipped under per-consumer QoS by @GangEunzzang in #10682
Keep the Azure Block Blob backend picklable by @Dev-next-gen in #10647
Keep a finished result when a revoke arrives for the task by @GangEunzzang in #10679
Chore(deps): Bump grpcio from 1.83.1 to 1.84.0 by @dependabot[bot] in #10686
Chore(deps): Bump github/codeql-action from 4.38.0 to 4.38.1 by @dependabot[bot] in #10687
Chore(deps): Update elasticsearch requirement from <=9.5.0 to <=9.5.1 by @dependabot[bot] in #10685
Added Changelog for v5.7.0a1 Alpha 1 release by @auvipy in #10688
Bump version: 5.6.3 → 5.7.0a1 by @auvipy in #10690
New Contributors
@maycuatroi1 made their first contribution in #10048
@jorsyk made their first contribution in #10056
@Timour-Ilyas made their first contribution in #10066
@sbc-khacnha made their first contribution in #10081
@veeceey made their first contribution in #10100
@mriddle made their first contribution in #10086
@Mr-Neutr0n made their first contribution in #10121
@ChickenBenny made their first contribution in #10108
@bysiber made their first contribution in #10137
@Rohan5commit made their first contribution in #10139
@cuiweixie made their first contribution in #10133
@kelsonbrito50 made their first contribution in #10145
@abdullahmujahidali made their first contribution in #10150
@brianhelba made their first contribution in #10038
@Br1an67 made their first contribution in #10155
@daniel7an made their first contribution in #10103
@vchomakov made their first contribution in #10040
@drichardson made their first contribution in #10165
@tsangwailam made their first contribution in #10181
@Borzik made their first contribution in #10171
@aurangzaib048 made their first contribution in #10159
@ericbuehl made their first contribution in #10187
@KianAnbarestani made their first contribution in #10192
@patri27826 made their first contribution in #10184
@dpgraham4401 made their first contribution in #10216
@antonio-mello-ai made their first contribution in #10204
@as567-code made their first contribution in #10224
@avolant made their first contribution in #10135
@EhteshamSid made their first contribution in #10244
@Aamirofficiall made their first contribution in #10183
@sk- made their first contribution in #10176
@c32-4e3-844-41ed9dc5d made their first contribution in #10265
@kittywaresz made their first contribution in #10258
@angelojbgama made their first contribution in #10272
@Song-Junho97 made their first contribution in #10277
@Krishnachaitanyakc made their first contribution in #10217
@jberclaz made their first contribution in #10263
@dannon made their first contribution in #10281
@stef41 made their first contribution in #10260
@constantinblanariu made their first contribution in #10285
@mina58 made their first contribution in #10293
@SAY-5 made their first contribution in #10295
@paulkagiri made their first contribution in #10300
@lphuc2250gma made their first contribution in #10309
@cyphercodes made their first contribution in #10313
@puneetdixit200 made their first contribution in #10321
@sastraxi made their first contribution in #10276
@phanky1 made their first contribution in #10335
@arkadiuszbach made their first contribution in #10334
@wayyoungboy made their first contribution in #10343
@r266-tech made their first contribution in #10214
@goingforstudying-ctrl made their first contribution in #10342
@DHUKK made their first contribution in #10291
@harshitayadavv made their first contribution in #10397
@lxingy3 made their first contribution in #10385
@zainnadeem786 made their first contribution in #10363
@sahilkanger made their first contribution in #10378
@tejas-ae made their first contribution in #10257
@eyupcanakman made their first contribution in #10323
@theShmoo made their first contribution in #10403
@MahinAnowar made their first contribution in #10406
@eeshsaxena made their first contribution in #10392
@Ozone317 made their first contribution in #10414
@chuenchen309 made their first contribution in #10417
@hanu-14 made their first contribution in #10419
@oliverhaas made their first contribution in #10435
@locker95 made their first contribution in #10470
@Namraa310806 made their first contribution in #10461
@AleksaMCode made their first contribution in #10485
@sahilmathur254 made their first contribution in #10482
@bchrobot made their first contribution in #10498
@rahul2002m made their first contribution in #10488
@dylanpulver made their first contribution in #10504
@waterWang made their first contribution in #10519
@ckarnell made their first contribution in #10487
@LOGESHWAR123 made their first contribution in #10356
@darkdi made their first contribution in #10460
@harmehak0173 made their first contribution in #10481
@Whning0513 made their first contribution in #10447
@LaRoyBot made their first contribution in #10429
@Mahir-Panchal made their first contribution in #10399
@tobyh-canva made their first contribution in #10409
@leetrout made their first contribution in #10365
@ArockiaRajamanickam made their first contribution in #10532
@mgaitan made their first contribution in #10416
@MarthalaJagruthiReddy made their first contribution in #10563
@GebleaAlex made their first contribution in #10566
@GruffElixir made their first contribution in #10568
@tritsystem made their first contribution in #10571
@superboum made their first contribution in #10339
@istoolsfox made their first contribution in #10595
@sasirven made their first contribution in #9516
@rmnvg made their first contribution in #10613
@mrchatam made their first contribution in #10615
@ndaprela made their first contribution in #10602
@aprylewu made their first contribution in #10611
@Yukibei made their first contribution in #10594
@VimalN2005 made their first contribution in #10606
@Dev-next-gen made their first contribution in #10620
@vasilisnasopoulos made their first contribution in #10598
@superh123 made their first contribution in #10644
@bodapatisaikrishna made their first contribution in #10625
@caspervdw made their first contribution in #9720
@yauhpl-alt made their first contribution in #10668
Full Changelog: v5.6.3...v5.7.0a1

What's Changed

• Fix Django worker recursion bug + defensive checks for pool_cls.module by @maycuatroi1 in #10048
• Docs: Update user_preload_options example to use click. by @jorsyk in #10056
• Fix invalid configuration key "bootstrap_servers" in Kafka demo by @jorsyk in #10060
• Fix broken images on PyPI page by @Timour-Ilyas in #10066
• Remove broken reference. by @sueannioanis in #10071
• Removed --dist=loadscope from smoke tests by @Nusnus in #10073
• Docs: Clarify task_retry signal args may be None by @GangEunzzang in #10076
• Update example for Django by @sbc-khacnha in #10081
• Make tests compatible with pymongo >= 4.16 by @cjwatson in #10074
• fix: source install of cassandra-driver by @Izzette in #10105
• fix: register task cross-reference role in Sphinx extension by @veeceey in #10100
• fix: avoid cycle detection in native delayed delivery by @Izzette in #10095
• fix(asynpool): avoid AttributeError when proc lacks _sentinel_poll by @mriddle in #10086
• fix dusk_astronomical horizon sign (+18 -> -18) by @Mr-Neutr0n in #10121
• Fix/10106 onupdate col use lambda func by @ChickenBenny in #10108
• Fix warm shutdown RuntimeError with eventlet>=0.37.0 (#10083) by @ChickenBenny in #10123
• Fix 10109 db backend connection health by @ChickenBenny in #10124
• Database Backend filter unsupport sql engine arguments with nullpool #7355 by @ChickenBenny in #10134
• fix(beat): correct argument order in Service.reduce by @bysiber in #10137
• ci: declare explicit read-only token permissions in workflow jobs by @Rohan5commit in #10139
• chore: 'boto3to' to 'boto3 to' by @cuiweixie in #10133
• Database Backend: Add missing index on date_done (Fixes #10097) by @ChickenBenny in #10098
• docs: fix typo in CONTRIBUTING.rst by @Rohan5commit in #10141
• Refer to Flower / Prometheus for monitoring by @WilliamDEdwards in #10140
• docs: remove duplicated words in broker and routing docs by @Rohan5commit in #10146
• docs: fix stale version reference and grammar in README by @kelsonbrito50 in #10145
• docs: fix wording in Celery 5.3 worker pool notes by @Rohan5commit in #10149
• docs: fix duplicated wording in 3.1 changelog entry by @Rohan5commit in #10152
• docs: fix changelog typo in context manager wording by @Rohan5commit in #10144
• Fix/10096 worker fails to reconnect after redis failover by @ChickenBenny in #10151
• Improve on_after_finalize signal documentation by @Br1an67 in #10155
• Add non-commutative example to clarify partial arg ordering in canvas docs by @Br1an67 in #10157
• Remove redundant test_isa_mapping test (fixes #10077) by @daniel7an in #10103
• Upgrade pytest-celery to >=1.3.0 and adopt PYTEST_CELERY_PKG build arg by @Nusnus in #10162
• Remove deprecated args from redis get_connection call by @JaeHyuckSa in #10036
• Fix #6912 rpc backend reconnection error by @ChickenBenny in #10179
• Fix NameError with TYPE_CHECKING annotations on Python 3.14+ (PEP 649) by @drichardson in #10165
• docs: Add elaboration on prefetch multiplier settings (worker_prefetch_multiplier) and worker_eta_task_limit by @tsangwailam in #10181
• Fix O(K²) message bloat in a chain of chords by @Borzik in #10171
• Fix mock connection interfaces to prevent TypeError during exception handling by @ChickenBenny in #10178
• fix(trace): dispatch chain/callbacks on dedup fast-path for redelivered tasks by @aurangzaib048 in #10159
• Extract reconnect_on_error to BaseResultConsumer by @ChickenBenny in #10189
• pep 649 by @ericbuehl in #10187
• Fix#9722 friendly status errors for CLI by @ChickenBenny in #10190
• docs: clarify after_return behavior for retried tasks by @KianAnbarestani in #10192
• Add compression header to message protocol docs by @Br1an67 in #10156
• docs: fix duplicated word in bootsteps comment by @Rohan5commit in #10153
• Remove outdated autoreloader section from extending docs by @Br1an67 in #10154
• Fix: prioritize request ignore_result over task definition by @patri27826 in #10184
• fix: clear the timer while catch the exception by @ChickenBenny in #10218
• Prepare for release: v5.6.3 by @Nusnus in #10221

New Contributors

• @maycuatroi1 made their first contribution in #10048
• @jorsyk made their first contribution in #10056
• @Timour-Ilyas made their first contribution in #10066
• @sueannioanis made their first contribution in #10071
• @GangEunzzang made their first contribution in #10076
• @sbc-khacnha made their first contribution in #10081
• @veeceey made their first contribution in #10100
• @mriddle made their first contribution in #10086
• @Mr-Neutr0n made their first contribution in #10121
• @ChickenBenny made their first contribution in #10108
• @bysiber made their first contribution in #10137
• @Rohan5commit made their first contribution in #10139
• @cuiweixie made their first contribution in #10133
• @kelsonbrito50 made their first contribution in #10145
• @Br1an67 made their first contribution in #10155
• @daniel7an made their first contribution in #10103
• @drichardson made their first contribution in #10165
• @tsangwailam made their first contribution in #10181
• @Borzik made their first contribution in #10171
• @aurangzaib048 made their first contribution in #10159
• @ericbuehl made their first contribution in #10187
• @KianAnbarestani made their first contribution in #10192
• @patri27826 made their first contribution in #10184

Full Changelog: v5.6.2...v5.6.3

What's Changed

• Fix Redis Sentinel ACL authentication support by @anthonykuzmich7 in #10013
• Fix: Broker heartbeats not sent during graceful shutdown by @weetster in #9986
• docs #5410 -- Document confirm_publish broker transport option by @JaeHyuckSa in #10016
• close DB pools only in prefork mode by @petrprikryl in #10020
• Fix: Avoid unnecessary Django database connection creation during cleanup by @snopoke in #10015
• reliable prefork detection by @petrprikryl in #10023
• better coverage by @petrprikryl in #10029
• Docs: clarify result_extended vs periodic task metadata and show headers["periodic_task_name"] example by @SpaceShaman in #10030
• Stop importing pytest_subtests by @cjwatson in #10032
• Only use exceptiongroup backport for Python < 3.11 by @cjwatson in #10033
• Prepare for release: v5.6.1 by @Nusnus in #10037

New Contributors

• @anthonykuzmich7 made their first contribution in #10013
• @weetster made their first contribution in #9986
• @JaeHyuckSa made their first contribution in #10016
• @snopoke made their first contribution in #10015
• @SpaceShaman made their first contribution in #10030

Full Changelog: v5.6.0...v5.6.1

Celery v5.6.0 is now available.

Key Highlights

See What's new in Celery 5.6 for a complete overview or read the main highlights below.

Python 3.9 Minimum Version

Celery 5.6.0 drops support for Python 3.8 (EOL). The minimum required Python version is now 3.9. Users still on Python 3.8 must upgrade their Python version before upgrading to Celery 5.6.0.

Additionally, this release includes initial support for Python 3.14.

SQS: Reverted to pycurl from urllib3

The switch from pycurl to urllib3 for the SQS transport (introduced in Celery 5.5.0 via Kombu) has been reverted due to critical issues affecting SQS users.

Contributed by @auvipy in #9620.

Security Fix: Broker Credential Leak Prevention

Fixed a security issue where broker URLs containing passwords were being logged in plaintext by the delayed delivery mechanism. Broker credentials are now properly sanitized in all log output.

Contributed by @giancarloromeo in #9997.

Memory Leak Fixes

Two significant memory leaks have been fixed in this release:

• Exception Handling Memory Leak: Fixed a critical memory leak in task exception handling that was particularly severe on Python 3.11+ due to enhanced traceback data. The fix properly breaks reference cycles in tracebacks to allow garbage collection.

Contributed by @jaiganeshs21 in #9799.

• Pending Result Memory Leak: Fixed a memory leak where AsyncResult subscriptions were not being cleaned up when results were forgotten.

Contributed by @tsoos99dev in #9806.

ETA Task Memory Limit

New configuration option worker_eta_task_limit to prevent out-of-memory crashes when workers fetch large numbers of ETA or countdown tasks. Previously, workers could exhaust available memory when the broker contained many scheduled tasks.

Example usage:

app.conf.worker_eta_task_limit = 1000

Contributed by @sashu2310 in #9853.

Queue Type Selection for Auto-created Queues

New configuration options allow specifying the queue type and exchange type when Celery auto-creates missing queues. This is particularly useful for RabbitMQ users who want to use quorum queues with auto-created queues.

Configuration options:

• task_create_missing_queue_type: Sets the queue type for auto-created queues (e.g., quorum, classic)
• task_create_missing_queue_exchange_type: Sets the exchange type for auto-created queues

Example usage:

app.conf.task_create_missing_queue_type = 'quorum'

Contributed by @ghirailghiro in #9815.

What's Changed

Prepare for release: v5.6.0 by @Nusnus in #10010

Full Changelog: v5.6.0rc2...v5.6.0

Celery v5.6.0 Release Candidate 2 is now available for testing.

Please help us test this version and report any issues.

What's Changed

• Remove Python 4.0 version condition for pytest dependencies by @ulgens in #9993
• Sanitize broker URL in delayed delivery logs (avoid leaking credentials) by @giancarloromeo in #9997
• Don't fail task on timeout during cold shutdown by @Nusnus in #9678
• Add Py39-314t to CI by @Nusnus in #9999
• asynpool: Don't return from inside a finally block by @torarvid in #10000
• Prepare for (pre) release: v5.6.0rc2 by @Nusnus in #10005

New Contributors

• @ulgens made their first contribution in #9993
• @giancarloromeo made their first contribution in #9997
• @torarvid made their first contribution in #10000

Full Changelog: v5.6.0rc1...v5.6.0rc2

Celery v5.6.0 Release Candidate 1 is now available for testing.

Please help us test this version and report any issues.

What's Changed

• Add support for Django Connection pool by @petrprikryl in #9953
• Pin tblib to ==3.1.0 by @kernelshard in #9967
• fix(worker): continue to attempt to bind other queues after a native delayed delivery binding failure has occurred by @Izzette in #9959
• Handle UnpicklingError in persistent scheduler initialization by @pakallis in #9952
• Bug Fix: Nested Chords Fail When Using django-celery-results with a Redis Backend by @kumuthu53 in #9950
• Add support pymongo 4.12 by @kidoz in #9665
• Make tests compatible with pymongo >= 4.14 by @cjwatson in #9968
• tblib updated from 3.1.0 to 3.2.0 by @MehrazRumman in #9970
• Fix remaining function typing and docstring by @wcislo-saleor in #9971
• Fix regex pattern in version parsing and remove duplicate entry in all by @sagar1343 in #9978
• Bump Kombu to v5.6.0 and removed <5.7 limit on kombu by @Nusnus in #9981
• Prepare for (pre) release: v5.6.0rc1 by @Nusnus in #9982

New Contributors

• @petrprikryl made their first contribution in #9953
• @kernelshard made their first contribution in #9967
• @Izzette made their first contribution in #9959
• @kumuthu53 made their first contribution in #9950
• @wcislo-saleor made their first contribution in #9971
• @sagar1343 made their first contribution in #9978

Full Changelog: v5.6.0b2...v5.6.0rc1

Celery v5.6.0 Beta 2 is now available for testing.

Please help us test this version and report any issues.

What's Changed

• GitHub Actions: Test on Python 3.14 release candidate 2 by @cclauss in #9891
• Update pypy to python 3.11 by @cclauss in #9896
• Feature: Add support credential_provider to Redis Backend by @alaminopu in #9879
• Celery.timezone: try tzlocal.get_localzone() before using LocalTimezone by @woutdenolf in #9862
• Run integration tests on Python 3.14 by @cclauss in #9903
• Fix arithmetic overflow for MSSQL result backend by @vladborovtsov in #9904
• Add documentation for task_id param for apply_async function by @sumo1998 in #9906
• Support redis client name by @mdalp in #9900
• Bump Kombu to v5.6.0rc1 by @Nusnus in #9918
• Fix broker connection retry attempt counter in the error log by @sumo1998 in #9911
• fix: restrict disable-prefetch feature to Redis brokers only by @Dkhodos in #9919
• fix(): preserve group order in replaced signature by @simonepozzoli-pix4d in #9910
• Remove Python 3.8 from CI workflow by @auvipy in #9930
• Update default Python versions in integration tests by @auvipy in #9931
• Update tox.ini to remove Python 3.8 by @auvipy in #9932
• Remove Python 3.8 from Dockerfile by @auvipy in #9933
• Update Python version requirement to 3.9 by @auvipy in #9935
• Update pypy version from 3.10 to 3.11 in Dockerfile by @auvipy in #9934
• Flake8 fixes by @auvipy in #9955
• Remove test-pypy3.txt from Dockerfile dependencies by @auvipy in #9939
• Remove backports.zoneinfo for Python 3.9 compatibility by @auvipy in #9956
• Update pytest-cov version for Python compatibility by @auvipy in #9957
• Update pytest-rerunfailures and pre-commit versions by @auvipy in #9958
• Prepare for (pre) release: v5.6.0b2 by @Nusnus in #9938

New Contributors

• @vladborovtsov made their first contribution in #9904
• @sumo1998 made their first contribution in #9906
• @mdalp made their first contribution in #9900
• @simonepozzoli-pix4d made their first contribution in #9910

Full Changelog: v5.6.0b1...v5.6.0b2

Celery v5.6.0 Beta 1 is now available for testing.

Please help us test this version and report any issues.

What's Changed

• docs: mention of json serializer recursive reference message size blowup (#5000) by @chrisbarber in #9743
• docs: typo in canvas.rst by @chrisbarber in #9744
• Makes _on_retry return a float as required to be used as errback on retry_over_time by @maccinza in #9741
• Update canvas.rst doc calculation order for callback by @auvipy in #9758
• Updated Blacksmith logo by @Nusnus in #9763
• Made the Sponsors logos link to their website by @Nusnus in #9764
• add missing cloudamqp logo by @auvipy in #9767
• Improve sponsor visibility by @auvipy in #9768
• fix: (#9773) task_id must not be empty with chain as body of a chord by @dfm88 in #9774
• Update setup.py to fix deprecation warning by @auvipy in #9771
• Adds integration test for chord_unlock bug when routed to quorum/topic queue by @maccinza in #9766
• Add xfail test for default queue/exchange fallback ignoring task_default_* settings by @maccinza in #9765
• Add xfail test for RabbitMQ quorum queue global QoS race condition by @maccinza in #9770
• fix: (#8786) time out when chord header fails with group body by @dfm88 in #9788
• Fix #9738 : Add root_id and parent_id to .apply() by @dfm88 in #9784
• Replace DelayedDelivery connection creation to use context manger by @bityob in #9793
• Fix #9794: Pydantic integration fails with future.annotations. by @davidt in #9795
• add go and rust implementation in docs by @darixsamani in #9800
• Fix memory leak in exception handling (Issue #8882) by @jaiganeshs21 in #9799
• Fix handlers docs (Issue #9787) by @jaiganeshs21 in #9804
• Remove importlib_metadata leftovers by @cjwatson in #9791
• Update timeout minutes for smoke tests CI by @auvipy in #9807
• Revert "Remove dependency on pycurl" by @auvipy in #9620
• Add Blacksmith Docker layer caching to all Docker builds by @Nusnus in #9840
• Bump Kombu to v5.6.0b1 by @Nusnus in #9839
• Disable pytest-xdist for smoke tests and increase retries (CI ONLY) by @Nusnus in #9842
• Fix Python 3.13 compatibility in events dumper by @Nusnus in #9826
• Dockerfile Build Optimizations by @Nusnus in #9733
• Migrated from useblacksmith/build-push-action@v1 to useblacksmith/setup-docker-builder@v1 in the CI by @Nusnus in #9846
• Remove incorrect example by @YuppY in #9854
• Revert "Use Django DB max age connection setting" by @danlamanna in #9824
• Fix pending_result memory leak by @tsoos99dev in #9806
• Update python-package.yml by @auvipy in #9856
• Bump actions/checkout from 4 to 5 by @dependabot[bot] in #9857
• Bump Kombu to v5.6.0b2 by @Nusnus in #9858
• Refactor integration and smoke tests CI by @Nusnus in #9855
• Fix AsyncResult.forget() with couchdb backend method raises TypeError: a bytes-like object is required, not 'str' by @temaxuck in #9865
• Improve Docs for SQS Authentication by @BlaiseMuhirwa in #9868
• Added .github/copilot-instructions.md for GitHub Copilot by @Nusnus in #9874
• misc: credit removal by @0asys in #9877
• Choose queue type and exchange type when creating missing queues (fix #9671) by @ghirailghiro in #9815
• fix: prevent celery from hanging due to spawned greenlet errors in greenlet drainers by @linusphan in #9371
• Feature/disable prefetch fixes by @Dkhodos in #9863
• Add worker_eta_task_limit configuration to manage ETA task memory usage by @sashu2310 in #9853
• Update runner version in Docker workflow by @auvipy in #9884
• Prepare for (pre) release: v5.6.0b1 by @Nusnus in #9890

New Contributors

• @chrisbarber made their first contribution in #9743
• @dfm88 made their first contribution in #9774
• @davidt made their first contribution in #9795
• @darixsamani made their first contribution in #9800
• @YuppY made their first contribution in #9854
• @danlamanna made their first contribution in #9824
• @tsoos99dev made their first contribution in #9806
• @temaxuck made their first contribution in #9865
• @BlaiseMuhirwa made their first contribution in #9868
• @ghirailghiro made their first contribution in #9815
• @linusphan made their first contribution in #9371
• @Dkhodos made their first contribution in #9863
• @sashu2310 made their first contribution in #9853

Full Changelog: v5.5.3...v5.6.0b1

What's Changed

• make the tests run on python 3.13 for gcs backend by @auvipy in #9677
• Added DeepWiki to README by @Nusnus in #9683
• Limit redis to <=v5.2.1 to match Kombu by @Nusnus in #9693
• Use EX_OK instead of literal zero by @Nusnus in #9684
• Make wheel metadata reproducible by @cjwatson in #9687
• let celery install from kombu dependencies for better align by @auvipy in #9696
• Fix stamping documentation to clarify stamped_headers key is optional in visitor methods by @Nusnus in #9697
• Support apply_async without queue argument on quorum queues by @bityob in #9686
• Updated rabbitmq doc about using quorum queues with task routes by @bityob in #9707
• Add: Dumper Unit Test by @yiyu0x in #9711
• Add unit test for event.group_from by @rogerforlife in #9709
• refactor: add beat_cron_starting_deadline documentation warning by @alirafiei75 in #9712
• fix: resolve issue #9569 by supporting distinct broker transport options for workers by @yiyu0x in #9695
• Fixes issue with retry callback arguments in DelayedDelivery by @maccinza in #9708
• get_exchange-unit-test by @rogerforlife in #9710
• ISSUE-9704: Update documentation of result_expires, filesystem backend is supported by @MattiasDC in #9716
• update to blacksmith ubuntu 24.04 by @auvipy in #9717
• Added unit tests for celery.utils.iso8601 by @jaiganeshs21 in #9725
• Update introduction.rst docs by @auvipy in #9728
• Prepare for release: v5.5.3 by @Nusnus in #9732

New Contributors

• @bityob made their first contribution in #9686
• @yiyu0x made their first contribution in #9711
• @rogerforlife made their first contribution in #9709
• @alirafiei75 made their first contribution in #9712
• @maccinza made their first contribution in #9708
• @MattiasDC made their first contribution in #9716
• @jaiganeshs21 made their first contribution in #9725

Full Changelog: v5.5.2...v5.5.3

What's Changed

• Fix calculating remaining time across DST changes by @imrivera in #9669
• Remove setup_logger from COMPAT_MODULES by @rconradharris in #9668
• Fix mongodb bullet and fix github links in contributions section by @jabberwock404 in #9672
• Prepare for release: v5.5.2 by @Nusnus in #9675

New Contributors

• @imrivera made their first contribution in #9669
• @rconradharris made their first contribution in #9668
• @jabberwock404 made their first contribution in #9672

Full Changelog: v5.5.1...v5.5.2