Rudder Server Updates & Release Notes

Features

• per-workspace PyT routing + cold-start handling (#6978) (d81e175)
• periodic cleanup of rsources shared db tables (#6945) (ed0dfe7)

Bug Fixes

• batchrouter: preserve prior LastJobStatus error on drain (#6958) (af31e62)
• batchrouter: preserve prior LastJobStatus error on drain (#6958) (193f797)
• clickhouse quarter partition type (#6965) (af31e62)
• continuous backend config cache cause postgres disk bloat (#6983) (f45aa06)
• ignore failed messages when source job run id exists (#6981) (045fdc0)
• server getting stuck during startup while initializing rsources (#6943) (62791fa)
• snowpipe streaming bulk status offset (#6966) (af31e62)

Miscellaneous

• ci: workflow cleanup (SEC-284) (#6949) (516ba5b)
• deps: bump actions/upload-artifact from 7.0.0 to 7.0.1 (#6892) (866f04d)
• deps: bump aws-actions/amazon-ecr-login from 2.0.1 to 2.1.4 (#6956) (89f1168)
• deps: bump docker/login-action from 4.0.0 to 4.1.0 (#6881) (5bca875)
• deps: bump rudderlabs/build-scan-push-action from 1.8.2 to 2.2.0 (#6955) (78cc895)
• deps: bump step-security/harden-runner from 2.16.0 to 2.19.1 (#6957) (cc5b578)
• jobsdb: disable no results cache state filter optimization (#6964) (c20dad2)
• jobsdb: release dsList read lock early during store (#6963) (a172404)
• pyt contracts for ipc and multi threading (#6942) (d570865)
• remove unused sed deletion method from GZIPLocalFileHandler (#6974) (d788760)
• replace deprecated WithCredentialsJSON with WithAuthCredentialsJSON (#6986) (8395174)
• sync release v1.75.0 to main branch (#6954) (f16fe93)

Features

• snowpipe batch status (#6926) (f00dd89)
• support clickhouse day week month partitions (#6931) (00ff494)
• support concurrency during partition migration flushing (#6929) (dd2f658)

Bug Fixes

• router: delays in finding worker slots when event ordering is disabled (#6930) (a7389f8)
• rsources failed keys batch fails to be inserted with postgres error 21000 (#6940) (3c7a1ec)
• salesforce bulk upload null and numeric CSV formatting (#6923) (5e67a45)

Miscellaneous

• debug snowpipe streaming importing job size (#6941) (73d3bbe)
• filtering overflow events for snowpipe streaming above 16MB (#6921) (2e5192b)
• pyt managed session (#6910) (c7aa7c4)
• remove deprecated fetch-tables endpoint (#6944) (fdb2649)
• sync release v1.74.0 to main branch (#6920) (e844f82)
• workflow cleanup (#6924) (da7161d)

Features

• add configurable batch size for bulk inserting failed rsources records (#6873) (d8f6ea0)
• add native deletion support for identity removal in gzip files (#6896) (c1e27d0)
• deep job pickups when no results cache is cold (#6850) (03e9d88)
• jobsdb: improve migration compaction (#6844) (b7f2b9f)

Bug Fixes

• add correct host for salesforceBU destination (#6906) (2430cb4)
• batch router drained events metrics (#6898) (c5b2927)
• build action failing (#6899) (691a812)
• snowpipe struck scenarios (#6895) (35b07a8)
• use tid instead of vid (#6908) (954dcf7)

Miscellaneous

• avoid marshalling proc error job payloads (#6872) (145826b)
• bump build-scan-push-action from v2.1.0 to v2.2.0 (#6903) (e917f9b)
• contract tests for dns regressions and overrides (#6864) (b105678)
• pin and bump action refs (SEC-171) (#6863) (8089953)
• pytransformer pooling contract tests (#6883) (0530c8c)
• scope workflow permissions to least privilege (SEC-167) (#6911) (5600dbe)
• update Slack notification method in scheduled release workflow (#6879) (3b67dcb)
• vuln: zizmor --fix=all findings (SEC-199) (#6905) (d8cc34f)

Bug Fixes

• blacklist uts by transformation id (#6832) (a78fa93)
• warehouse: intermittent failures in bigquery integration test partition listing (#6862) (f0bdc52)
• warehouse: intermittent failures in bigquery integration test schema verification (#6858) (8244315)

Miscellaneous

• add dependabot cooldown (#6842) (8a96763)
• apply security best practices from step security (#6746) (ec4390d)
• change release to 1.73.0 (370bbdb)
• deps: bump actions/checkout from 4.3.0 to 6.0.2 (#6848) (f393a5f)
• deps: bump actions/create-github-app-token from 2.1.4 to 3.0.0 (#6845) (7b5bd0f)
• deps: bump actions/download-artifact from 4.3.0 to 8.0.1 (#6849) (3d0c5f5)
• deps: bump actions/setup-go from 5.5.0 to 6.4.0 (#6831) (f4d7c78)
• deps: bump actions/stale from 9.1.0 to 10.2.0 (#6805) (fe697e3)
• deps: bump actions/upload-artifact from 4.6.2 to 7.0.0 (#6847) (8cc34b8)
• deps: bump codecov/codecov-action from 5.5.1 to 6.0.0 (#6830) (667d363)
• deps: bump docker/login-action from 3.4.0 to 4.0.0 (#6808) (fdd16b5)
• deps: bump docker/metadata-action from 5.9.0 to 6.0.0 (#6851) (766203b)
• deps: bump docker/setup-buildx-action from 3.11.1 to 4.0.0 (#6806) (1ac9e51)
• deps: bump github.com/evanphx/json-patch from 0.5.2 to 5.9.11+incompatible (#6853) (8526e45)
• deps: bump go dependencies (#6816) (5630ae4)
• deps: bump slackapi/slack-github-action from 1.26.0 to 3.0.1 (#6846) (b16d1f7)
• deps: bump the go-deps group across 1 directory with 8 updates (#6859) (29c7c59)
• dispatch release events to operator/devops after image builds complete (#6827) (c9c0dde)
• remove rsources_failed_keys migration and unused code (#6837) (9460873)
• router: kafka destination performance improvement (#6836) (90cbb45)
• sync release v1.72.0 to main branch (#6829) (cd13f36)
• update openfaas-flask ecr repo (#6828) (3aa2485)

Features

• jobsdb: migration optimizations for large number of datasets (#6786) (641f9fd)

Bug Fixes

• language label (#6809) (ac501c8)
• mirroring round trip comparison (#6813) (57a079b)
• sanity checks (#6817) (2969e3e)

Miscellaneous

• partition migration stress test and improvements (#6802) (419818a)
• sync release v1.71.0 to main branch (#6801) (6a6ee90)

Bug Fixes

• router panics when invalid header format is returned by transformer (#6795) (910f421)
• snowpipe streaming remove authz error handling (#6777) (910f421)
• snowpipe streaming remove authz error handling (#6777) (5eaffb6)

Miscellaneous

• bump rudder-schemas to 0.11.0 (#6779) (7c7296b)
• bump rudder-transformer to v1.126.2 (#6774) (69692ac)
• force release 1.71.0 (#6791) (9cf21c7)
• jobsdb: partition migration improvements (#6772) (57b1c70)
• sync release v1.70.0 to main branch (#6775) (74125a6)
• ut mirror filtering (#6776) (fa4d1c4)