Antalya 26.8: auto-grp-pr-2159: combined port of 22 PRs

[zvonand]

Changelog category (leave one):

• Experimental Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add experimental content-addressed storage (cas) for object-storage disks, letting multiple servers share deduplicated MergeTree data in one S3/GCS bucket pool, with replica fetches that relink shared data instead of copying it, lease-coordinated background garbage collection, SYSTEM CAS commands, system.cas_* tables, clickhouse-disks integrity tools, configurable mount lease timing, parallel and batched GC deletes, EXPORT PARTITION support, faster table loading and cheaper part removal, plus fixes for GC races that could delete still-referenced data and for lease renewal failing under server memory pressure. Also stop parsing every listed object-storage key as JSON, which removes a thrown exception per key from every object-storage listing.
Add experimental content-addressed storage (cas) for object-storage disks, letting multiple servers share deduplicated MergeTree data in one S3/GCS bucket pool, with replica fetches that relink shared data instead of copying it, lease-coordinated background garbage collection, SYSTEM CAS commands, system.cas_* tables, clickhouse-disks integrity tools, configurable mount lease timing, parallel and batched GC deletes, EXPORT PARTITION support, faster table loading and cheaper part removal, plus fixes for GC races that could delete still-referenced data and for lease renewal failing under server memory pressure. Also stop parsing every listed object-storage key as JSON, which removes a thrown exception per key from every object-storage listing (#2159 by @filimonov, #2300 by @filimonov, #2307 by @k-morozov, #2312 by @k-morozov, #2326 by @k-morozov, #2349 by @k-morozov, #2360 by @filimonov, #2384 by @filimonov, #2385 by @filimonov, #2393 by @filimonov, #2292 by @alsugiliazova, #2351 by @k-morozov, #2440 by @filimonov, #2452 by @filimonov, #2463 by @filimonov, #2444 by @ianton-ru, #2455 by @filimonov, #2484 by @filimonov, #2509 by @filimonov, #2510 by @filimonov, #2511 by @filimonov, #2483 by @filimonov).

CI/CD Options

Exclude tests:

• Fast test
• Integration Tests
• Stateless tests
• Stateful tests
• Performance tests
• All with ASAN
• All with TSAN
• All with MSAN
• All with UBSAN
• All with Coverage
• All with Aarch64
• All Regression
• Disable CI Cache

Regression jobs to run:

• Fast suites (mostly <1h)
• Aggregate Functions (2h)
• Alter (1.5h)
• Benchmark (30m)
• ClickHouse Keeper (1h)
• Iceberg (2h)
• LDAP (1h)
• Parquet (1.5h)
• RBAC (1.5h)
• SSL Server (1h)
• S3 (2h)
• S3 Export (2h)
• Swarms (30m)
• Tiered Storage (2h)

Combined port of 22 PR(s) (group auto-grp-pr-2159). Cherry-picked from #2159, #2300, #2307, #2312, #2326, #2349, #2360, #2384, #2385, #2393, #2292, #2351, #2440, #2452, #2463, #2444, #2455, #2484, #2509, #2510, #2511, #2483.

• [experimental] CAS (Content-addressed storage) over shared object storage for antalya-26.6 #2159 — [experimental] CAS (Content-addressed storage) over shared object storage for antalya-26.6
• CAS improvements #2300 — CAS improvements
• CAS: configurable mount lease timing #2307 — CAS: configurable mount lease timing
• CAS: doc for GC round #2312 — CAS: doc for GC round
• CAS: gc scheduler stop join race #2326 — CAS: gc scheduler stop join race
• MemoryWorker: use sanitizer info for allocated counter #2349 — MemoryWorker: use sanitizer info for allocated counter
• Fix the coverage build: unused variable in gtest_cas_throttling_gate.cpp #2360 — Fix the coverage build: unused variable in gtest_cas_throttling_gate.cpp
• CI: cap the RustFS blocking-thread pool on the CAS-S3 lanes and collect its log #2384 — CI: cap the RustFS blocking-thread pool on the CAS-S3 lanes and collect its log
• CI: lldb stack budget by build flavor, and keep lldb's JIT breakpoint out of the server #2385 — CI: lldb stack budget by build flavor, and keep lldb's JIT breakpoint out of the server
• Temporary workaround: do not probe object-storage listing keys as JSON #2393 — Temporary workaround: do not probe object-storage listing keys as JSON
• Enable cas s3 stress #2292 — Enable cas s3 stress
• CAS: parallel delete blobs #2351 — CAS: parallel delete blobs
• CAS: answer directory probes inside a part from the part manifest, no LIST per part file #2440 — CAS: answer directory probes inside a part from the part manifest, no LIST per part file
• CAS: remove a part with one ref drop #2452 — CAS: remove a part with one ref drop
• CAS GC: delete a condemn marker only for the condemnation that owns it #2463 — CAS GC: delete a condemn marker only for the condemnation that owns it
• Document Antalya-only profile events and metrics. #2444 — Document Antalya-only profile events and metrics.
• CAS: drop KeyStrictness, readers skip unknown ordinary keys #2455 — CAS: drop KeyStrictness, readers skip unknown ordinary keys
• CAS GC: cut batch deletes to the storage's batch-delete limit #2484 — CAS GC: cut batch deletes to the storage's batch-delete limit
• Date a GC mount-token sighting after the read that returned it #2509 — Date a GC mount-token sighting after the read that returned it
• Return the last Indeterminate when a CAS probe pause ends on the deadline #2510 — Return the last Indeterminate when a CAS probe pause ends on the deadline
• Keep the CAS mount lease renewal alive over the server memory limit #2511 — Keep the CAS mount lease renewal alive over the server memory limit
• CAS GC: batch the namespace janitor's deletes under a soft time budget #2483 — CAS GC: batch the namespace janitor's deletes under a soft time budget