fix(scrapy)!: serialize requests and HTTP cache as JSON instead of pickle - #951

Merged

vdusek merged 12 commits into

fix/scrapy-json-serialization

Jun 10, 2026

Commits on Jun 9, 2026

fix(scrapy)!: serialize requests and HTTP cache as JSON instead of pickle
vdusek
committed
d73fcb4
fix(scrapy): Delete stale HTTP cache items instead of overwriting them with null
vdusek
committed
afcaa2a

Commits on Jun 10, 2026

Improvements
vdusek
committed
0ef1954
fix(scrapy): reject non-base64 payloads when decoding serialized data
vdusek
committed
dca36d1
chore(scrapy): serialization module docstring, drop test dividers
vdusek
committed
3b59797
docs(scrapy): clarify HTTP cache settings wording
vdusek
committed
ec7e422
Merge branch 'master' into fix/scrapy-json-serialization
vdusek
committed
31c05d7
docs(scrapy): document JSON serialization breaking change in v4 upgrading guide
vdusek
committed
eabdcbd
Polish docstrings and comments
vdusek
committed
44eb971
test(scrapy): cover serialization, cache store, and scheduler enqueue paths
vdusek
committed
b24db90
refactor(scrapy): drop dead apify_request_id handling in to_apify_request
vdusek
committed
837b649
add 2 more tests
vdusek
committed
d404786