Objective & Overview
Implement protocol adapters for direct range downloads from cloud object stores (AWS S3, Google Cloud Storage, Azure Blob Storage) and enterprise network proxies (SOCKS5, HTTP CONNECT).
Technical Specification & Design
- Cloud Protocols:
- AWS S3: SigV4 signature headers for range GETs
- GCS:
gs:// OAuth2 token authorization
- Azure:
az:// Shared Key and SAS range requests (x-ms-range)
- Enterprise Proxies:
- SOCKS5 (RFC 1928) handshake and remote DNS
- HTTP
CONNECT proxy tunneling with custom CA bundles
Key Deliverables & Module Breakdown
src/adapters/s3_adapter.py: AWS S3 range adapter
src/adapters/gcs_adapter.py: GCS range adapter
src/adapters/azure_adapter.py: Azure Blob adapter
src/adapters/proxy_adapter.py: SOCKS5 and HTTP CONNECT proxy adapter
Acceptance Criteria & Checkpoints
Documentation References
Objective & Overview
Implement protocol adapters for direct range downloads from cloud object stores (AWS S3, Google Cloud Storage, Azure Blob Storage) and enterprise network proxies (SOCKS5, HTTP CONNECT).
Technical Specification & Design
gs://OAuth2 token authorizationaz://Shared Key and SAS range requests (x-ms-range)CONNECTproxy tunneling with custom CA bundlesKey Deliverables & Module Breakdown
src/adapters/s3_adapter.py: AWS S3 range adaptersrc/adapters/gcs_adapter.py: GCS range adaptersrc/adapters/azure_adapter.py: Azure Blob adaptersrc/adapters/proxy_adapter.py: SOCKS5 and HTTP CONNECT proxy adapterAcceptance Criteria & Checkpoints
Documentation References