Skip to content

Replace axios & httpx with impit in the HTTP-scraping start templates #847

Description

@vdusek

Our plain HTTP-scraping templates use general-purpose HTTP clients (axios in JS/TS, httpx in Python). We should switch them to impit, Apify's HTTP client with browser impersonation (TLS/HTTP fingerprinting), which is a better default for web scraping since it gets blocked less often.

Affected templates

axiosimpit:

  • js-start
  • ts-start
  • ts-start-bun

httpximpit:

  • python-start
  • python-beautifulsoup

Per template

  • Swap the dependency (package.json / requirements.txt).
  • Update the request code in main.{js,ts,py} and its comments.
  • Update any HTTP-client mention in the README.

Packages: npm impit, PyPI impit. Docs: https://apify.github.io/impit/

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request.t-buildersIssues owned by the Builders team.t-dx

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions