Skip to content

Commit 5277d25

Browse files
vdusekclaude
andcommitted
test: fix max_crawl_depth test to use /deep/ chain from shared server
Update test_actor_on_platform_max_crawl_depth to use the /deep/N URL pattern from the shared server instead of the old infinite pagination URLs that no longer exist. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 8dd9a16 commit 5277d25

1 file changed

Lines changed: 6 additions & 2 deletions

File tree

tests/e2e/test_crawlers_with_storages.py

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ async def main() -> None:
2323
async with Actor:
2424
crawler = ParselCrawler(max_crawl_depth=2)
2525
finished = []
26-
enqueue_pattern = re.compile(r'http://localhost:8080/2+$')
26+
enqueue_pattern = re.compile(r'http://localhost:8080/deep/\d+$')
2727

2828
@crawler.router.default_handler
2929
async def default_handler(context: ParselCrawlingContext) -> None:
@@ -33,7 +33,11 @@ async def default_handler(context: ParselCrawlingContext) -> None:
3333
finished.append(context.request.url)
3434

3535
await crawler.run(['http://localhost:8080/'])
36-
assert finished == ['http://localhost:8080/', 'http://localhost:8080/2', 'http://localhost:8080/22']
36+
assert finished == [
37+
'http://localhost:8080/',
38+
'http://localhost:8080/deep/1',
39+
'http://localhost:8080/deep/2',
40+
]
3741

3842
actor = await make_actor(label='crawler-max-depth', main_func=main)
3943
run_result = await run_actor(actor)

0 commit comments

Comments
 (0)