Low-hanging improvements to the crawler APIs - #698

Merged

jodal merged 11 commits into

mainfrom

crawler-api-cleanups

Sep 4, 2026

Commits on Sep 4, 2026

fix: Let a missing image URL raise ImageURLNotFound in base crawlers
jodal
committed
cae1d68
refactor: Remove the unraisable DoesNotExist from LxmlParser
jodal
committed
3757726
refactor: Remove the unreachable _decode() from LxmlParser
jodal
committed
edf04fc
fix: Correct the return type of LxmlParser.text()
jodal
committed
a0c7fad
feat: Add first=True to the singular LxmlParser accessors
jodal
committed
263f100
feat: Add element()/elements() to LxmlParser
jodal
committed
19d17a8
feat: Declare the Entry fields crawlers actually use
jodal
committed
ecd8450
refactor: Parse the OOTS feed once per crawl
jodal
committed
52bb9b2
refactor: Drop the no-op history_length_days = 0
jodal
committed
05a28d0
refactor: Report a missing image as ImageURLNotFound once the entry is known
jodal
committed
0475839
fix: Raise on HTTP errors when parsing a page
jodal
committed
e1c8f66