Skip to content

Fix robots.txt parser for stacked user-agent groups (RFC 9309) - #6

Open
federicobartoli wants to merge 2 commits into
addyosmani:mainfrom
federicobartoli:fix/robots-txt-multi-agent-groups
Open

Fix robots.txt parser for stacked user-agent groups (RFC 9309)#6
federicobartoli wants to merge 2 commits into
addyosmani:mainfrom
federicobartoli:fix/robots-txt-multi-agent-groups

Recognize path-specific Allow rules as explicit allowances

bddf6cb
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs