Status: IN
`RobotsParser.is_allowed` resolves conflicting allow/disallow rules by selecting the rule with the longest matching path prefix, falling back from agent-specific rules to `*`.
Source: entries/2026/06/05/web-crawler-web_crawler.md
JSON