Status: IN
Every URL is added to the Bloom filter before being pushed into the frontier, so the frontier never enqueues a URL that has already been seen (modulo false positives, which cause URLs to be permanently skipped).
Source: entries/2026/06/05/web-crawler-web_crawler.md