User-agent: * # Private/auth pages Disallow: /login Disallow: /profile Disallow: /messages Disallow: /favorites Disallow: /blocked-users Disallow: /admin Disallow: /settings Disallow: /notifications # City/category hub pages are now handled via # in the SPA (see src/App.js route handler). We let Googlebot crawl them so it # can read the noindex tag and drop them from the index cleanly. Previously these # were Disallowed, which trapped 76 already-indexed pages as "duplicate" because # Google couldn't re-crawl to see the noindex. Removed 2026-04-13. # Allow crawlable pages with unique content Allow: / Allow: /browse Allow: /discover Allow: /buy/ Allow: /listings/ Allow: /hire/ Allow: /wanted/ Allow: /llms.txt Sitemap: https://bids44.com/sitemap.xml