Our robots.txt Rules Explained
A transparent breakdown of every page we allow and block from search engine crawlers. Built for Google, Bing, and the open web.
Why This Page Exists
The robots.txt file tells search engine crawlers which parts of a website they can and cannot visit. At RideCarpooling, we believe in radical transparency — so we built this page to explain exactly what we allow, what we block, and why.
1 second
Crawl Delay
Respectful rate limiting for all bots
40+ blocked
Private Pages
Auth-required pages never indexed
80+ allowed
Public Pages
All marketing, content & city pages
Current robots.txt
User-agent: * Crawl-delay: 1 # PRIVATE — Do Not Crawl Disallow: /login Disallow: /dashboard Disallow: /my-* Disallow: /profile Disallow: /driver-dashboard Disallow: /driver-earnings Disallow: /messages Disallow: /admin* Disallow: /system-status Disallow: /fleet-management Disallow: /passenger-dashboard Disallow: /corporate-dashboard Disallow: /analytics Disallow: /track/* Disallow: /driver-tracking/* # PUBLIC — Crawl Freely Allow: / Allow: /find-ride Allow: /post-ride Allow: /blog Allow: /popular-routes Allow: /canada Allow: /usa Allow: /mexico Allow: /city/* Allow: /route/* Allow: /about Allow: /careers Allow: /press Allow: /safety-center Allow: /privacy-policy Allow: /terms-and-conditions Sitemap: https://ridecarpooling.com/sitemap.xml Sitemap: https://ridecarpooling.com/sitemap-dynamic.xml
Rule Breakdown by Category
Every Allow and Disallow directive, organized by what the pages do.
Core Booking & Search
Pages that help users find and book rides. These are our highest-priority pages for search engines.
/Homepage — updated daily with live rides
/find-rideMain ride search — updated hourly
/post-rideDriver ride posting form
/request-ridePassenger ride request form
/quick-bookExpress booking flow
Content & Discovery
Blog, routes, reviews, and other content-rich pages that attract organic search traffic.
/blogBlog listing + all /blog/:slug articles
/popular-routesMost-searched route directory
/reviewsPublic ride reviews — updated daily
/storiesPassenger & driver story testimonials
/leaderboardTop driver rankings
/incentive-leaderboardDriver incentive standings
/badge-leaderboardCommunity badge rankings
Country & City Landing Pages
Location-specific SEO landing pages for Canada, USA, Mexico and major cities.
/canadaCanada carpooling hub
/usaUSA carpooling hub
/mexicoMexico carpooling hub
/city/*All city pages (Toronto, Montreal, Vancouver, etc.)
/route/*All route landing pages (e.g. /route/toronto-to-montreal)
/regionsRegion directory
Safety, Legal & Trust
Pages that establish trust and comply with legal requirements across all three countries.
/safety-centerSafety features & protocols
/privacy-policyPrivacy Policy (PIPEDA / CCPA / LGPD compliant)
/terms-and-conditionsTerms of Service
/service-agreementService Agreement between users
/community-guidelinesCommunity conduct rules
/trust-guaranteePassenger protection policy
/data-deletionGDPR / PIPEDA data deletion request
/verify-memberPublic member verification lookup
Company & Media
Information about RideCarpooling as a company, plus press resources and careers.
/aboutOur story, mission & founding team
/careersOpen positions & benefits
/pressPress releases, media kit, investor relations
/partnersPartner & API information
/sustainabilityEnvironmental impact & carbon tracking
/contactGeneral contact & support
/helpHelp center & FAQ
/supportSupport ticket system
Private — Do Not Crawl
Authenticated pages, dashboards, admin panels, and personal data. Search engines should never index these.
/loginAuthentication page
/dashboardUser dashboard (requires login)
/my-*All /my-rides, /my-reviews, /my-requests, /my-incentives, etc.
/profileUser profile editor
/driver-dashboardDriver dashboard (requires login)
/driver-earningsEarnings page (requires login)
/messagesPrivate messaging (requires login)
/admin*All admin pages (/admin, /admin-login, /admin-setup, etc.)
/system-statusInternal health monitoring dashboard
/fleet-managementFleet admin dashboard
/passenger-dashboardPassenger analytics dashboard
/corporate-dashboardCorporate admin dashboard
/analyticsInternal analytics dashboard
/track/*Live GPS tracking pages
/driver-tracking/*Driver location tracking
Sitemap Sources
We maintain two sitemaps so search engines always have a complete view of our public pages.
https://ridecarpooling.com/sitemap.xmlHand-curated sitemap with all static marketing and content pages
https://ridecarpooling.com/sitemap-dynamic.xmlAuto-generated from live ride and driver data via Supabase Edge Function
For Webmasters & SEO Professionals
If you are verifying our crawling policy or auditing our SEO setup, here are the key details.
User-Agent
* (all bots)
Rules apply to all crawlers equally
Crawl-Delay
1 second
Prevents server overload from aggressive bots
Sitemap Format
XML Sitemap 0.9
Standard protocol supported by all engines
Last Updated
2026-05-06
Synced after every new page deployment
Indexing Strategy
Content-first
Blog, city & route pages prioritized over tools
Multilingual
en / fr / es
Same URLs serve all languages client-side
Frequently Asked Questions
Why do you block so many pages?
Pages that require login contain personal data — booking history, earnings, messages, and admin tools. Blocking them protects user privacy and prevents private URLs from appearing in search results.
Can I use your sitemap for research?
Yes. Both sitemaps are public and updated regularly. The static sitemap lists all marketing pages; the dynamic sitemap includes live ride listings and verified driver profiles.
How often is robots.txt updated?
We update robots.txt every time a new public page is added to the router. The sitemap edge functions refresh daily via cron jobs to include new rides and drivers.
What about dynamic ride pages?
Individual ride detail pages (/ride/:id) and driver profiles (/driver/:id) are included in the dynamic sitemap but only while the ride is active and the driver is verified. Expired rides drop out automatically.