# Robots.txt for LanOnasis # https://lanonasis.com # Allow all robots User-agent: * Allow: / # Disallow admin or private areas (if any) # Disallow: /admin/ # Disallow: /api/ # Crawl-delay for respectful crawling Crawl-delay: 1 # Sitemap location Sitemap: https://docs.lanonasis.com/sitemap.xml # Allow social media crawlers for better social sharing User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / # Block bad bots (optional) User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Crawl-delay: 10