# Ana arama motoru botları User-agent: Googlebot Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: Bingbot Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: Yandex Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: YandexBot Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: YandexAdditionalBot Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: YandexGPTBot Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: YandexVertis Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* User-agent: YandexVerticals Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* # SEO/analitik botları - sınırlı erişim User-agent: AhrefsBot Disallow: / Allow: /blog/ User-agent: SemrushBot Disallow: / Allow: /blog/ User-agent: MJ12bot Disallow: / # Agresif botları tamamen engelle User-agent: PetalBot Disallow: / User-agent: baiduspider Disallow: / # Scraper botları User-agent: SeznamBot Disallow: / User-agent: DotBot Disallow: / # Sosyal medya botları - ana sayfa izni User-agent: facebookexternalhit Allow: / Disallow: /ajax/ Disallow: /check_rate_limit User-agent: Twitterbot Allow: / Disallow: /ajax/ Disallow: /check_rate_limit # Diğer tüm botlar User-agent: * Allow: / Allow: /blog/ Allow: /p/ Disallow: /check_rate_limit Disallow: /ajax/ Disallow: /og/istek* Disallow: /*?* Disallow: /insta/* Disallow: /reel/* Disallow: /ig/* # Crawl delay (saniye) Crawl-delay: 1 # Sitemap Sitemap: https://www.storieswatch.com/og/sitemap-article-0.xml