Robots.txt Control

Production robots control for BestMatchLive.Ph. Public football pages are open to search engines and AI retrieval agents, while admin, config, data and private files stay protected. AI training bots remain blocked.

Search IndexingAllowed

AI RetrievalAllowed

AI TrainingBlocked

Admin / SystemProtected

Production Robots File

Use this as the official root /robots.txt. The current package already includes this version.

# BestMatchLive.Ph robots.txt

# FIFA World Cup 2026 Live Scores, Fixtures, News, Predictions & Standings
# Search indexing and AI retrieval are permitted.
# AI model training is not permitted.

User-agent: *
Allow: /

# Protected system areas
Disallow: /admin/
Disallow: /admin-embed-manager/
Disallow: /config/
Disallow: /data/
Disallow: /embed-manager/

# Sensitive files
Disallow: /.user.ini
Disallow: /.htaccess
Disallow: /README
Disallow: /README-*
Disallow: /VERSION*
Disallow: /LINK-*

# ==========================================
# SEARCH ENGINES
# ==========================================

User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: Slurp
Allow: /

User-agent: DuckDuckBot
Allow: /

User-agent: Applebot
Allow: /

User-agent: YandexBot
Allow: /

User-agent: Baiduspider
Allow: /

User-agent: SeznamBot
Allow: /

User-agent: PetalBot
Allow: /

# ==========================================
# AI SEARCH / RETRIEVAL AGENTS
# ==========================================

User-agent: ChatGPT-User
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Perplexity-User
Allow: /

User-agent: Meta-ExternalAgent
Allow: /

User-agent: FacebookBot
Allow: /

User-agent: Applebot-Extended
Allow: /

User-agent: Amazonbot
Allow: /

User-agent: DuckAssistBot
Allow: /

User-agent: PhindBot
Allow: /

User-agent: AndiBot
Allow: /

User-agent: Bravebot
Allow: /

User-agent: Diffbot
Allow: /

User-agent: Cohere-ai
Allow: /

# ==========================================
# AI TRAINING AGENTS BLOCKED
# ==========================================

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Bytespider
Disallow: /

# ==========================================
# SITEMAPS
# ==========================================

Sitemap: https://bestmatchlive.ph/sitemap.xml
Sitemap: https://bestmatchlive.ph/sitemap.html

# ==========================================
# LLM DISCOVERY
# ==========================================

# LLM discovery file:
# https://bestmatchlive.ph/llms.txt

# ==========================================
# HOST
# ==========================================

Host: bestmatchlive.ph

Open Sitemap XML Open llms.txt

Hosting note: upload this file to the domain root as /robots.txt. Keep /admin/, /config/, and /data/ blocked from crawlers.