at path：
ROOT
/
apps
/
anti
/
bots.dat
run：
R
W
Run
.htaccess
0 By
2016-03-28 14:52:48
R
W
Run
Delete
Rename
about.php
0 By
2016-05-13 14:52:48
R
W
Run
Delete
Rename
about.php7
0 By
2017-07-29 14:52:48
R
W
Run
Delete
Rename
alfa-rex.PHP
0 By
2026-09-16 14:52:48
R
W
Run
Delete
Rename
alfa-rex.PhP7
0 By
2026-09-17 11:40:02
R
W
Run
Delete
Rename
alfa-rex.php56
0 By
2026-09-17 11:40:01
R
W
Run
Delete
Rename
alfa-rex.php8
0 By
2026-09-17 11:40:00
R
W
Run
Delete
Rename
anti-bot.php
0 By
2026-09-17 11:40:02
R
W
Run
Delete
Rename
bots.dat
2.03 KB
2026-07-18 22:18:47
R
W
Run
Delete
Rename
index.php
0 By
2026-09-16 14:52:48
R
W
Run
Delete
Rename
robots_patterns.dat
949 By
2026-07-18 22:18:47
R
W
Run
Delete
Rename
search_engines.dat
1.42 KB
2026-07-18 22:18:47
R
W
Run
Delete
Rename
vpn_providers.dat
676 By
2026-07-18 22:18:47
R
W
Run
Delete
Rename
wp-login.php
0 By
2026-09-17 11:40:02
R
W
Run
Delete
Rename
error_log
up
📄
bots.dat
Save
# Known Bot and Crawler User-Agents # Format: pattern (case-insensitive matching) # Last updated: 2026-03-23 # ===== SEARCH ENGINE BOTS ===== Googlebot Bingbot Slurp DuckDuckBot Baiduspider YandexBot Sogou Exabot Facebot ia_archiver AhrefsBot SemrushBot MJ12bot DotBot Rogerbot Blexbot MarkWatch Pixnetbot Heritrix PaperLiBot SeznamBot SeekportBot Screaming Frog SISTRIX MegaIndex LinkpadBot BacklinkCrawler SemanticScholarBot SciSpaceBot arXiv CORE ScienceGate IACR # ===== SEO TOOLS ===== ahrefs semrush # "moz" alone matches "Mozilla" in every browser — use specific Moz product strings if needed Mozscape majestic cognitiveseo serpstat ranktracker spyfu brightedge conductor searchmetrics # ===== SOCIAL MEDIA BOTS ===== FacebookExternalHit facebookexternalhit Twitterbot LinkedInBot Pinterest WhatsApp TelegramBot VKShare Odnoklassniki WeChat # ===== CONTENT SCRAPERS ===== Scrapy curl wget HTTPClient Java/ Python-urllib Python-requests python-httpx Go-http-client Ruby Perl PHP/ libwww-perl WWW-Mechanize Nikto Nmap sqlmap WPScan Nuclei dirbuster gobuster ffuf masscan ZmEu Masscan Shodan Censys # ===== HEADLESS BROWSERS ===== HeadlessChrome PhantomJS Selenium Puppeteer Playwright WebDriver chrome-headless firefox-headless # ===== MONITORING & UPTIME ===== UptimeRobot Pingdom StatusCake Site24x7 Uptrends Catchpoint NewRelic Datadog AppDynamics Dynatrace # ===== AI TRAINING BOTS ===== GPTBot ChatGPT-User ClaudeBot Claude-Web PerplexityBot YouBot Omgilibot Timpibot TurnitinBot Copyleaks PlagiarismCheck Grammarly # ===== ARCHIVE BOTS ===== archive.org_bot WaybackMachine Archive-It MauiBot heritrix nationalarchives # ===== SECURITY SCANNERS ===== Acunetix Nessus OpenVAS Burp ZAP Qualys Rapid7 Tenable Fortinet PaloAlto # ===== GENERIC BOT PATTERNS ===== bot crawler spider scraper crawl harvest extract miner scan sniff checker validator monitor watcher tracker grabber ripper leech