# 本站爬虫协议 # LightBot 遵守 robots.txt 标准(https://www.robotstxt.org/robotstxt.html) User-agent: * Allow: / Crawl-delay: 2 # 不抓取后台与私有路径 Disallow: /admin/ Disallow: /includes/ Disallow: /bin/ Disallow: /sql/ Disallow: /deploy/ Disallow: /install.php Sitemap: /sitemap.php