Skip to content

Commit

Permalink
# 增加 robots 文件,屏蔽搜索引擎收录
Browse files Browse the repository at this point in the history
  • Loading branch information
Toyo committed Aug 22, 2018
1 parent 24b1c83 commit 20a5cc4
Showing 1 changed file with 42 additions and 0 deletions.
42 changes: 42 additions & 0 deletions robots.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# robots.txt generated at http://tool.chinaz.com/robots/
User-agent: Baiduspider
Disallow: /
User-agent: Sosospider
Disallow: /
User-agent: sogou spider
Disallow: /
User-agent: YodaoBot
Disallow: /
User-agent: Googlebot
Disallow: /
User-agent: Bingbot
Disallow: /
User-agent: Slurp
Disallow: /
User-agent: Teoma
Disallow: /
User-agent: ia_archiver
Disallow: /
User-agent: twiceler
Disallow: /
User-agent: MSNBot
Disallow: /
User-agent: Scrubby
Disallow: /
User-agent: Robozilla
Disallow: /
User-agent: Gigabot
Disallow: /
User-agent: googlebot-image
Disallow: /
User-agent: googlebot-mobile
Disallow: /
User-agent: yahoo-mmcrawler
Disallow: /
User-agent: yahoo-blogs/v3.9
Disallow: /
User-agent: psbot
Disallow: /
Disallow: /ip/
Disallow: /qr/
Disallow: /

0 comments on commit 20a5cc4

Please sign in to comment.