Browse Source
添加AhrefsBot和MJ12bot的爬虫禁止访问网站
1 changed files with 4 additions and 0 deletions
+ 4
- 0
robots.txt
|
|||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||
|
|
||