首页 > seo优化知识 > 每个建站程序的Robots文件写法都一样吗?
2015
05-30

每个建站程序的Robots文件写法都一样吗?

每个建站程序的Robots文件写法都一样吗? - 第1张  | 枫叶树seo博客

robots.txt是搜索引擎蜘蛛访问我们网站时第一个要看的文件。这个文件是告诉蜘蛛在爬取我们网站时,哪些文件可以看,哪些文件不能看。如果我们网站上有些信息不想被搜索引擎蜘蛛爬取,这个时候我们就可以写一个robots.txt文件,告诉蜘蛛不要索引我们这个文件。

看完上面这段话,相信大家也可以知道robots.txt文件是干什么用的。但是我们当下有很多热门的建站程序,例如:wordpress、dedecms、phpcms、discuz等等,那么这些建站程序的robots.txt文件的写法都是一样的吗?答案肯定不是。今天我就给大家分享下这些热门建站程序的robots.txt文件该怎么写。

1.WordPress建站程序的robots.txt文件写法
User-agent: *
Disallow: /wp-admin
Disallow: /wp-content/plugins
Disallow: /wp-content/themes
Disallow: /wp-includes
Disallow: /?s=
Sitemap: http://www.***.com/sitemap.xml

2.DedeCMS建站程序的robots.txt文件写法
User-agent: *
Disallow: /plus/feedback_js.php
Disallow: /plus/feedback.php
Disallow: /plus/mytag_js.php
Disallow: /plus/rss.php
Disallow: /plus/search.php
Disallow: /plus/recommend.php
Disallow: /plus/stow.php
Disallow: /plus/count.php
Disallow: /include
Disallow: /templets
Disallow: /member

3.phpcms建站程序的robots.txt文件写法
User-agent: *
Disallow: /admin
Disallow: /data
Disallow: /templates
Disallow: /include
Disallow: /languages
Disallow: /api
Disallow: /fckeditor
Disallow: /install
Disallow: /count.php
Disallow: /comment
Disallow: /guestbook
Disallow: /announce
Disallow: /member
Disallow: /message
Disallow: /spider
Disallow: /yp
Disallow: /vote
Disallow: /video

4.discuz论坛建站程序的robots.txt文件写法
User-agent: *
Allow: /redirect.php
Allow: /viewthread.php
Allow: /forumdisplay.php
Disallow: /?
Disallow: /*.php

总结:以上就是当下4个热门建站程序的robots.txt文件写法。当然我这里并不是要大家在实际操作过程中也按照这个方法来写,因为这里都是我用经验总结出来的,其中有些协议大家可能都涉及不到,所以希望大家灵活的使用,不要太死板。


每个建站程序的Robots文件写法都一样吗?》有 7 条评论

  1. I’m also commenting to make you be aware of of the fantastic discovery my cousin’s princess had reading yuor web blog. She noticed plenty of pieces, which included what it is like to have an awesome helping spirit to have a number of people with ease know precisely some hard to do topics. You undoubtedly did more than her desires. Thank you for presenting those warm and helpful, dependable, educational and unique thoughts on your topic to Lizeth.

  2. nike roshe 说:

    I definitely wanted to post a simple remark in order to thank you for all the nice secrets you are giving out at this site. My considerable internet look up has finally been compensated with extremely good concept to share with my colleagues. I ‘d claim that we visitors are undeniably endowed to be in a fantastic place with many perfect people with useful methods. I feel rather privileged to have come across your entire web page and look forward to many more amazing minutes reading here. Thanks a lot once more for all the details.

  3. I simply needed to say thanks again. I’m not certain the things that I would have tried without the entire thoughts documented by you concerning my situation. It previously was an absolute alarming matter in my circumstances, but seeing this professional mode you handled that took me to leap for happiness. Now i’m thankful for this support and even hope that you comprehend what a powerful job your are doing training the mediocre ones using your site. More than likely you’ve never got to know any of us.

  4. My spouse and i were absolutely happy when Jordan could finish off his preliminary research with the ideas he received out of your web site. It’s not at all simplistic to just always be giving away instructions which often many others may have been making money from. And we all remember we have got you to give thanks to for that. The main explanations you made, the straightforward website navigation, the friendships you can make it possible to promote – it is all amazing, and it’s really helping our son in addition to our family know that that content is interesting, which is pretty pressing. Many thanks for all the pieces!

  5. curry 5 说:

    I simply had to appreciate you once more. I’m not certain what I would have followed in the absence of these creative ideas shown by you over such a theme. It had become an absolute frightful problem in my opinion, however , taking note of a specialised manner you processed the issue took me to leap with joy. I’m just grateful for this support and then hope you are aware of a powerful job you happen to be undertaking educating many others through the use of your website. I am certain you’ve never encountered any of us.

  6. jordan 4 说:

    I just wanted to send a note so as to express gratitude to you for those stunning steps you are giving at this website. My time-consuming internet research has finally been paid with incredibly good tips to share with my two friends. I would tell you that we site visitors are really blessed to exist in a remarkable website with many marvellous professionals with helpful things. I feel very much blessed to have seen your weblog and look forward to tons of more pleasurable times reading here. Thanks a lot once more for a lot of things.

  7. I want to show some thanks to this writer just for rescuing me from this particular instance. Just after looking through the world wide web and obtaining notions which are not powerful, I believed my entire life was gone. Existing without the presence of solutions to the problems you’ve fixed by means of your entire article is a critical case, as well as the kind which may have adversely damaged my entire career if I had not encountered your site. Your main expertise and kindness in dealing with all areas was excellent. I don’t know what I would have done if I had not come across such a solution like this. It’s possible to now look ahead to my future. Thanks for your time very much for your specialized and effective guide. I won’t be reluctant to refer your web blog to anyone who should receive support about this subject matter.

留下一个回复

你的email不会被公开。