mammu
04-26-2007, 02:02 PM
How to configure robots.txt and urllist.txt?
I tried to understand there explaination but found it too complicated.
I tried to understand there explaination but found it too complicated.
![]() |
Google webmaster toolsmammu 04-26-2007, 02:02 PM How to configure robots.txt and urllist.txt? I tried to understand there explaination but found it too complicated. rolfw 04-26-2007, 02:50 PM You only need to use robots.txt if there are areas of your site which you don't want crawled, do a google search for free sitemap generator and there are a couple which do it automatically for you. Peggy 04-26-2007, 03:01 PM do a google search for free sitemap generator and there are a couple which do it automatically for you. I use the vBSEO Google/Yahoo Sitemap Generator (http://www.vbulletin.org/forum/showthread.php?t=100435). It's free and works great. mammu 04-27-2007, 10:44 AM I get this error in web crawl section of google webmaster tools. http://www.mydomainname.com/function.require (http://www.mysite.com/function.require) 404 (Not found) What does it mean? Doc 04-27-2007, 11:44 AM I get this error in web crawl section of google webmaster tools. http://www.mydomainname.com/function.require (http://www.mysite.com/function.require) 404 (Not found) What does it mean? A 404 error means file not found, maybe you missed off a forward slash at the end of the address (/). However I also see the link on the page above is http://www.mydomainname.com/function.require but the url you are pointing to is http://www.mysite.com/function.require which do you mean? mammu 04-27-2007, 03:00 PM Dont know what that function.require is? you missed off a forward slash at the end of the address (/) Which address I should put this (/)? where? I just have these things in my robot.txt file... User-agent: * Disallow: Thats it. Where am I going wrong? mammu 04-28-2007, 12:13 AM I get this error: http://img243.imageshack.us/img243/6707/62172358we1.jpg http://img243.imageshack.us/img243/3190/29749174ka6.jpg Peggy 04-28-2007, 12:56 AM mammu, I'm sorry, but you really DO need to ask about this at either vbulletin.org or vbulletin.com. This forum is for support of my skins and graphics, not vBulletin in general. sushil 04-05-2008, 01:28 AM mammu, I'm sorry, but you really DO need to ask about this at either vbulletin.org or vbulletin.com. This forum is for support of my skins and graphics, not vBulletin in general. I think peggy is right you should need to ask this question on vbullentin.org or vebullentin.hope you will try it. Mike54 04-05-2008, 07:02 PM I think peggy is right you should need to ask this question on vbullentin.org or vebullentin.hope you will try it. Take a quick look at the dates of the thread. You're trying to punctuate comments that are nearly 50 weeks old. |