Why bots don't come to me?

I submitted my site to yahoo, and google, ( free), and no bots ever came to me, why.

Give it time. They are more likely to find you through backlinks.

I get bots but not many members & have no idea why???

I signed up with google analytics and uploaded the small piece of code to my navbar template, getting crawled very regularly now, also look for free sitemap generators, upload a copy into your root directory and it should help to encourage bots. :)

I have google analytics, i just realised yesteday i didn't put the code in the right place, so i placed it in the footer template. At least i started seeing some data, but i don't see bots yet.

It takes up to 48 hours. :)

I think the yahoo spiders started coming, i am not sure though. It's always somebody else there besides me, and i know it can't be the real person, because they would be looking at the threads. Plus analytics shows that yahoo comes.

I signed up with google analytics and uploaded the small piece of code to my navbar template, getting crawled very regularly now, also look for free sitemap generators, upload a copy into your root directory and it should help to encourage bots. :)
would you give us a little discraption about that code you used?
thnx

I signed up with google analytics and uploaded the small piece of code to my navbar template, getting crawled very regularly now, also look for free sitemap generators, upload a copy into your root directory and it should help to encourage bots. :)


I haven't signed up with Google analytics yet. Could you please explain a bit about that that is and what it does, rolfw?


I downloaded vBSEO's free Google/Yahoo sitemap generator a few weeks ago, for both of my sites, and I'm seeing the yahoo slurpie much more often.

Sorry, duplicated, so deleted.

You need a google account, then you can use analytics, they give you a small piece of invisible code to put in your navbar template or similar and you can get an interesting graphic presentation of the visitors to your site or sites. I have three of my own and the satellite forum which I can monitor at a glance. :) But as with any of these things, it also means that Google are regularly crawling your site. :)

http://www.thamesvalleybirds.co.uk/googleanalytics.jpg
PS.I still have no quota on attachments Peggy, it makes me go through the process of uploading, then tells me I have exceeded my quota by X amount, which just happens to be the same size as the picture i am trying to upload.;)

Thank you for the explanation.

I'll check the permitted attachment size again

I have analytics, and i love it. How could i live without it before. I also go to dns sites and always check for spam ips. I didn't realize that one of my sites is listed on the first page of google, i couldn't beleive it. I knew i have pr1, i don't know what it means. Wow, i am thinking where all this people are coming from if i am not doing any advertising. Great.

Thnx rolfw (http://www.themesbydesign.net/forums/member.php?u=371) now Google Crawling my site. :) vbmenu_register("postmenu_1076", true);

I was always wondering why people like spiders, and what good do they bring. Now i know.:blush:

Gives you feeling you are not the only one on your site.

How do the yahoo or google spiders decide that they will come? I have 2 sites, one is visited only by yahoo, and another only by google spiders. Why?

I don't have a hack to know if i have visitors or spiders. But in my analitics, is there a way to tell?

Use this hack Julia, I have it installed and it works well. :)

http://www.vbulletin.org/forum/showthread.php?t=131314&highlight=spider+visits

http://www.thamesvalleybirds.co.uk/visitors.jpg

Rolf, I don't see it on your site, is it visible only to admin?

Yes Julia, the visibility is controlled by adding usergroup ids in the control panel.

I like that, but i have another question now. I was thinking to install a hack to display number of members that visited today just like Peggy has it. Is it the same hack Rolf, or different ?

What the whole topic about?

Couldn't get anything!

Peggy have you ever installed vb seo, i don't see it installed here. But i saw your post there.

julia, I had vBSEO installed on Top vBulletin. In 8 months, it did very little good for that site.
It's not installed here. I've had this site for 11 months, and have done nothing but good old fashioned SEO, installed the google/yahoo sitemap generator, utilizing tips I've picked up at vBFAQ, around the internet, and my own imagination ;)

THIS site has done far better than Top vB ever did, which is why I closed it, and merged it into this site, moving my online business over here.

I'll be selling the vBSEO license eventually.

I like that, but i have another question now. I was thinking to install a hack to display number of members that visited today just like Peggy has it. Is it the same hack Rolf, or different ?

julia, you'll find the hack you mentioned above, here -
Members who have visited today (or in the past 24 hours) (http://www.vbulletin.org/forum/showthread.php?t=121883)

julia, I had vBSEO installed on Top vBulletin. In 8 months, it did very little good for that site.
It's not installed here. I've had this site for 11 months, and have done nothing but good old fashioned SEO, installed the google/yahoo sitemap generator, utilizing tips I've picked up at vBFAQ, around the internet, and my own imagination ;)

THIS site has done far better than Top vB ever did, which is why I closed it, and merged it into this site, moving my online business over here.

I'll be selling the vBSEO license eventually.

Hey Peggy, when you're ready to sell, let me know please. :)

You betcha hun.

If anyone needs a few bots to visit their forum I will tell 'em to visit you :D the Yahoo spiders seem to like gathering at my forum, wonder if they got a party going on :eek: - below copy of visitors in last 24 hours

Visitors (110), Yahoo! Slurp Spiders (1345), Google Spiders (4), MSNBot Spiders (9)

I'd sure like to have more google spiders, that's for sure. But I'm ok with the slurpies too... TBD is indexed VERY well in yahoo for our keywords

Don't know why but the slurpy spiders are going mad on the board today (breeding?) I see you got more than a few on here too Peggy!

Currently Active Users (http://www.r3w.co.uk/forum/online.php): 1047 (41 members and 1006 guests)

think I need to initiate birth control lessons for spiders :rolleyes:

gawd yes. You shoulda seen it one day last week... had 640somethingoranother in a 24 hr period.

:faint:

I'd sure like to have more google spiders, that's for sure. But I'm ok with the slurpies too... TBD is indexed VERY well in yahoo for our keywords
Take a look at the stats on the spiders and see how much is being transferred.

I seem to have my own personal Goober spider, as there is always one there and the guest listing always shows 1 in the last 24 hours. But Goober is transferring a lot more than the Slurpies. And I've had a bit over 500 Slurpies a day for the last couple of weeks now.

That's the thing tho.... There always a Google bot here - yet for my keywords, I'm still on page 2 and 3! Still better than Top vB tho. Even with vBSEO, it was on pgs 3 and 4 for its keywords.

Amazing thing is tho... for being on pgs 2 and 3, we're getting alot of traffic from the search engines, AND the homepage is PR 4, forum is PR 3.

Interesting...

Thanks god, it didn't only happened to me. I am releived, there were 99 on mine all at the same time. I don't know what are they, I don't have that hack to find out. Uf, I feel better, I am not the only one. I wonder what's going on?

I have no idea what's going on, but I'm being told not to worry about it, so - don't worry about it! :)

I guess we should just be happy that they find our forums so darned attractive!

I guess we should just be happy that they find our forums so darned attractive!
Exactly! Remember the days (in my case, not so very long ago) when we were trying to find ways to attract the spiders?

uh huh I do - wasn't all that long ago for me here either :nope: