Themes By Design

Yahoo! Slurp (8), MSNBot (3), Google (3), Giga Blast

blackss
09-14-2008, 10:12 AM
i no for a fact this is in the wrong place but couldnt find where to post it sorry:(

i was wondering how themesbydesign.net is displying other spiders like Giga Blast etc?
is this a mod at vborg? or

thanks

Chris
09-14-2008, 11:28 AM
Yes this is a hack from vb.org. I do believe this hack is in the modification graveyard though and is not available for download right now.

blackss
09-14-2008, 08:09 PM
ahhh nuts lol, thanks chris ;)

Peggy
09-14-2008, 08:11 PM
There's another one - http://www.vbulletin.org/forum/showthread.php?t=184172&highlight=spiders
not nearly as good tho.

blackss
09-14-2008, 08:20 PM
thanks Peggy (http://www.themesbydesign.net/forums/member.php?u=1) i do have that hack installed but it does not show any other bots apart from googe msn and yahoo.

Peggy
09-14-2008, 08:24 PM
ah I don't know then, sorry. I thought it was supposed to show them all.

blackss
09-14-2008, 08:32 PM
mmm maybe it does but maybe a Giga Blast has yet to find my site.
thx

Peggy
09-15-2008, 11:48 PM
Nope, Dana I don't know. I still use Boofo's and have had no problem whatsoever.

Peggy
09-16-2008, 12:00 AM
I can only ask Boofo if he would release it here, as so many are asking for it.

blackss
09-16-2008, 09:51 PM
That would be great! I check weekly on the org for a newer version of the one I have, and am sorry I passed on his when I saw it the first time.

yeah same here.

i'd love to see what other spiders are lurking my site ;)

Peggy
09-16-2008, 09:55 PM
I'll try to get ahold of him and see what he says.

blackss
09-16-2008, 10:20 PM
I'll try to get ahold of him and see what he says.

thanks, this would be great ;)

Peggy
09-16-2008, 10:39 PM
OK... I've talked to Boofo and he's thinking about releasing the spider display mod here.
I bet a few donations would seal the deal. :yes:

Peggy
09-16-2008, 10:45 PM
Nope he has not re-released the mod anywhere else. It will be released here exclusively.

blackss
09-16-2008, 10:57 PM
OK... I've talked to Boofo and he's thinking about releasing the spider display mod here.
I bet a few donations would seal the deal. :yes:

its a deal :coffee:

Peggy
09-16-2008, 11:08 PM
oh, lol here. I'll get him to add a donation button to the release post when he posts it.

blackss
09-16-2008, 11:13 PM
oh, lol here. I'll get him to add a donation button to the release post when he posts it.

sounds good thanks ;)

Peggy
09-17-2008, 05:05 PM
Ok, anyone who is interested in obtaining Boofo's spider display mod can PM him here at Themes by Design.

PM Boofo (http://www.themesbydesign.net/forums/private.php?do=newpm&u=2715)

Peggy
09-19-2008, 09:43 AM
hmmm that's odd. You should contact Boofo, Dana, as mine works fine.

Boofo
09-19-2008, 01:33 PM
You are checking that by resolving the IP, right? That is not how vbulletin detects spiders. It detects them from the User Agent string. If the UA string does not contain any spider information, then it is recognized as a Guest, no matter what the resolved IP says. This is something we have been trying to get the developers to change for quite a while now, and so far, as with most requests, they have chosen to ignore it.

Make sure to keep the spiders XML file updated as new spiders are being added all the time. The package I sent you has the latest version in it as of now. Also, I could have added a check for spiders in the resolved IP but your server load would skyrocketed if you had more than a few spider/users/guests on at the same time.

Peggy
09-19-2008, 02:24 PM
I don't remember if this was just an xml to import? or were there any settings to mess with?

Boofo
09-19-2008, 02:38 PM
I don't remember if this was just an xml to import? or were there any settings to mess with?

I was referring to the spiders_vbulletin.xml file in the includes/xml directory.

Peggy
09-19-2008, 03:07 PM
I understand that.

I was referring to this -
...
Make sure to keep the spiders XML file updated as new spiders are being added all the time. The package I sent you has the latest version in it as of now. Also, I could have added a check for spiders in the resolved IP but your server load would skyrocketed if you had more than a few spider/users/guests on at the same time.

Boofo
09-19-2008, 03:29 PM
Yes, that is what I meant in that statement.

Peggy
09-21-2008, 10:54 AM
Yes it is, I agree. :yes:

ArnyVee
10-15-2008, 12:11 PM
Here's the one that I use....

http://www.vbulletin.org/forum/showthread.php?t=167278

....and, I just update the spider display file by going here....

http://spiderlist.codeforgers.com/

....hope that helps! :D

Here are my spiders for the last 24 hours....

The most guests online over 24 hours was 1,189, 09-18-2008 at 06:20 AM.
Visitors (572) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Visitors), Giga Blast Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Giga%20Blast), MSNBot Spiders (4) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=MSNBot), Yahoo! Slurp Spiders (22) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yahoo%21%20Slurp), Yahoo! FeedSeeker Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yahoo%21%20FeedSeeker), Radian6 FeedFetcher Spiders (8) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Radian6%20FeedFetcher), Ask.com Spiders (3) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Ask.com), Yeti Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yeti), Google Spiders (14) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google), ScoutJet Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=ScoutJet), Windows RSS Platform 1.0 Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Windows%20RSS%20Platform%201.0), Magpie Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Magpie), Windows RSS Platform 2.0 Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Windows%20RSS%20Platform%202.0), Google AdSense Spiders (3) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google%20AdSense), Deepnet Explorer Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Deepnet%20Explorer), Alexa Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Alexa), Radian6 Comment Reader Spiders (5) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Radian6%20Comment%20Reader), vBSEO Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=vBSEO), Google FeedFetcher Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google%20FeedFetcher), CJ Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=CJ), Twiceler Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Twiceler)

....picks up lots of spiders! :D

Peggy
10-15-2008, 01:16 PM
....and, I just update the spider display file by going here....

http://spiderlist.codeforgers.com/

I didn't know about that. Thanks for sharing.

ArnyVee
10-15-2008, 01:27 PM
I didn't know about that. Thanks for sharing.

No problem Peggy :D

This latest file has 476 spiders defined. So, it gives you a better idea of what/who is crawling your site.

Peggy
10-15-2008, 01:50 PM
WOW. :eek: To be honest, I didn't know there were that many spiders.

Boofo
10-15-2008, 02:21 PM
Here's the one that I use....

http://www.vbulletin.org/forum/showthread.php?t=167278 (http://www.vbulletin.org/forum/showthread.php?t=167278)

....and, I just update the spider display file by going here....

http://spiderlist.codeforgers.com/ (http://spiderlist.codeforgers.com/)

....hope that helps! :D

Here are my spiders for the last 24 hours....

The most guests online over 24 hours was 1,189, 09-18-2008 at 06:20 AM.
Visitors (572) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Visitors), Giga Blast Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Giga%20Blast), MSNBot Spiders (4) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=MSNBot), Yahoo! Slurp Spiders (22) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yahoo%21%20Slurp), Yahoo! FeedSeeker Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yahoo%21%20FeedSeeker), Radian6 FeedFetcher Spiders (8) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Radian6%20FeedFetcher), Ask.com Spiders (3) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Ask.com), Yeti Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Yeti), Google Spiders (14) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google), ScoutJet Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=ScoutJet), Windows RSS Platform 1.0 Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Windows%20RSS%20Platform%201.0), Magpie Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Magpie), Windows RSS Platform 2.0 Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Windows%20RSS%20Platform%202.0), Google AdSense Spiders (3) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google%20AdSense), Deepnet Explorer Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Deepnet%20Explorer), Alexa Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Alexa), Radian6 Comment Reader Spiders (5) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Radian6%20Comment%20Reader), vBSEO Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=vBSEO), Google FeedFetcher Spiders (2) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Google%20FeedFetcher), CJ Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=CJ), Twiceler Spiders (1) (http://www.waltdisneyboards.com/misc.php?do=guestlist&type=Twiceler)

....picks up lots of spiders! :D

That hack is not the same thing. It does not show in the Currently Active Users area. I use that also but have the results hidden from anyone but staff as it does add some load to the server. The XML file is included in the Spider Display hack.

ArnyVee
10-15-2008, 02:24 PM
This file gets updated every couple of weeks. And, there are anywhere from 5 to 10 new spiders every update.

ArnyVee
10-15-2008, 02:25 PM
Boofo, your mod shows them in the current active users?

I think that I added yours a long time ago but did not keep track of it and lost it during one of my upgrades if I recall.

Do you have a link to yours?

Boofo
10-15-2008, 02:34 PM
This file gets updated every couple of weeks. And, there are anywhere from 5 to 10 new spiders every update.

It gets updated as new spiders are reported, not necessarily at any certain time. Also, there are times I have seen only 1 or 2 spiders added. It all depends on how many get reported that are legitimate spiders.

Boofo
10-21-2008, 07:00 AM
Boofo, your mod shows them in the current active users?

I think that I added yours a long time ago but did not keep track of it and lost it during one of my upgrades if I recall.

Do you have a link to yours?

The one Peggy uses here is the one I released. There is no way you could have lost it during an upgrade. Sounds like you never had it installed.

ArnyVee
10-21-2008, 10:48 PM
Funny that you said that....I just checked and noticed that I found lots of spiders showing in there. So, I guess that I installed it way back when. :D

Boofo
10-21-2008, 10:58 PM
Funny that you said that....I just checked and noticed that I found lots of spiders showing in there. So, I guess that I installed it way back when. :D

Are you sure it isn't the file edit one that Amy did a long time ago? I did the product and have revamped it since I took it down from the org.

henlyn
10-24-2008, 03:56 PM
OK OK whats these spiders you're all talking about,:eek: I'm new to all this but love learning.
Lynn

Peggy
10-24-2008, 05:06 PM
Lynn, if you look on my main forum page, in the What's Going On box, you'll see a section with hundreds of spiders. These are search engine spiders, that search engines send out to crawl a website and index it in their search engines. Some of them are rss feed spiders that crawl your rss feeds and index them. If you have rss feeds enabled on your forum, you probably have the spiders on your forum and don't even know it, because vBulletin isn't coded to show all spiders in the what's going on box.

Boofo has coded a hack that does this, and it's available from Boofo, for a donation. Just send him a pm and he'll give you his paypal addy if you're interested in installing the hack.

Personally, I like knowing what is crawling my forum.

ArnyVee
11-01-2008, 11:54 PM
Are you sure it isn't the file edit one that Amy did a long time ago? I did the product and have revamped it since I took it down from the org.

Not sure which one it is, but I had your old one on vB.org marked as installed. So, I'm assuming it was that one.

I haven't added the code to my new 'test' board, but I'll try and see if it works. If not, then expect a little donation from Camp ArnyVee ;)

blackss
11-06-2008, 10:17 PM
i hope no one is paying for this as its at vbulletin.org for free.

you just download the mod, spider display online.
then goto vbulletin.com copy all the spiders codes, add the codes to your forum/includes/xml >> spiders_vbulletin.xml file.

Peggy
11-06-2008, 10:28 PM
This mod is not at vB for free. This is the original Display Spiders mod, the one at vB is a copy. This mod is better than the one at vB, and you don't have to copy and paste anything. Simply install it.

I have it working on all of my forums.

blackss
11-06-2008, 10:54 PM
This mod is not at vB for free. This is the original Display Spiders mod, the one at vB is a copy. This mod is better than the one at vB, and you don't have to copy and paste anything. Simply install it.

I have it working on all of my forums.

sorry but i also have one running on my site.
honestly,

you just upload the product product-spider_display.xml (http://www.themesbydesign.net/forums/attachment.php?attachmentid=521&stc=1&d=1226029878) to your forum admincp...
then upload spiders_vbulletin.xml (http://www.themesbydesign.net/forums/attachment.php?attachmentid=522&stc=1&d=1226029878) to your forum/includes/xml folder and over right.
it has all the most updated new spiders.

i added a screen shot.

Peggy
11-07-2008, 12:15 AM
I believe you, lol. There are two of them. The one posted by Boofo is the original. The other, posted by Atakan, is a copy, doesn't work for most people (judging from the support threads on .org), and isn't being supported at all.

BTW, I removed the xml's because I'm pretty sure that distributing a coders mod is against his TOS.