Forums >Behind the Scenes>Yahoos at Yahoo
rectumdamnnearkilledem
Perhaps this is why Google is so dominant in the search engine market. It doesn't download as frequently and as much as Yahoo, yet new forum posts on RA will appear on Google within a few hours, sometimes within a few minutes. The Google crawler reduces its crawl rate if the server is takes longer to return the requested page. Yahoo crawler does the exact opposite by increasing its crawl rate, thus making the problem worse.Other websites have reported similar problems for years. Given that Yahoo generates so little traffic while consuming so much resources, I am considering banning Yahoo from crawling RunningAHEAD.
I think I would, if it were my choice to make. I haven't used Yahoo for anything in years. But I've seen threads/posts appear in Google searches within hours of creation, as you pointed out (noticed this just recently when looking at info. re: ankle sprain recovery). Very cool.
Getting the wind knocked out of you is the only way to
remind your lungs how much they like the taste of air.
~ Sarah Kay
Given that Yahoo generates so little traffic while consuming so much resources, I am considering banning Yahoo from crawling RunningAHEAD.
I agree with Zoomy. I'd go ahead with banning Yahoo from crawling RA.
Don't make excuses for why you can't get it done.
Focus on all the reasons why you must make it happen.
A Saucy Wench
who uses yahoo for searches anyway? Ban the yahoos!
But I really do appreciate the explanation behind the scenes!
I have become Death, the destroyer of electronic gadgets
"When I got too tired to run anymore I just pretended I wasnt tired and kept running anyway" - dd, age 7
Anyway, that is my 2 cents.
Dennis
Good Bad & The Monkey
I'm running somewhere tomorrow. It's going to be beautiful. I can't wait.
Poor baby
Not on the search engines yet...
Now I have the "can you hear me now" commercial in my head.
Are you looking at the right place? Click
Your text string has been around longer than mine. Mine is still not there.
7 posts - 5 authors - Last post: 4 hours agowho uses yahoo for searches anyway? Ban the yahoos! But I really do appreciate the explanation behind the scenes! ...www.runningahead.com/.../f475caced4ce4266ae492ddeefb026b7 - 4 hours agoI created this forum from scratch (you may criticize my insanity some other time). There is no other forum like it, yet it is evident that Google figured out that it's a forum, and its format.