Yes, I am talking about Cuil. I still find it amazing that cuil got as much publicity starting out. I just found an interesting piece on Techcrunch and would like to share it here as well. Techcrunch received an email from an angry cuil user and this is what it said,
I don’t know what spawned it, but when Cuil attempts to index a site, it does so by completely hammering it with traffic. So much, that it completely brings the site down. We’re 24 hours into this “index” of the site, and I’ve had to restrict traffic to the site down to 2 packets per second, while discarding the rest, or otherwise it makes the site unusable.
Cuil really needs to figure out a way to run their search engine in a more professional and scientific way before they earn more negative publicity.
This is what Cuil’s Operational Engineer had to say regarding this issue,
Twiceler is an experimental crawler that we are developing for our new search engine. It is important to us that it obey robots.txt, and that it not crawl sites that do not wish to be crawled. If you wish I will glad to add your site to our list of sites to exclude, but I need you to tell the site name to block as email return addresses frequently from the domains that wish to be blocked.
Cuil has got to do a better job or it is soon going to be out of business. 33 million dollars in funding and out of business in a year…imagine that. That would hurt big time.
[ source : Techcrunch ]
