"An Efficient Scheme to Remove Crawler Traffic from the Internet"

As the web grows, the search gang (Google, Yahoo et al) need to crawl more and more. And probably, more often! So much so that crawlers become a major factor in most of the traffic to websites! (After all, more search engines would mean more crawlers.) Time to do away with the conventional crawlers? Or have just one crawler (as a service) with all the search gang using that crawler-system's services. Or, (this had to come!) invoke active networks!
An Efficient Scheme to Remove Crawler Traffic from the Internet