Grub - data flowing

Need Money? Join Lending Club!

I have the Grub client on one of my machines and it has been querying the Grub server for almost a week for packets of URLs to crawl. Well, suddenly this evening around 9:30 EST the Grub client came to life and began crawling. It crawls the URLs and delivers the results back to the main site, but those URLs are not being reflected on the Grub web site. I can’t remember if the old site was updated in real-time, hourly or daily. Given enough people dedicating computing time in the off hours - Grub could help the next Google competitor get some traction.

Comments are closed.