web crawler

The Serci SearchEngine project will provide an open-source web search engine. It will consist out of a web crawler, an indexer with index tools and a query server. As the first component the Serci WebCrawler is published here. The Serci WebCrawler is written in C++ and was designed from the ground up for speed - after all, high crawling speed means faster throughput and a lower power consumption per fetched web page.