for work  i search same open web crowler or site searcher:

http://www.openwebspider.org/

 http://lucene.apache.org/nutch/
 http://www.soft-land.org/articoli/search
 http://www.mnogosearch.org/

Advertisements