Marco.org

(thanks metacordr). What an idiotic article. No. Crawling isn’t the hard part, and plenty of other search engines have figured that out. The hard part is filtering and ranking: given this massive amount of data, how do you give me useful results when I search for a word that appears in millions of pages? And if Wikia’s indexer is as good as the previous open-source search efforts (Lucene, etc.), nobody has anything to worry about.