All projects

StreamWorks Search Engine

A Google-esque distributed search engine spanning crawl, index, rank and serve.

May 2022 Software
CodePDF
Results of searching for
Results of searching for "machine learning" in debug mode.

StreamWorks is a full distributed search engine, from web crawl to ranked retrieval behind a minimal UI.

  • Built around four key components: crawler, indexer, ranker and frontend server.
  • Crawled and efficiently indexed a corpus of 500k URLs.
  • Applied sound ranking algorithms with a minimalist UI to demonstrate the engine.
C++Information RetrievalDistributed Systems
BackAll projects