crawler Web crawler for parsing and indexing webpages An example of what the index looks like (powered by Nginx):