IPFS Scanner Post 1

I have started working on an IPFS scanner/indexer. The basic premise is to attempt to resolve the IPNS name of every connected peer, then download the index.html for each of the names that resolve, and create a page that provides a list of page titles and a simple description similar to a search engine results page.

Right now, the scanner is working reasonably well. I have found about 150 names that can be resolved from my node. The problem right now is the index creation. It’s crashing with an IndexError. Both the scanner and the index creation are written in crystal, a compiled language with a distinctly Ruby flavor to it.

When I get an index created successfully, I’ll throw it up on IPFS and link to it from here.