IPFS Scanner Post 3

I found why the scanner was only producing two pages: HTTP 301 Redirect.

If you look at the Release Notes for v0.5.0 of IPFS, you will find a section labeled Subdomain Gateway that details a feature where the HTTP gateway will generate a redirect to a subdomain when accessing /ipfs/$HASH and /ipns/$HASH using localhost, but not when using 127.0.0.1. My code was checking for a status code of 202 and treating everything else as a failure. Change the domain from ’localhost’ to ‘127.0.0.1’ and it started handling fetched pages correct.

Well, mostly. It looks like I’ve got HTML bleeding thru into the description field. And it isn’t declaring as UTF-8 encoding correctly. Just a couple more items for the ToDo list…