I’ve added several new blogs to lekythion’s search feature, including:
trinque.org
loper-os.org
thimbron.com
ossasepia.com
fixpoint.welshcomputing.com
billymg.com
ztkfg.com
qntra.net
I intend to add more as I have time. I am also open to suggestions for additional sites and blogs to index.
The crawler still needs some tuning for many of the sites listed above. For example there are still instances where the bot will return multiple identical results for a search term due to different urls displaying the same content.
Also ranking is still very basic and doesn’t incorporate anything like pagerank, although it can search using l-distance.
In addition to adding the encyclopedia (work on which is underway), I’m considering adding Bitcoin transaction search. I wrote my own app for such purposes last year and have found it occasionally useful. I don’t know how much demand there is for publicly tracking transactions, but it wouldn’t be a big deal to set something up and try it out.
In terms of infrastructure, the bot is now running on its own vps. The next step is automatic index updates.