Item — HN Reader

right now the biggest cost is llm api calls (currently claude haiku) for organising content and making it easily searchable - this is relatively cheap (max 50$ per month). I use pinecone for search which so far has been very inexpensive, though admittedly traffic has been low, so I'll see how that goes.

on feeds - I've built a list over a number of years, a mix of tracking blogs on twitter, hacker news and a few other places. usually the feed url can be lifted quite easily from a blog's header.

1 comments

Ugh, let me rephrase the question then, is this 34,000 blogs as in websites, or blogs as in posts? I assumed the former, but sounds like I might have been wrong since building a list of 34k niche websites would be next to impossible.

I am guessing you have added everything from here:

https://news.ycombinator.com/item?id=36575081

and the subsequent site that offers the OPML for those blogs:

https://dm.hn/

Yes, it's 34k websites, but to be transparent, they probably don't all strictly qualify as niche, for example, it includes some smaller commercial sites (usually if they have tech blogs). I've found the hardest part of this isn't finding the feeds so much as filtering out the usual suspects (SEO etc) that masquerade as technical content.

As well as HN, I found a google search along the lines of "site:github.com opml rss feed [topic]" was quite effective too.