I agree. The problem I have is that I hate clicking load more on nitter. And the awful web.archive.org UX. And search results pages. And paywalls. And all the things.
So the idea is to programmatically extract all the links, images, dysfunctional paywall shit, videos, feeds... everything. And leech it. Then have an algo index it. Then NLP. And then finally anchor everything towards everything.
Then we can Sherlock everything. Find a new lead? Scrape the hell out of it and everything it links to and archive it all
I agree. The problem I have is that I hate clicking
load moreon nitter. And the awful web.archive.org UX. And search results pages. And paywalls. And all the things.So the idea is to programmatically extract all the links, images, dysfunctional paywall shit, videos, feeds... everything. And leech it. Then have an algo index it. Then NLP. And then finally anchor everything towards everything.
Then we can Sherlock everything. Find a new lead? Scrape the hell out of it and everything it links to and archive it all