Does somebody just need to buy a lot of hard drives and data tapes, and program a bunch of raspberry pi to download everything it can find?
Edit: What I’m specifically asking about is the feature reddit had to search the site itself. Obviously for reddit this process is much simpler, since they’re just searching their own database.
Ya I’m hoping for something closer to what I do today with Reddit, err used to do ;) Where I can just type in “best VPN providers reddit” and see a listing of posts / and a short blurb on the search results page itself. And ya trying to filter out all of the blog spam from the rest of the web. Since there’s no one single site for the fediverse it becomes a little trickier, especially for the layman to find the content they want.
lol that’ll just give you a bunch of spam and ads for shitty VPNs like Nord
True but not everyone has the google-fu to filter their search results to weed out spam, etc… So how can we make things easier for the average Joe to be able to find the reviews/feedback/advice that they’re searching for without someone raising the same questions here everyday?
I.e. what if there was a search engine specifically built to just search all of the comments and posts in the fediverse? What if that engine could be hosted in your own home so you don’t have to worry if someone is snooping on your search history? What if there were no ads of any kind in those same results?