Technology

Google destroyed the opposition when building a search engine tool, this is nothing like the case with Google. Many websites generate robots.txt and other Terms of Service that are impossible for common people to follow these days. It's very hard to scrape, serve and be compliant at the same time. And as small fish you have to. Search engine maintenance occupies too much space and serving the pages with quality requires quick database management tools.

This gap might be closed by AI, but not before it. Even though true alternatives like GigaBlast existed.

The current LLM status has a vibrant open-weights scenario, which is centered on HuggingFace but it's the code away from being served in other places. AI uses datasets/corpus of texts, which can be shared by Universities/Institutions around the world, as they are currently.

LLM/AI is at arms reach from the people, no matter how much money Big Tech puts on Datacenters. The scary part is what Google always used to do best, lobbying for monopolization. Aside from that, we're safe.