1179
this post was submitted on 05 Oct 2023
1179 points (98.4% liked)
Technology
60083 readers
3163 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
When you need a scalable service for tons of users, federated isn't going to cut it. This is why Apple wants DDG. Point the bajillion crApple lusers at one of your public instances (or even all of them chosen at random each time) and watch it crash and burn overnight. DDG has tons of servers and the infrastructure to hold up while a ton of people search why their luxury device is slowing down every time Apple releases a new one.
Lol Federation is the definition of scalable. Everyone serves their local users -> a miniscule amount of global traffic, everything but auth always stays local.
Universities have been doing it since the beginning of the internet. Email is the biggest example but there are others: eduGAIN and eduroam are the most notable ones coming out of the academic community.
You are confusing a network of distinct servers with a single point of entry that a search engine would need to be. There is no fallback or distribution of search when everything is directed to a single search point, and pointing people to different search sites per search will remove any per-site preferences.
Do people think about what they say any more, or do they see someone who is trying to carefully explain their problem and just go into pure rage and try to disprove them by spewing things that do not make any sense?
No search engine has a "single point of entry". Every search engine has Cache servers all over the world at almost every major IXP. Nothing would prevent a federated service from operating the same way. Cloudflare or literally any form of loadbalancer or load balancing service could be used to redirect queries to fedisearch (or whatever the service name would be) to the local instance by IP geolocation. Authentication can just be forwarded to the home server via SAML, thats also where the settings can be stored and queried at login time by the local instance. SAML assertions are very scalable, and there needs to be no global login server, since every users login query can be forwarded to his home instance, where his profile is loaded. The full search index could be put into a blockchain that every local instance joins - every instance crawls their area and publishes new results to the chain. You seem to know very little about how the internet works, yet you accuse me of raging.
That the foss community can manage things like that has been proven for years. Debian mirror server network works in a similar way (they run their own loadbalancer ofc), while being cryptographically secure. And if you wanna see a federated login network like i described in action, just go to https://pubs.acs.org/action/ssostart
All these parts i described are existing technology and in global use. The combination is not, but there is nothing that would prevent a foundation from implementing search like this.