this post was submitted on 18 Nov 2025
233 points (98.7% liked)

Technology

40285 readers
91 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 6 years ago
MODERATORS
 

Reminds me of the Crowdstrike incident last year.

top 50 comments
sorted by: hot top controversial new old
[–] drspod@lemmy.ml 95 points 2 days ago* (last edited 2 days ago) (2 children)

Seems like it.

Reminds me of the Cloudflare incident this year.

And the Cloudflare incident also this year.

[–] tux0r@feddit.org 40 points 2 days ago (1 children)

Clownflare is going just great.

[–] Ulrich@feddit.org 10 points 2 days ago

🔥 Everything is fine 🔥

[–] herseycokguzelolacak@lemmy.ml 12 points 2 days ago (1 children)

Reminds me of the Cloudflare incident this year.

And the Cloudflare incident also this year.

Were those as big as this one? Somehow I missed them.

[–] Ooops@feddit.org 10 points 2 days ago

I'm learning about this one right now, so I guess I basically missed this one, too, while being online for hours...

[–] tux0r@feddit.org 59 points 2 days ago (5 children)

Use cloud services, they said. To prevent outages, they said.

[–] ramble81@lemmy.zip 20 points 2 days ago (1 children)

There are a lot of IT departments though that get to throw up their hands and say “can’t fix it, it’s a cloud issue!” and watch as management, who pushed for cloud in the first place, sucks it up because they don’t want to lose face for their decision.

(Yes I know some still get yelled at regardless and told to fix a 3rd party service)

[–] 7U5K3N@lemmy.dbzer0.com 5 points 2 days ago

(Yes I know some still get yelled at regardless and told to fix a 3rd party service)

Man I feel this. Once some drunk asshat hit a telephone pole and it killed the fiber line to a call center for the company I worked for. Hilariously the backup Internet was on the same pole... Additionally.. It was a hemispherical call center meaning it served everyone in the western hemisphere.

Anyway.. All internet was down for the call center for like 8 hours. So no calls were being answered. No orders being placed etc.

Being on the Helpdesk at the time..I took so many "our Internet is down" calls. Which after a couple hours it turned into "fix the internet or I'm calling your boss" lol

Which then turned into "fix the internet or I'm calling their boss"

From my pov it was hilarious.

Someone in upper management got fired for consolidating all the call centers. Then they moved to wireless Internet via cell towers as a backup.

But as we all know. That's just fiber based at the tower. Lol

So yeah fun times of "go do someone else's job"

Still to this day idk why it took so long.. you'd think an sla would be in place. ¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯

load more comments (4 replies)
[–] Ephera@lemmy.ml 31 points 2 days ago (2 children)

Oh man, these global outages are really getting out of hand. A few days after the recent AWS and Azure outages, I suddenly noticed that I couldn't reach certain webpages anymore. And I genuinely didn't even bother trying to debug, because I just assumed that it's another global outage.

In the evening, I did look into it and noticed that my router was at fault (presumably DNS got bugged by a recent update). That was just wild to me, that I genuinely deemed it more likely that several major webpages went offline together than that my home setup is fucky.

[–] crusa187@lemmy.ml 5 points 2 days ago (1 children)

To be fair, it’s never DNS ;]

[–] kent_eh@lemmy.ca 5 points 2 days ago

To be fair, it’s never DNS ;]

Sometimes it's BGP.

[–] cassandrafatigue@lemmy.dbzer0.com 3 points 2 days ago (2 children)

Well yeah. Yourrouter is managed by a person. We aren't as good at fucking up as mega corps.

load more comments (2 replies)
[–] ThePantser@sh.itjust.works 49 points 2 days ago (3 children)

The world's richest man can't even keep his own website up and accessible. But the guys hosting the fedi in their garage are just fine. Lol

[–] SkaveRat@discuss.tchncs.de 24 points 2 days ago (2 children)

tbf, the scales are slightly different

[–] Damage@feddit.it 12 points 2 days ago

I mean, isn't that part of the point? Decentralization to smaller systems

[–] cassandrafatigue@lemmy.dbzer0.com 5 points 2 days ago* (last edited 2 days ago)

He should be able to afford a lot more redundancy than our garage hosters.

The scale makes it more embarrassing, not less.

[–] tenchiken@anarchist.nexus 8 points 2 days ago

Can I rent some space in your garage?

[–] Zamboni_Driver@lemmy.ca 4 points 2 days ago

Lemmy.ca was down

[–] schnurrito@discuss.tchncs.de 35 points 2 days ago (3 children)

It reminds me more of the AWS outage last month.

It's probably not half of the Internet, but the fact that it's so many very visible sites should be a warning sign to everyone that the Internet is nowadays too reliant on a few points of failure (which can cause other problems, e.g. censorship).

[–] krooklochurm@lemmy.ca 7 points 2 days ago* (last edited 2 days ago) (1 children)

From a security perspective when you consider this, along with our reliance on mobile phones, POS systems, digital payment processors, iot devices, cell phone providers, etc etc.

Sooner or later someone with ill intent is going to savagely fist fuck the whole fucking ecosystem to death and take a shit on the flaming wreckage.

Law enforcement neither understands nor gives a fuck about tech for the most part, unless you're dealing with high end espionage type shit. Good luck getting officers dunning and Krueger to take action on anything suspicious when they think their ability to use an iPhone means they're the greatest thing to happen to tech since the microprocessor.

The makers of consumer tech products could give a fuck about security. Wireless providers similarly could not give a squirt of fucking piss about security as long as you're paying your monthly bills and they can harvest data. Politicians only care insofar as they're able to use tech to push their moral bullshit, control and police peoples' actions. It goes on and on and on and on.

We are reliant on all manner of tech products, both hardware and software, to participate in modern life, and yet the political apparatus treats it all like it's disposable, as if it's 1996 and it doesn't matter if all of this goes to shit.

We are a naked, drunk 16 year old girl at a frat house with a sign that says "fuck me, I'm wasted" around our necks and we're pretending like there are no consequences to this, or worse yet that nothing bad will happen.

[–] WanderingThoughts@europe.pub 6 points 2 days ago (1 children)

The Spider Jerusalem of the tech world. But I want to slap some of my colleagues. The number of times I caught some making everybody administrator so they don't have to deal with security is too high.

load more comments (1 replies)
[–] PowerCrazy@lemmy.ml 2 points 2 days ago

Cloudflare is in an interesting space. They are a service provider (ddos protection, scalable edge caching, SSL termination, etc) that allows the highly centralized internet to function. However they aren't a gatekeeper at all. You only need cloudflare if you are in the top 5% of internet websites by volume. So when cloudflare has a problem, Lemmy isn't affected, but Reddit is. My blog isn't affected, but someone like https://blog.ipspace.net/ is affected.

My personal browsing habbits meant I didn't even realize there was a cloudflare problem until I read an article about it on Lemmy. Anyway, just a tangent, but as a network engineer I'm sure i'll be interested in the RCA.

load more comments (1 replies)
[–] herseycokguzelolacak@lemmy.ml 4 points 2 days ago
[–] antrosapien@lemmy.ml 25 points 2 days ago (9 children)

There's some malicious satisfaction watching centralized internet burning in dumpster fire while your self hosted stuff is still up

[–] digdilem@lemmy.ml 5 points 2 days ago

Except many of us use cloudflare tunnels to reach our selfhosted kit from the internet because we're behind CGNATs...

load more comments (8 replies)
[–] Tenderizer78@lemmy.ml 26 points 2 days ago (2 children)

Are they vibe-coding or something?

[–] zod000@lemmy.dbzer0.com 9 points 2 days ago (1 children)
[–] exu@feditown.com 5 points 2 days ago
load more comments (1 replies)
[–] Korkki@lemmy.ml 20 points 2 days ago

Never replace your code monkeys with clankers, boys.

[–] Zerush@lemmy.ml 4 points 2 days ago

In short: yes, because Cloudflare is the man in the middle between you and half the internet, most pages use it's service.

[–] MonkderVierte@lemmy.zip 10 points 2 days ago

They are half the internet.

[–] cupcakezealot@piefed.blahaj.zone 15 points 2 days ago (1 children)

maybe if big tech stopped firing all their engineers and investing in ai, this could have been prevented.

load more comments (1 replies)
[–] unexposedhazard@discuss.tchncs.de 16 points 2 days ago* (last edited 2 days ago) (2 children)

Yes. All my fedi services are still happy tho :)

[–] bjoern_tantau@swg-empire.de 5 points 2 days ago* (last edited 2 days ago)

Most Lemmy images stopped working. And maybe what my server is showing me in terms of posts is just what it still has stored.

Edit: My server is actually much more responsive with most of the big Lemmy instances being down. I really hope 1.0 brings great improvements.

load more comments (1 replies)
[–] 9point6@lemmy.world 11 points 2 days ago

Cloudflare is increasingly a SPOF for the web

It's hilariously probably at the point where it's beneficial for them from a PR perspective to recommend alternatives to new customers now

[–] umbrella@lemmy.ml 7 points 2 days ago* (last edited 2 days ago)

i'm usually on frontends, alternatives and self-hosted services. i'm barely seeing any of those outages.

feeling cool rn ngl 😎

[–] HiddenLayer555@lemmy.ml 6 points 2 days ago* (last edited 2 days ago)

Weird. Didn't notice because Cloudflare blocks my real user traffic because I have the audacity to use a VPN and Firefox with privacy extensions that block like maybe two of their arsenal of fingerprinting tools.

[–] benagain@lemmy.ml 7 points 2 days ago

The age old question: was it DNS or LLM?

[–] Olgratin_Magmatoe@slrpnk.net 7 points 2 days ago* (last edited 2 days ago)

Gonna be a fun day at work today

[–] VoxAliorum@lemmy.ml 6 points 2 days ago

It's so funny :P just months ago one of my most used forums adopted cloudflare and many asked "Are you sure?". Well...

[–] RiceMunk@sopuli.xyz 6 points 2 days ago
[–] ArsonButCute@lemmy.dbzer0.com 5 points 2 days ago (5 children)

Anyone have a decent guide on migrating from CF tunnels over to a proper reverse proxy? I hate networking 😓

load more comments (5 replies)
[–] yxp@lemmy.radio 5 points 2 days ago (1 children)

Damn, I really shouldn't have trusted cloudflare tunnel. All my selfhosted servers are inaccessible... It's running behind traefik so no ports are open.

[–] qjkxbmwvz@startrek.website 7 points 2 days ago (2 children)

VPS+VPN (WireGuard for me), with Tailscale as an emergency alternative, has worked very well for me. Knock on wood the only outages have been my own fault.

load more comments (2 replies)
load more comments
view more: next ›