Microblog Memes

I suspect china is fudging the training timeline tho…

I'm more prone to believe OpenAI is just a clunky POS. DeepSeek released a model that's operating on theories kicking around the LLM community for years. Now Alibaba is claiming they've got a better model, too.

Altman insisting he needed $1T in new physical infrastructure to get to the next iteration of his product should have been a red flag for everyone.

They're trying to brute force a solution to a problem that more elegate coding accomplishes better.

I had suspicious before, but I knew they were screwed when Qwen 2.5 came out. 32Bs and 72Bs nipping at their heels… O3 was a joke in comparison.

And they probably aren’t fudging anything. Base Deepseek isn’t like crazy or anything, and the way they finetuned it to R1 is public. Researchers are trying to replicate it now.

Also, the thing the Chinese govt did probably do is give Deepseek training data.

For all the memes about the NSA, the US govt isn’t really in that position, as whatever the US govt has pales in comparison to Microsoft or Google.

Let X burn - ironically like the KKK did
Twitter will always have a place in my heart. Let it rest in peace

Or gasp advocate for open source development in the US?

Unthinkable, right?

Running the model can be no more taxing than playing a modern video game, except the load is not constant.

This is not true, Deepseek R1 is huge. There's a lot of confusion between the smaller distillations based on Qwen 2.5 (some that can run on consumer GPUs), and the "full" Deepseek R1 based on Deepseekv3

Your point mostly stands, but the "full" model is hundreds of gigabytes, and the paper mentioned something like a bank of 370 GPUs being optimal for hosting. It's very efficient because its only like 30B active, which is bonkers, but still.

I could live with life of the author and spouse (not children), but only if they haven't sold the rights.

If they've sold the rights, 15 years.

Thanks, Disney…

Copyright sometimes encourages new work, it often discourages it. Some of humanity's greatest art comes from a time before copyright. Some of the earliest English stories come from a tradition of essentially "fanfic". People took the Arthurian legends and wrote another story in that setting using those same characters. That would be illegal under copyright.

There may be an optimal copyright term that both encourages artists to pursue it, but then allows remixes while the art is still relevant. But, we don't know if that optimal copyright term is 14 years, 3 months or 2 centuries. (Personally, I doubt it's 2 centuries, but the current copyright terms are headed in that direction.)

Also, different types of works should probably have different copyright terms. Computer code is not going to be relevant in a century, it's probably loses half its relevance in something like 5 years. OTOH, a novel might take 5+ years to write, and might remain relevant for decades, even centuries. Music can be relevant for centuries, but it also often fits in a short zeitgeist, and being able to remix it while still in that cultural moment would be beneficial to everyone.

Maybe the real solution is some kind of universal basic income and no copyright terms at all. That way, you don't need a day job to pursue a passion that doesn't make you money. There's also nothing to stop you from finding patrons who will provide additional support because they love your work.

It all comes down to what the goal of copyright is. Are we trying to make art as a career possible? Do we want copyright behemoths like Disney? Do we want people to express themselves freely? Should cultural works be freely available to people while they're relevant?