Fuck AI

This is shockingly true.

I am working in it and a coworker who is a windows server admin (please take a moment to pray for his soul) is, according to him, making money with crypto. As I got fairly disappointed by the reality of crypto but was fairly excited over it before, I reject crypto because I looked into it.

So he is a bit of fan and I am the opposite, and I decided to talk with him about his perspective on my issues with crypto. Before we even got there, I had to realise that he is unfamiliar with the basics of crypto.

He always lies. He has no concept of truth or fact. He is a parrot, who has been listening to humans for milenia. But he doesn't understand anything. Just heard every word in many spoken sentences.

But he isn't anything more.

Generative AI actually does have a few real uses. Most notable is in the generation of new protein sequences.

Not long ago, you had PhD's whose entire career was understanding a single protein sequence. Now we can generate thousands of properly folded proteins. Millions. Stuff nature never thought of.

Due to patent law, the biotech revolution is still a few years out, but it's coming.

You want an enzyme that breaks apart plastic? We can design one now and have yeast producing it within a day or two.

And there are millions more that we can now play with.

Anyway, there are a few more niche uses for generative AI. But then idiot CEOs decided to shove that shit into everything. To decidedly mixed success.

LLMs are generally OK, if you can craft an unbiased question that demands facts. Never seen ChatGPT get it wrong. But it's stunning how easily you can manipulate them just a couple of prompts deep.

Thing is, most people, in America anyway, didn't get the science training I got in 70s elementary school, and even though I'm barely above average IQ, I was a star science student. Imagine those people who don't understand empiricism using LLMs. The mind boggles.

The way I imagine it in my head is like a text autocomplete trying to carry on a story about a person talking to a brilliant AI.

If something is real, of course the hypothetical author would try to get those details correct, so as not to break the illusion for educated readers. But if something is fake (or the LLM just doesn't know about it), well of course the all knowing fictional AI it's emulating would know about it. This is a fictional story, whatever your character is asking about it is probably just part of the setting. It wouldn't make sense for the all knowing AI in this story to just not know.

Obviously, OpenAI or whoever would try to prompt their LLMs to believe they're not in a fictional setting, but the LLMs are trained on as much fiction as non-fiction, and fiction doesn't usually break to tell you it's fiction, but often does the opposite. And even in non fiction there aren't many examples of people saying they don't know things. I wouldn't write a book review just to say I haven't heard of the book. Not to mention the non-fiction examples of people confidently being wrong or flat out lying.

Simply based on the nature of human writing, I frankly wouldn't ever expect LLMs to be immune to writing fiction. I expect that it's fundamental to the technology, and "hallucinations" (a metaphor that gives far too much credit, IMO) and jailbreaks won't ever be fully stamped out.

the only time they're useful is when assisted by an algorithmic search that provides good contextual information for it to summarize and more importantly link to for verification..

if you're struggling to find good results online it will absolutely not be helpful, if you're struggling to read results then it might help you hone in on an area and save you time.

however, chances are you'll continue to get worse at independent information gathering

Less downsides more that the upsides don't really exist.

Kind of a non-story, isn't it?