Programmer Humor

Just start again from scratch for every feature 🤣

That estimate seems a little low to me. It's at least 115%.

And if you need anything else, you have to use a new prompt which will generate a brand new application, it's fun!

And it still doesn't work. Just "mostly works".

That's the thing, it's a useful assistant for an expert who will be able to verify any answers.

It's a disaster for anyone who's ignorant of the domain.

I turned on copilot in VSCode for the first time this week. The results so far have been less than stellar. It's batting about .100 in terms of completing code the way I intended. Now, people tell me it needs to learn your ways, so I'm going to give it a chance. But one thing it has done is replaced the normal auto-completion which showed you what sort of arguments a function takes with something that is sometimes dead wrong. Like the code will not even compile with the suggested args.

It also has a knack for making me forget what I was trying to do. It will show me something like the left side picture with a nice rail stretching off into the distance when I had intended it to turn, and then I can't remember whether I wanted to go left or right? I guess it's just something you need to adjust to. Like you need to have a thought fairly firmly in your mind before you begin typing so that you can react to the AI code in a reasonable way? It may occasionally be better than what you have it mind, but you need to keep the original idea in your head for comparison purposes. I'm not good at that yet.

If you're having to do repetitive shit, you might reconsider your approach.

I knocked off an android app in Flutter/Dart/Supabase in about a week of evenings with Claude. I have never used Flutter before, but I know enough coding to fix things and give good instructions about what I want.

It would even debug my android test environment for me and wrote automated tests to debug the application, as well as spit out the compose files I needed to set up the Supabase docker container and SQL queries to prep the database and authentication backend.

That was using 3.5Sonnet, and from what I've seen of 3.7, it's way better. I think it cost me about $20 in tokens. I've never used AI to code anything before, this was my first attempt. Pretty cool.

It's taken me a while to learn how to use it and where it works best but I'm coming around to where it fits.

Just today i was doing a new project, i wrote a couple lines about what i needed and asked for a database schema. It looked about 80% right. Then asked for all the models for the ORM i wanted and it did that. Probably saved an hour of tedious typing.

The one on the right prints “hello world” to the terminal

Engineers love moving parts, known for their reliability and vigor

That's the problem. Maybe it is.

Maybe the code the AI wrote works perfectly. Maybe it just looks like how perfectly working code is supposed to look, but doesn't actually do what it's supposed to do.

To get to the train tracks on the right, you would normally have dozens of engineers working over probably decades, learning how the old system worked and adding to it. If you're a new engineer and you have to work on it, you might be able to talk to the people who worked on it before you and find out how their design was supposed to work. There may be notes or designs generated as they worked on it. And so-on.

It might take you months to fully understand the system, but whenever there's something confusing you can find someone and ask questions like "Where did you...?" and "How does it....?" and "When does this....?"

Now, imagine you work at a railroad and show up to work one day and there's this whole mess in front of you that was laid down overnight by some magic railroad-laying machine. Along with a certificate the machine printed that says that the design works. You can't ask the machine any questions about what it did. Or, maybe you can ask questions, but those questions are pretty useless because the machine isn't designed to remember what it did (although it might lie to you and claim that it remembers what it did).

So, what do you do, just start running trains through those tracks, assured that the machine probably got things right? Or, do you start trying to understand every possible path through those tracks from first principles?

Might is the important here

It gives you the right picture when you asked for a single straight track on the prompt. Now you have to spend 10 hours debugging code and fixing hallucinations of functions that don't exist on libraries it doesn't even neet to import.

I'm being pretty resistant about AI code Gen. I assume we're not too far away from "Our software product is a handcrafted bespoke solution to your B2B needs that will enable synergies without exposing your entire database to the open web".

When did you get diagnosed?

OpenTTD is a good game.

I believe that, because test scripts tend to involve a lot of very repetitive code, and it's normally pretty easy to read that code.

Still, I would bet that out of 1000 tests it writes, at least 1 will introduce a subtle logic bug.

Imagine you hired an intern for the summer and asked them to write 1000 tests for your software. The intern doesn't know the programming language you use, doesn't understand the project, but is really, really good at Googling stuff. They search online for tests matching what you need, copy what they find and paste it into their editor. They may not understand the programming language you use, but they've read the style guide back to front. They make sure their code builds and runs without errors. They are meticulous when it comes to copying over the comments from the tests they find and they make sure the tests are named in a consistent way. Eventually you receive a CL with 1000 tests. You'd like to thank the intern and ask them a few questions, but they've already gone back to school without leaving any contact info.

Do you have 1000 reliable tests?

AI can't imagine an image full glass of wine because there are barely any images of that in any dataset out there. AI can't think, just massage it's dataset into something vaguely plausible.

https://www.youtube.com/watch?v=160F8F8mXlo