When I was working with the Mastodon API, I decided to try ChatGPT on a problem I was having. So I created a prompt with as much detail as I could, and submitted it. It gave me some JS code that looked pretty good at first, until I checked the docs.

— Charles Johnson (@charles.littlegreenfootballs.com) 2024-05-25T22:33:50.000Z

It was using an API endpoint that doesn’t exist!

So I submitted the same question again, and got a completely different answer, also wildly wrong. I did this 3 or 4 more times and got different answers every time, until I just said, “Fuck this.”

I do not use ChatGPT now.

— Charles Johnson (@charles.littlegreenfootballs.com) 2024-05-25T22:33:51.000Z