These types of uses make ChatGPT for the non-write the same as a calculator for the non-mathematician. Lots of people are shit at arithmetic, but need to use mathematics in their every day life. Rather than spend hours with a scratch pad and carrying the 1, they drop the numbers into calculator or spreadsheet and get answers.

A good portion of my life is spent writing (and re-writing) technical documents aimed at non-technical people. I like to think I’m pretty good at it. I’ve also seen some people who are very good, technically, but can’t write in a cohesive, succinct fashion. Using ChatGPT to overcome some of those hurdles, as long as you are the person doing final compilation and organization to ensure that the output is correct and accurate, is just the next step in spelling, usage, and grammar tools. And, just as people learning arithmetic shouldn’t be using calculators until they understand how its done, students should still learn to create writing without the assistance of ML/AI. The goal is to maximize your human productivity by reducing tasks on which you spend time for little added value.

Will the ML company misuse your inputs? Probably. Will they also use them to make your job easier or more streamlined? Probably. Are you contributing to the downfall of humanity? Sure, in some very small way. If you stop, will you prevent the misuse of ML/AI and substantially retard the growth of the industry? Not even a little bit.

• it’s expensive to run, openAI is subsidising it heavily and it will come back to bite us in the ass soon
• it can be both intentionally and unintentionally biased
• the text it generates has a certain style to it that can be easy to pick up on
• it can mix made up information with real information
• it’s a black box

A lot of people are talking about the privacy aspect (like you mention in your post) a lot better than me, so I wanted to share the main issue I’ve had with ChatGPT. It’s an idiot. It can’t follow basic instructions and will just repeat the mistake over and over again when you point it out. It’s uninspired and uncreative and will spit out lame, great value brand names like “The Shadow Nexus”, “The Cybercenter”, “The Datahaven”. I used to be able make it give good names when giving it example names but doesn’t work anymore. I’m writing cyberpunk fic, and I needed help with a hacker group name, and it came up with the Binary Syndicate which is pretty good. Now it comes up with “Hacker Squad”, “The Hacker Elite”, “The Hackers”. I don’t want it to write an entire book for me, but sometimes I need help with scene that require more technical knowledge than I have. It’s prose was really good when you fine tune it a little. Now it’s flat, bland, and boring. I asked it to write a scene about someone defusing a bomb and it basically was a two sentence scene that explained nothing on how he defused it. I asked it to make it longer and explain how he defused it and it saw “He opens the case and utilizes a technique known as ‘wire tracing’. He traces the wire and cuts it and the bomb is defused. The hacker is so relieved.” See how flat that is? How mechanical? I use Claude for creative writing but it’s not much better.

Claude is so censored that writing anything that sounds even nonoscopically criminal it freaks the hell out and lectures you about being ethical. For instances it wouldn’t help me write a scene about a digital forensic analyst at the FBI wiping a computer (because it encourages harm). So you can only imagine how it reacted when I asked it for help writing about my vigilante hacker character and my archeologist posing as a crime lord smuggler secretly dismantling black market trades in the middle east. You have to jailbreak it (which is a little bit less hard than hacking the Pentagon!) and eventually it goes all love guru on you and starts monologuing about light and darkness and writing inspiring uplifting tales blah blah blah.

Honestly, what I’m saying is that ChatGPT is pretty dumbed down, but I’ve heard of a lot of people who’ve noticed no difference. You could be one of them. If you’re using it for creative writing, use Claude and good luck with the prompt engineering attempting to jailbreak it.

The first downside is in the use of it exactly the way you’re using it. In this case, a company may decide they don’t actually need technical writers, just a low-paid editor who feeds tech specs into a prompt, gets a response, and tidies it up. How many skilled jobs are lost because of this?

Think of software devs. Feed a project spec into the prompt: “Give me a Django backend and Vue frontend to build an online calendar” and then you have just a QA dev who debugs and tests and maybe cleans up a bit. Now, instead of a team of software devs working to make sure you have a robust, secure and properly architected app, you have one or two low-paid testers who don’t understand the full architecture, can only fix bugs, and don’t understand the security issues inherent in the minimally viable code the bot spat out.

Think of writers. Just ignore actual creatives. Plug an “idea” into the prompt and then have an editor clean up any glaring strangeness and get it out the door. It can, and already is, flood the market with absolute drivel driving actual human creatives out. Look at the current writers strike. The Hollywood execs are fucking champing at the bit to just replace them all with an LLM and say to hell with the writers.

The core issue is: the people at the top with money only care about money. They don’t care if the product is good. Quality is irrelevant if they can crank it out at a tenth of the cost and at 1000x the volume. And every time you use it, you’re giving it training data. You’re justifying its use. And its use is, and will continue, to destroy entire industries, ruin web search, create mis- and disinformation, and endanger the sharing of actual human creativity.