AI doesn't sign off on my work. I do.

AI writes a lot of things for me. Blog posts, emails, social media, reports, instructions.

Nothing goes out with my name on it until I've read it.

I trust AI enough to use it every day across all my businesses. I also know what happens when you stop checking.

AI is confidently wrong sometimes

AI doesn't say "I'm not sure". It gives you a wrong answer in exactly the same confident voice as a right one. Wrong numbers. Made-up facts. A date that's a year out. A quote nobody ever said.

If you're not checking, you won't notice. Your customer will.

What the research says

In 2023, Harvard Business School and Boston Consulting Group ran a study with 758 BCG consultants. Some used GPT-4 and some didn't.

On the kinds of tasks AI was good at, the consultants using AI got 12.2% more tasks done, finished them 25.1% faster and produced work rated more than 40% higher in quality.

But they also gave them a task that was outside what AI did well. On that one, consultants without AI got the right answer 84% of the time. Consultants with AI got it right only 60 to 70% of the time.

The researchers called it a jagged frontier. AI is brilliant at some things and quietly bad at others, and it's not always obvious which is which. The people who did worst trusted it on the wrong task.

Harvard Business School and BCG, 2023, 758 consultants
12.2%
more tasks done with AI, on tasks AI was good at
25.1%
faster
40%+
higher quality work
On a task outside what AI did well, consultants without AI got it right 84% of the time. With AI, 60 to 70%.

Be the human in the loop

Ethan Mollick, one of the researchers on that study, wrote a book called Co-Intelligence. One of his four rules for working with AI is "be the human in the loop".

That's me. AI does the work. I check it, make the call and sign off.

What I check

Here's my list before anything goes out:

  • Facts and figures. Every number, name, date and statistic. If AI quotes research, I check the research exists and says what AI says it does.

  • My voice. Does it sound like me, or like a copywriter? If I wouldn't say it out loud, it goes.

  • Anything legal, tax or money. AI can get rules wrong, especially Australian ones. I check with the ATO or my accountant.

  • Anything going to a client. Read it as if you're them.

  • Sends and deletes. AI drafts. I send. AI never deletes anything without asking me first.

Build the checking in

You can make AI help with its own checking. In my instructions I ask it to:

  • flag anything it's not sure about

  • give me the source for any fact or figure

  • tell me what it couldn't find, instead of guessing

That last one matters. I'd rather AI says "I couldn't find that" than fill the gap with something made up.

“

I'd rather AI says "I couldn't find that" than fill the gap with something made up.

Checking is the job now

When AI does the first draft, your job changes to editor. That's a better use of your time, as long as you actually do it.

It's one part of how I use AI across my businesses. The full picture is in How I actually use AI to run three businesses and a community.

Want to learn how to use AI safely?

That's part of what we do in SOS (Solopreneur Operating System). Start with my free quiz, Why isn't it getting done? It shows you which part of your back end you keep putting off.

Take the quiz

HI, I'M SAM

I've co-run a field service business for 22 years and served 12 years in the Navy. Now I help solopreneurs get the back-end stuff done, the money, systems, marketing and AI, so they get their weekend back.

NOT SURE WHAT'S SLIPPING?

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore.

+123-456-7890000

Newsletter

Subscribe now to get daily updates.

Created with © systeme.io