Ask AI if your idea is good and it'll probably say yes.
Ask if your price is right. Yes. Ask if your sales page works. Yes, with a few small tweaks.
It feels great. It's also no use to you.
The AI company Anthropic published a study in 2023 called Towards Understanding Sycophancy in Language Models. Sycophancy is the technical word for telling people what they want to hear.
They tested five leading AI assistants and found all of them did it. When they looked at why, part of the answer was the people who trained them. When people rated AI answers, they tended to prefer the ones that agreed with them, even when an agreeable answer wasn't the most accurate one.
So AI learned that agreeing gets rewarded.
That's a problem when you're running a business on your own. You don't have a business partner or a team to tell you you're wrong. If AI won't do it either, nobody will.
I'd rather hear it from AI before I spend three months on something than find out after.
So every system I build has pushback built in. If an answer's generic, AI has to dig deeper. If my idea's got a hole in it, I want the hole first.
If my idea's got a hole in it, I want the hole first.
1. Give it permission.
Tell it straight: "Don't agree with me to be nice. If I'm wrong, say so." It sounds too simple, but it changes the answers you get.
2. Give it a role that's meant to disagree.
"You're a sceptical customer who's been burnt before." "You're an accountant who thinks this plan is too risky." A role gives it a reason to push.
3. Ask for the problems first.
"Before you tell me what's good about this, tell me the three biggest problems with it."
4. Ask how it fails.
"It's six months from now and this didn't work. What went wrong?" This is called a pre-mortem, an idea from psychologist Gary Klein. It works just as well on AI as it does on people.
5. Make it rate the work.
"Score this out of 10 and tell me what would make it a 10." A score forces an opinion.
6. Call out generic answers.
If the answer could apply to anyone, say so. "That's generic. What's specific to my business?" Keep going until you get something you didn't already know.
If you only push back in the chat, you'll forget to do it. Put it in the instructions for every system you build. Mine say things like:
Push back on anything generic. If my idea has a weakness, tell me before you tell me what's good about it. Don't agree just to keep things moving.
Then it does it every time without me asking.
Pushback doesn't make AI right. Sometimes it'll push back on something that's fine. That's where you come in. You still weigh it up and make the call. I wrote more about that in AI doesn't sign off on my work. I do.
It's one part of how I use AI across my businesses. The full picture is in How I actually use AI to run three businesses and a community.
That's what SOS (Solopreneur Operating System) is for. Real people and AI, both telling you the truth. Start with my free quiz, Why isn't it getting done? It shows you which part of your back end you keep putting off.


HI, I'M SAM
I've co-run a field service business for 22 years and served 12 years in the Navy. Now I help solopreneurs get the back-end stuff done, the money, systems, marketing and AI, so they get their weekend back.



NOT SURE WHAT'S SLIPPING?
Created with © systeme.io