In partnership with

AI Spotlight — Your AI Isn't the Problem. Your First Prompt Is.
AI SPOTLIGHT

Your AI Isn't the Problem. Your First Prompt Is.

Most people treat ChatGPT like a calculator and get frustrated when it doesn't act like one. One founder's five-step fix, tested over two years of building custom AI assistants.

📖 5 minute read
Person typing on a laptop with a chat interface open

Welcome Back,

We've all done it, built a custom GPT, fed it documents, and shouted out in frustration when it failed real-world tasks, hallucinating, ignoring a key rule, or giving a generic, useless answer, according to entrepreneur and Kalicube founder Jason Barnard, writing for Entrepreneur. His diagnosis is blunt, if that's happening to you, the technology is up to the task, your approach isn't.

Most entrepreneurs are treating ChatGPT, Gemini, and Claude as software to be configured, when they're closer to a bonkers mix of super-knowledgeable interns that need to be guided. Writing a static set of rules and expecting flawless performance is, in Barnard's words, a huge mistake. Over the last two years, he's built dozens of specialized AI assistants, moving from frustratingly unhelpful tools that drown him in useless text to genuinely powerful ones that save real time.

Today we look at the two traps most people fall into when building an AI assistant, the specific five-part job brief that replaces a vague prompt, why a flawed first draft is actually useful information, and the one step Barnard says almost everyone skips, the step he calls the single biggest source of AI frustration.

📌 In Today's AI Spotlight

  • The two common traps that make AI assistants frustrating from day one.
  • The five-part job brief that replaces a vague, one-line prompt.
  • Why a flawed first draft is actually the most useful part of the process.
  • "Instructional drift," the step almost everyone skips.
  • Our AI Spotlight take on treating an AI assistant like a new hire, not a calculator.

⚠️ The Two Traps Everyone Falls Into

When building a custom AI assistant, most entrepreneurs fall into one of two traps, according to Barnard. The first is the one-line prayer, a vague prompt that expects the machine to read your mind. The second is the mega-manual, a single, massive prompt that tries to account for every possible scenario upfront.

Both create an inflexible system that breaks under pressure, forcing a frustrating cycle of rewrites. The reason, according to Barnard, is that both methods treat the AI like a calculator, not a collaborator. The AI has no context for why the rules exist, it's just executing a script.

"True expertise, whether human or artificial, comes from understanding the principles behind the rules. You build that understanding through practice, feedback and refinement, not by handing over an encyclopedia on day one."

— Jason Barnard, entrepreneur and founder, Kalicube

That reframing is genuinely useful on its own, independent of the specific five-step method that follows. Most frustration with AI assistants comes from expecting a single, perfect instruction set to work immediately, the same unrealistic expectation nobody would place on an actual new hire's first day.

Manager reviewing work with a new employee at a desk

Treating an AI assistant like a new hire, one that needs coaching, not a finished configuration, is the core mindset shift.

📋 Step 1: Ditch the Prompt, Write a Job Brief

The solution, Barnard argues, is to treat your AI assistant like a new hire. Your first prompt should be a clear job brief, written with a plain, unconfigured version of Gemini or GPT, defining the core components in a single, focused conversation. He lists five components every brief needs.

💡 The Five-Part Job Brief

The role: who is the AI? ("You are a junior copywriter specializing in financial services.")

The goal: the single most important objective the output must achieve.

Success criteria: two to three measurable checks the final output must satisfy, the AI's own quality checklist.

Constraints: the scope, and any allowed or forbidden sources of information.

Output format: the specific deliverable, bullet points, a report, a word count.

Barnard adds a sixth element worth calling out separately, clarifications, an instruction empowering the assistant to ask for help. Something as simple as "if any critical information is missing to meet the goal, ask me targeted questions before you proceed" gives the AI permission to flag a gap instead of quietly guessing and producing a confidently wrong answer.

How Jennifer Aniston’s LolaVie brand grew sales 40% with CTV ads

For its first CTV campaign, Jennifer Aniston’s DTC haircare brand LolaVie had a few non-negotiables. The campaign had to be simple. It had to demonstrate measurable impact. And it had to be full-funnel.

LolaVie used Roku Ads Manager to test and optimize creatives — reaching millions of potential customers at all stages of their purchase journeys. Roku Ads Manager helped the brand convey LolaVie’s playful voice while helping drive omnichannel sales across both ecommerce and retail touchpoints.

The campaign included an Action Ad overlay that let viewers shop directly from their TVs by clicking OK on their Roku remote. This guided them to the website to buy LolaVie products.

Discover how Roku Ads Manager helped LolaVie drive big sales and customer growth with self-serve TV ads.

The DTC beauty category is crowded. To break through, Jennifer Aniston’s brand LolaVie, worked with Roku Ads Manager to easily set up, test, and optimize CTV ad creatives. The campaign helped drive a big lift in sales and customer growth, helping LolaVie break through in the crowded beauty category.

AI Spotlight — Your AI Isn't the Problem. Your First Prompt Is. Part 2

✍️ Step 2: Assign a Real Task, Expect a Flawed First Draft

Once the assistant has its brief, give it its first real-world assignment, a real input it's never seen before, and see what it produces. The expectation matters here as much as the task itself, expect it to get things wrong. Just like a junior employee, its first attempt will reveal the gaps in its understanding.

The Five-Step Process, In Brief

5

core components required in the initial job brief

 

2 yrs

of building specialized assistants behind Barnard's method

 

2–3

measurable success criteria recommended per job brief

That reframing of a bad first draft as useful data, not wasted effort, is a genuinely healthy way to approach this. A flawed output isn't a sign the process failed, it's the diagnostic step that tells you exactly what needs correcting next, the same way a new employee's early mistakes reveal exactly what training they still need.

Person reviewing and marking up a printed document with red pen

A flawed first draft is diagnostic information, not a failure, revealing exactly which gaps the AI's instructions still need to close.

🗣️ Step 3: Feedback, Not a New Set of Rules

This is where the real coaching begins, and Barnard is specific about the structure that works. Present the critique as, first, a reminder of the input you provided, second, the output the AI generated, and third, your actual critique, stated specifically. His example, "The tone was excellent, but you failed to mention the key statistic about Q3 revenue, which was a critical part of the input. That statistic needs to be in the first paragraph."

"Ask it to rewrite its own instructions to incorporate this feedback."

That last instruction is the subtle, important part, rather than the user rewriting the rules themselves, the AI is asked to update its own instructions based on the specific feedback given. Barnard recommends staying in a single conversation throughout this phase, so the model is building on existing context, adding new rules, refining old ones, and, crucially, learning why the previous version fell short, not just what changed.

🔍 Step 4: The Step Almost Everyone Skips

Here's the step Barnard calls the most important, and the one he says most people miss entirely. When you ask an AI to "tweak" its instructions, it can sometimes remove or alter foundational rules in the process of incorporating new feedback, a pattern he calls "instructional drift."

Fixing Instructional Drift

⚠️  Don't trust the assistant to self-regulate its own updated instructions
⚠️  Compare the newly generated instructions against the previous version directly
⚠️  If a rule is missing, say so explicitly and ask what else may have been dropped

Barnard's own recovery prompt is worth stealing directly, "You have removed the rule about X. That is still a core requirement. Please add it back in, and then tell me what other essential instructions you may have omitted in your update." That second half of the sentence does real work, it turns the correction into an audit, rather than a one-off patch.

Checklist and document comparison on a desk

Comparing updated instructions against the previous version catches rules that quietly disappeared during a "tweak."

🧠 AI Spotlight Analysis

The fifth and final step is simply to repeat the cycle, assign, review, critique, and audit, until the AI's understanding becomes more nuanced and its performance more reliable. But Barnard adds one last, genuinely counterintuitive piece of advice at the end, once the instructions are finally right, start a brand new assistant with them, rather than continuing to use the one you've been training.

"The assistant you have been working with will still contain all the inaccuracies, mistakes and back-and-forth from steps 1 to 4. That pollutes the algorithm," Barnard writes, calling this "historical assistant pollution," and describing it as the single thing that makes custom GPTs so frustrating for most people. That's a genuinely useful, easy-to-miss detail, the messy training process itself leaves residue behind, and the clean, refined instructions deserve a clean slate to actually perform on.

💬 Quote of the Week

"The technology is up to the task. My approach isn't."

— Jason Barnard, entrepreneur and founder, Kalicube

That's a genuinely useful reframe for anyone who's given up on a "frustrating" AI assistant after one bad session. The method here isn't exotic, it's structured iteration, treating the model less like software you configure once and more like a new hire you coach through repeated, specific feedback. The upfront patience required is real, but so is the payoff Barnard describes once "historical pollution" is finally cleared out of the picture.

💡 Final Thoughts

None of these five steps require any technical skill beyond writing clearly and paying attention, which is exactly what makes this method worth trying before writing off an underperforming AI assistant as simply not good enough. A job brief instead of a vague prompt, an expected flawed first draft, specific feedback instead of a new rulebook, an audit for instructional drift, and a fresh start once the instructions are finally right.

The honest trade-off is time upfront, this is a genuinely more effortful process than typing a single prompt and hoping for the best. But for anyone who's built a custom GPT, fed it documents, and walked away frustrated, the diagnosis worth sitting with is Barnard's own, the technology usually isn't the bottleneck, the one-shot approach to instructing it is.

Have you ever caught "instructional drift" in your own AI assistant without realizing what to call it? Hit reply, we read every response.

🔗 Sources and Further Reading

Entrepreneur: Is Your AI Assistant More Frustrating Than Helpful? Here's How to Make It Truly Useful

❤️ Enjoying AI Spotlight?

If today's edition gave you a fix worth trying on your own AI assistant this week, consider sharing it with a colleague, founder, or friend interested in technology.

Share AI Spotlight →

Thanks for reading AI Spotlight.

Our mission is simple: deliver clear, trustworthy, and actionable AI insights that help professionals stay ahead without the hype.