Hiring a Shopify Marketing Agency: 12 Questions to Ask Before Signing
Most Shopify founders sign with the wrong agency for the same reason: the evaluation call was a sales presentation, not a diligence conversation. The agency walked through a polished pitch deck. You felt good about the energy. Three months in, the actual delivery doesn't match the promise.
This post is the diligence framework. Twelve questions to ask in any agency evaluation call — including the ones agencies don't want to answer. The bad agencies will dodge or deflect. The good ones will appreciate the rigor and give you specific answers. For background context on what you're buying, see how much a Shopify marketing agency actually costs in 2026.
Table of Contents
- Why Most Evaluation Calls Miss the Point
- The 12 Questions
- Red Flags in How They Answer
- The Post-Call Decision Framework
Key Takeaways
| Point | Details |
|---|---|
| The point | Force the conversation off pitch mode and into specifics about delivery, accountability, and pricing. |
| The dodge | Vague answers, redirects, or "let me circle back" are signals — pay attention. |
| The signal | An agency that answers all 12 with specifics, even uncomfortable ones, is the one to take seriously. |
| The framework | Score each agency on the 12 questions. Average matters less than absence of red flags on the critical ones (case studies, contracts, AI delivery, who does the work). |
Why Most Evaluation Calls Miss the Point
The default Shopify agency evaluation call goes like this:
- Agency walks through a polished pitch deck (10–20 mins)
- Agency asks about your brand and goals (10–15 mins)
- Agency promises a tailored proposal (5 mins)
- You feel positive about the energy and process
What's missing: the diligence. You haven't asked who's actually doing the work, what specific output you'll get, what accountability you have if it doesn't perform, or what the contract says about leaving if results don't materialize.
The 12 questions below force the conversation into specifics. Send them in advance if you want serious answers. Most founders are scared to look "demanding." Don't be — you're committing $20k–$120k+ over the next year.
The 12 Questions
1. "Walk me through exactly what AI does in your delivery process — what tools, where in the workflow, where humans review."
Why ask: In 2026, this question separates AI-native agencies (specific, detailed answer) from traditional agencies that added "AI" to their pitch deck (vague answer or "we use AI to enhance our process").
What good looks like: A specific walk-through. "We use Claude for email subject line variant generation. Designer reviews creative concepts in Midjourney before production. Performance reports are AI-generated weekly, reviewed by the account lead before delivery." Tools named. Humans in the loop named. See what an AI marketing agency actually does for the framework.
2. "Show me a specific case study — starting revenue, ending revenue, timeframe, and what specifically drove the growth."
Why ask: Vague testimonials don't prove anything. You want a number-backed story.
What good looks like: "Client X went from $18k/mo to $51k/mo in 90 days. Email contribution moved from 12% to 34% via the 4-flow stack. Paid scaled from $3k/mo to $12k/mo at 3.2x ROAS." Specific. Numbers. Attribution to the work.
3. "Who specifically will be on my account day-to-day — names, roles, and time commitment?"
Why ask: The pitch team and the delivery team are often different people at mid-tier and large agencies. The senior strategist sells; the 1-year-experience associate executes.
What good looks like: "You'll work with [Name], your account lead, 6 hours/week. [Name] handles paid (4 hrs/wk). [Name] handles email (3 hrs/wk). I'll be on quarterly reviews."
4. "What's your monthly fee, and what's specifically included vs. what's always extra?"
Why ask: Most fee creep happens because the proposal was vague. Force the itemization upfront.
What good looks like: "$X/mo includes: 4 email campaigns + flow management, paid ads management with N creative variants, SEO with N content pieces. Extras: photography, video production, custom landing pages outside the standard scope."
5. "What's the contract term, and what happens if I want to leave at month 3?"
Why ask: Long contracts protect agency revenue, not client outcomes.
What good looks like: "Month-to-month with a 30-day notice." Or: "90-day pilot, then month-to-month." Anything requiring 12 months upfront with significant early termination fees is a red flag.
6. "What does success look like at 30, 60, and 90 days — what specific KPIs?"
Why ask: Agencies that can't articulate this in advance don't have a clear delivery model.
What good looks like: "Day 30: flows live, creative testing started, baseline established. Day 60: email contribution at 20%+, ROAS at 2.5x+. Day 90: email at 30%+, ROAS at 3x+, organic traffic up 25%." Specific. Time-bound. Measurable.
7. "How often do you produce and test new ad creative variants?"
Why ask: Creative testing velocity is the single biggest differentiator on paid performance. Traditional agencies produce 2–3 variants/month. AI-native agencies produce 12–20.
What good looks like: "We test 3–5 new creative variants per week per top ad set." Anything monthly is too slow. We covered this in the complete guide to paid ads for ecommerce.
8. "What's the recommended ad spend for my situation — and what should I expect for ROAS?"
Why ask: Sets the right expectation and tests whether the agency understands your specific stage.
What good looks like: "For your AOV and category, $3k–$5k/mo to start, scaling to $10k+ as we identify winners. Expect 2x ROAS week 1, 2.5x by week 4, target 3x+ by month 3."
9. "What's your reporting cadence — weekly, monthly? What format?"
Why ask: Agencies that report monthly only are running the relationship at agency-convenience speed, not client-need speed.
What good looks like: "Weekly written summary, real-time dashboard access (Looker / Triple Whale / similar), monthly review call with strategic recommendations."
10. "Tell me about a client engagement that went poorly — what happened and what did you learn?"
Why ask: Tests honesty. Every agency has had bad fits. The ones that won't acknowledge it are hiding something.
What good looks like: A real story with self-awareness. "We took on a client at $X/mo who needed [different scope]. Six weeks in, we identified the mismatch and offered to refund and refer them elsewhere. We've since updated our intake process to filter earlier."
11. "If I want to bring this in-house in 9 months, will you help me document the workflows and transition?"
Why ask: Tests whether the agency views you as a long-term partner or a revenue lock-in.
What good looks like: "Yes — we document everything in your accounts. If you go in-house, your team can pick up where we left off." Anything resistant is the agency telling you they're optimizing for retention, not your success.
12. "What's the one thing about your agency you wish more clients understood before signing?"
Why ask: Open-ended honesty test. Reveals what the agency itself thinks the most common misalignment is.
What good looks like: A real, candid answer. "Most clients don't engage in onboarding deeply enough — the first 14 days set the tone for the whole engagement." Vague answers like "we work hard" are non-answers.
Red Flags in How They Answer
Watch the texture of the answers as much as the content:
- Defensive on pricing. "Our pricing reflects our value" without specifics is a dodge. Real value is shown, not asserted.
- Vague on delivery. "We have a comprehensive process" without describing the actual workflow is a tell.
- Long pause on case studies. Real outcomes are top-of-mind for any agency that has them.
- Pushback on month-to-month terms. A confident agency doesn't need long contracts.
- Heavy on social proof, light on numbers. "Trusted by 500+ brands" is not the same as "our average client grew 40% in 6 months."
- Scope creep language. "We'll figure that out as we go" instead of "here's what's included and what's extra."
- Pitch team ≠ delivery team. The senior partner on the call won't be on the account week-to-week.
For broader pricing red flags, see how much a Shopify marketing agency actually costs in 2026 and the agency tax post.
The Post-Call Decision Framework
After running the 12 questions across 2–3 agencies, score each one. A simple framework:
| Question | Score (1–5) |
|---|---|
| 1. AI delivery story | |
| 2. Specific case study | |
| 3. Who's on my account | |
| 4. Itemized scope | |
| 5. Contract terms | |
| 6. KPI commitments | |
| 7. Creative testing cadence | |
| 8. Ad spend recommendations | |
| 9. Reporting cadence | |
| 10. Honest failure story | |
| 11. Transition flexibility | |
| 12. Honest "wish you knew" |
Decision rules:
- Any score of 1 on questions 1, 2, 3, 4, 5, or 6 = walk away. These are the non-negotiables. If they can't articulate AI delivery, show a real case study, name who's on your account, itemize scope, offer reasonable contract terms, or commit to KPIs — the rest doesn't matter.
- Average score below 3.5 = pass. You're committing 12 months of marketing budget. Don't settle for a 3.
For broader context on which agency model fits which stage, see agency vs. in-house vs. AI cost breakdown.
Talk to Branva
Branva runs the AI-native model — full email, paid ads, SEO on transparent monthly pricing, month-to-month. We'll answer all 12 questions on a free call. Book yours.
Frequently Asked Questions
Should I send these questions to the agency in advance?
Yes. Serious agencies welcome it; agencies running on the pitch model will be visibly less prepared.
How many agencies should I evaluate?
Three. One incumbent or recommended option, one mid-market alternative, one AI-native challenger. The triangulation forces clarity on what you're actually buying.
What if an agency refuses to answer one of these?
That's the answer. Move on.
How long does a real evaluation call take?
60–90 minutes if you're running the 12 questions properly. Most agency pitch calls are 30 minutes — that's not enough time to actually evaluate.
Are these questions too aggressive?
No — they're the diligence any prudent buyer should do for a $20k–$120k/yr commitment. Agencies that find them aggressive are the ones who don't want diligence done.
Related reading
- How Much Does a Shopify Marketing Agency Actually Cost in 2026? — Pricing tiers and what's included.
- What to Look for in an AI Shopify Marketing Agency in 2026 — Buyer's checklist for the AI-native side.
- The "Agency Tax": Why Shopify Brands Overpay by 60% — The structural argument.
- Shopify Marketing Agency vs. In-House vs. AI-Run Model — Full cost comparison.