How to Hold Your Marketing Agency Accountable: A Business Owner’s Guide to Agency Oversight
Share:
Share:
To hold your marketing agency accountable, you need four things: one KPI tied to revenue and written into the agreement, every account owned by your business, a meeting rhythm that starts with that KPI every time, and the habit of asking what each number in the report is counting. Without those, you’re paying for activity and hoping it turns into customers.
Most agencies aren’t trying to fool anyone. The trouble is structural: the agency writes the report, picks the metrics, holds the logins and grades its own work. If you don’t set the terms, they will, and their terms always look good on a slide.
This guide covers the oversight side: the agreement, the accounts, the meetings, the reports and the decision to fix or fire. I’ve hired, managed and directed more than 25 ad agencies, so most of what follows comes from sitting on your side of that table.
Key takeaways
- Pick one revenue KPI, write it into the agreement, and make the agency report against it every month.
- Your business should own every account and login. The agency gets user access, not ownership.
- Open every agency meeting with the same question: this is the main KPI, has it changed?
- Decimal conversions, blended cost per lead and activity-only reports are the three red flags I see most.
- Fix an agency that is open and specific. Replace one that won’t commit to a number or give you the keys.
In this guide

Start with the agreement: one KPI, in writing
Here’s a quick test. Picture yourself signing the agency’s check next month. What number does your mind land on? If it’s a number you care about, like booked jobs, new patients or closed deals, you’ll sign without a second thought. If it lands on nothing, or on “we got 400,000 impressions,” you’ll start wondering what you’re paying for. I call this the Check-Writing Test, and it’s where every accountable agency relationship starts.
So before the campaigns, agree on one KPI. One. Tie it to revenue: qualified leads, booked appointments, sales from marketing, cost per customer. Put it in the agreement or in a signed scope document. Agencies will often offer five or six metrics instead. That sounds thorough, but six metrics give them six places to find good news. Choosing which number and setting a realistic target is scorecard work, and I cover it in how to evaluate your agency’s performance.
What belongs in the agreement
- The main KPI, how it’s counted and where the count comes from (your CRM, your phone system, your sales records).
- A plain definition of a lead. A real person who called, booked or filled out a form, counted as a whole number.
- Ownership of every account by your business, with agency user access.
- A notice period you can live with. Weeks, not quarters.
- What’s included: channels, hours, meetings, creative, landing pages.
- Disclosure of any markup on ad spend or tools, and any referral fees.
A good agency signs this without much argument. If they push back on the KPI, ask why. Sometimes the answer is fair: your tracking is broken and they can’t measure leads yet. Then the first deliverable is fixed tracking, with a date on it.
Own the keys before anything else
Your business should own one central account that everything connects to: domain, hosting, analytics, ad accounts, call tracking, tag manager, social pages, every login. The owner holds the password from day one. The agency gets user access to the pieces it needs. That’s Own the Keys, and it’s the cheapest insurance you’ll ever buy.
An agency that owns your accounts controls the evidence. It decides what you see, and if you part ways, years of conversion data and ad tests can leave with it. I’ve watched owners stay with an agency they’d lost faith in for exactly this reason. They weren’t loyal. They were stuck.
If your agency set things up under its own login, ask for a transfer now, while the relationship is friendly. It’s a routine request. How they respond tells you a lot.
Run every meeting from the main KPI
Agency meetings drift. A new ad mockup, an algorithm update, and 45 minutes later nobody has mentioned revenue. The fix is a ritual I call the KPI Lock.
Open with the KPI
Every meeting starts with the same sentence: “This is the main KPI. Has it changed?” Either the target is still right or the business has shifted and the work must shift with it. Maybe you hired two salespeople and can handle more leads, or one service line is booked out for three months.
Close by confirming it
Before anyone leaves, confirm the KPI again and agree on what changes before the next meeting. Each change gets an owner and a date.
Report against it next time
The next report opens with that number and with the changes you agreed on. Did they happen? What moved?
Monthly suits most businesses, with a short written update in between if you spend heavily. Weekly status calls mostly add hours to the invoice.

Questions to ask about every report
You don’t need to read every chart. Ask the questions that force the report to connect to money. These are mine.
- What is this conversion counting? A form submission, a phone call, a page view, someone scrolling halfway down a page? Plenty of things can be set as a “conversion” in an ad platform. Most aren’t leads. That’s the point of clarity of conversions.
- Does your lead count match ours? Put the agency’s number next to what your sales team or CRM logged for the same dates. If they say 60 and you saw 22, find the gap before discussing anything else.
- What did the most recent leads cost, compared with the average for the month?
- What did you change this month, and what happened after?
- What would you cut if I asked you to cut 20%?
- What happens after the click? Where do people land, and what do they do there?
That last question matters more than most owners expect. In one case study, a drug-trial company was running broad-match Google Ads on migraine keywords. Searchers were looking for organic and natural remedies, and the landing page talked about medicine under a doctor’s care as part of a study. The bounce rate was 97%. Changing the search terms and building a new landing page brought the bounce rate down 30%, took leads from 0 to 10 per week, and cut spend by 10%. The ads were “running” the whole time. Nobody had asked whether the click matched the page.
Asking that question every month is a job. Some owners do it themselves; others hand it to a strategist who doesn’t sell the ads. If you’re weighing that second route, I’ve compared a fractional CMO and a marketing agency side by side, and here’s how I get more out of an ad agency you already have.
Red flags that hide behind good-looking numbers
Most bad agency reports don’t contain lies. They contain numbers that are technically true and practically useless. Three show up again and again.
Decimal conversions
If the report shows 37.4 conversions, or a campaign with 0.62, something is wrong. You can’t get 0.62 of a customer. A decimal means the platform is counting something fractional, like engaged sessions, time on site or modeled credit, and calling it a conversion. When you see one, ask what’s being tracked and have it demoted to a secondary goal. This is Don’t Trust the Fraction, and it’s the fastest check you can run on any report.
Blended cost per lead that hides saturation
Average cost per lead can look steady while the last dollars you spend are getting expensive. Each extra dollar brings back less than the one before it. That’s the law of diminishing returns.
Example only: say an agency raises your budget from $2,800 to $4,200 a month and leads go from 35 to 42. The blended cost per lead moves from $80 to $100, which sounds manageable. The extra $1,400 bought 7 leads, though. That’s $200 each. If a lead is worth $150 to you, the increase lost money even though the average still looks fine. Ask for the incremental number whenever the budget goes up.
Reporting activity instead of outcomes
Posts published, impressions, reach, clicks, keywords ranked, blogs written. Activity proves the agency was busy, not that anything reached your bank account. If the revenue KPI is missing or buried on page nine, ask for it at the top. If it still isn’t there next month, you’ve learned something.
One caution before you cut anything
A channel showing zero conversions isn’t proof it does nothing, so test total leads with it switched off before you call it waste.
When to fire your agency and when to fix it
Firing an agency feels decisive. It's also expensive, because the new team needs months to learn your business. Bad results alone don't settle it. Watch how the agency behaves when you hold them to a number.
| Situation | Fix it | Replace them |
|---|---|---|
| The KPI | They agree to one revenue KPI, even if results are behind | They keep steering back to impressions and clicks |
| Accounts | They transfer ownership when asked | They stall, or say the accounts are "theirs" |
| Bad news | They raise problems before you find them | You find problems they didn't mention |
| Changes | They change one thing, measure it, and report what happened | The plan is the same every month |
| Lead counts | The gap with your CRM shrinks once they look into it | The gap stays and nobody explains it |
If you're in the fix column, give them a deadline. Agree on what the KPI should look like by a specific date, usually 60 to 90 days out, and write it down. If they hit it, keep going. If they miss but the reasons are specific and the trend is right, you might extend once. If they miss and the reasons are vague, you have your answer.
In the replace column, do it in order. Get every account transferred first. Export the reports and the conversion history. Then give notice. Doing it the other way around is how owners lose years of data.
And replacing an agency doesn't have to mean hiring another one. Freelancers, an in-house hire or a flat-fee service can fit better, depending on what you're short on. I've laid out the alternatives to a marketing agency and who each one suits.
When tighter oversight is the wrong move
Oversight has a cost, and it's possible to overdo it.
If you spend a few hundred dollars a month on one narrow campaign, full governance may cost more of your time than the campaign is worth. Keep the KPI and the account ownership. Lighten the rest.
Micromanagement backfires too. Rewrite every headline and the agency stops owning results. Hold them to the outcome, and step in on the method only when the outcome misses.
And sometimes the agency isn't the problem. If leads are coming in but sales aren't closing, or nobody calls new leads back for two days, tighter agency oversight won't help. Before you blame the agency, check where the money is leaking. A money leak audit can show whether the problem sits in the ads, the website or the follow-up.
The honest downside of this guide: it needs someone on your side who can read the numbers. Without that person, the agency keeps grading its own work whatever the contract says. That person is often a part-time CMO, and asking these questions every month is a big share of the job. If you go that way, hold them to a number too. Here's how to measure a CMO's performance with the same discipline.
Check your own blind spots first
Before your next agency meeting, run your reports past the Blind Spot Brain. It loads my marketing laws into ChatGPT, Claude or Gemini so you can check your own ads, site and numbers, and spot decimal conversions or blended costs before the agency explains them. The laws behind it are on the marketing laws hub.
Frequently asked questions
Get a second set of eyes on your agency
If you're not sure whether your agency is working or just busy, book a free 2-hour strategy session. We'll go through your real reports and accounts together, and you'll leave knowing which numbers to trust and what to ask your agency next. Rather talk now? Call 214.466.8332.
Phoenix Build Expo 2026
📅 December 9–10, 2026
📍 Phoenix Convention Center - F & G · Phoenix, AZ
Reserve My Seat View ConferenceFree · In-person · Limited seats




