How to Tell If Your SEO Agency Is Doing Real Work

A good mechanic shows you the old part before he throws it away. SEO works the same way, except too many agencies skip the part where they show you the old part. They hand you a report with upward-trending graphs and expect that to be enough.

By the end of this, you’ll know exactly what to check in your agency’s reporting, where the numbers can be quietly massaged, and what a real six-month trajectory should look like for a business actually getting value from organic search.

Prerequisites:

• Login access to your Google Analytics account (not just the agency’s dashboard)
• Access to Google Search Console for your domain
• At least two to three months of reports from your current agency
• A list of your actual revenue-producing products or services

Check your first deliverables for a technical audit and baseline report

Any agency worth paying starts with a technical audit. This means checking crawl errors, broken links, slow load times, and structural problems on your site, then compiling that into a baseline report before-and-after comparisons, according to Boulder SEO Marketing. If you never got one of these in your first month, that’s worth asking about directly.

The trade-off here’s time versus proof. A proper audit takes real hours, and some agencies skip it to get straight to “visible” work like content or outreach, because that’s what clients notice first. But skipping the audit means nobody has a true starting point. Six months from now, when they tell you rankings improved, you won’t be able to check that against anything real.

The monthly reporting package matters just as much. A complete one includes an executive summary, a performance overview, tactical recommendations, a technical health overview, a content and link overview, and a forward-looking plan, per Magnified Media’s breakdown of SEO reporting. Notice how specific that list is. It’s not just “traffic went up.” It’s a structured document that ties technical work to content work to what’s coming next.

If your reports are a single screenshot of a traffic graph with no narrative around it, you’re not getting a report. You’re getting a screenshot. Ask yourself: could you hand this report to someone else in your company and have them understand what was done and why? If not, something’s missing.

Audit keyword search volumes to uncover vanity metrics

Here’s a contrast worth checking yourself: an agency reports you’re ranking number one for fifteen keywords, but can’t tell you how many people actually visited your site from those rankings or whether those visitors did anything useful, as described in this breakdown of real SEO work versus reporting theater. That’s the most flattering number on the page, and it’s hiding the ones that matter.

Pull up the keywords your agency highlights in their reports. Check them against Google Search Console, or just ask for the monthly search volume on every term they’re featuring. If most of those terms pull under 50 searches a month, your agency is optimizing for the report, not your business, according to Rankova’s guide on evaluating agency performance.

This changes how you read every future report. A keyword with 30 monthly searches that you now rank number one for sounds impressive. It isn’t moving revenue. What you want tracked instead are rankings for commercial, revenue-producing terms, the ones tied to what customers actually search before they buy, improving over time rather than staying flat while vanity terms climb, per GoBig’s SEO agency accountability guide.

Here’s the catch: low-volume keywords aren’t automatically bad. Long-tail terms can convert well precisely because they’re specific. The problem isn’t that the term has low volume. It’s when an agency fills a report with dozens of low-volume wins and zero mention of how your money keywords, the ones tied to what you sell, are actually tracking. That imbalance is the signal.

Verify reporting against raw analytics exports

An agency tells you your site saw a 200 percent increase in organic traffic, a 50 percent jump in conversions, and 100 new backlinks since they started. Sounds great. Have they shown you the actual numbers behind that claim, or just the claim itself? Without hard data, you have no way to know if something’s exaggerated, according to BusinessCollective’s red flags guide for hiring an SEO company.

This is why a direct export from Google Analytics matters more than any custom dashboard. If your reports live in a slick third-party tool or a manually built spreadsheet that doesn’t trace back to an original data source, you’re trusting a middleman you can’t verify. Ask to see the raw numbers during a screen share, pulled live from Analytics, not copied into a branded template days later.

The implication isn’t that every custom dashboard is dishonest. Plenty of agencies build dashboards for clarity, not concealment.

The second piece is cadence. You should get status updates at least once a week, or at minimum once a month, and whenever traffic or conversions drop, a good agency tells you and brings a plan to fix it, per the same BusinessCollective guide. Silence during a bad month is worse than the bad month itself. An agency that goes quiet when numbers dip isn’t managing your account, it’s hoping you don’t notice.

Track inbound lead growth by month six

Six months in, and the phone still isn’t ringing any more than it was before you signed the contract. That’s the risk every business owner outsourcing SEO is actually worried about, and it’s the right thing to worry about, because the whole point of organic search is new business reaching you through channels that weren’t producing before, as GoBig’s agency evaluation piece puts it plainly.

Rankings and traffic are leading indicators. Leads and sales are the proof. So by month six, you should see new business coming in that you can trace to organic search, and you should be able to ask new customers how they found you. If “Google” is becoming a more common answer over those six months, the work is paying off.

The month-over-month organic traffic trend gives you an earlier read before leads fully show up. A 15% month-over-month increase, for example, suggests last month’s changes are having a practical effect, according to Magnified Media’s reporting guidance.

That doesn’t mean every month needs to hit that exact figure. SEO is uneven by nature, some months are flat while content gets indexed or links get built. But a flat line for six straight months with no explanation isn’t a slow ramp. It’s a stall.

The option that addresses this risk is simple to execute even if it’s uncomfortable to ask for: request a direct comparison of organic traffic and organic leads this month versus last month versus six months ago, laid out side by side. If your agency can’t produce that comparison without scrambling, that tells you something on its own.

Troubleshooting

The agency’s numbers don’t match your own Google Analytics. Request a live screen share where they pull data directly from Analytics in front of you, not a pre-built export. A mismatch here’s the single clearest red flag in this whole process.
Reports look full but you can’t explain what happened last month. Ask for one sentence per section: what was done, why, and what it changed. If they can’t summarize their own report in plain language, the report exists for your eyes, not your decisions.
Traffic is up but leads aren’t. Check whether the keywords driving that traffic are commercial or informational. Rising traffic from topics unrelated to what you sell won’t move revenue no matter how good the chart looks.
Your agency’s reports show strong numbers, but visits are coming from the wrong geography. Filtering performance by location can catch this. A business that sells only in the US but shows a big share of traffic from overseas visitors is seeing a false signal, not real growth, a distortion Improvado’s look at geographic reporting flags directly.

Frequently Asked Questions

How long should I wait before judging if my SEO agency is working?

Give it six months before drawing firm conclusions, since that’s the window where inbound leads from organic search should start showing measurable movement, according to GoBig’s guide on evaluating agency performance. Before that point, judge the process: audits, reporting cadence, and whether technical issues are getting fixed, since those are the groundwork leads depend on later.

What’s the difference between vanity keywords and money keywords?

Vanity keywords are low-volume or tangential terms that make a ranking report look impressive without tying to revenue, while money keywords are the commercial search terms your actual customers use before buying. If most of your reported rankings sit under 50 monthly searches, you’re likely looking at vanity terms rather than terms driving your business forward, per Rankova’s keyword audit method.

Should my SEO reports come directly from Google Analytics?

Yes, or at minimum, your agency should be able to show you the same figures live inside Analytics during a call. Reports built entirely in spreadsheets or branded dashboards with no clear link back to the original data source are harder to verify and easier to inflate, as BusinessCollective’s hiring guide points out.

How often should my agency update me if results are down?

At least once a month, and ideally once a week, with a clear explanation and plan whenever traffic or conversions drop, per BusinessCollective’s red flags piece. Silence during a slow stretch is a worse sign than the slow stretch itself.