When we started SignalPost Media, the pitch was simple: use AI to write social media content for local businesses at scale, faster and cheaper than a traditional agency. But we had an honest question we needed to answer first — does AI-generated content actually perform?
We ran a 90-day controlled experiment across 12 local business clients to find out. The methodology wasn't perfect, but the results were clear enough to act on.
The Experiment
We split each client's content into two types: posts written entirely by our AI system (trained on their business profile, tone, and services) and posts written by a human copywriter using the same brief. Both sets were reviewed and approved by the client before publishing. We tracked reach, engagement rate, saves, and direct lead attribution over 90 days.
What We Found
The headline result surprised us: AI-written content performed within 8% of human-written content on reach and engagement metrics. For educational posts and tips, AI actually outperformed human writers on average — likely because the AI was more consistent with structure, headline hooks, and call-to-action placement.
AI content avg. engagement rate: 4.2% · Human content avg. engagement rate: 4.6% · Difference: -8.7% · AI cost per post: ~$2.40 · Human cost per post: ~$85–$120
Where AI Fell Short
The gap was most visible in storytelling posts — content that required nuance, humor, or a personal anecdote. "My tech Marcus drove 40 miles in a hailstorm to fix a family's AC on a 104°F day" is a story that a human writer who knows Marcus can tell compellingly. An AI writing it from a brief produces something technically correct but emotionally flat.
"The best results came from combining both: AI handles the structure, consistency, and volume. Humans add the stories, the warmth, and the moments that make a brand memorable."
The Right Way to Use AI for Social Content
Our conclusion after 90 days: AI is exceptional at handling the 80% of social content that needs to be consistent, professional, and on-brand but doesn't require deep human emotion. Educational tips, service spotlights, promotional posts, review graphics, seasonal reminders — AI handles all of these at a fraction of the cost with comparable performance.
The remaining 20% — your brand stories, your milestone moments, your genuine customer narratives — those benefit from a human touch. The businesses that understand this distinction and allocate accordingly get the best results.
What This Means for Local Business Owners
If you've been avoiding AI-generated content because you're worried it'll sound generic — your concern is valid but manageable. The key is in the quality of the inputs: the more specific your business profile, tone guidelines, and service descriptions, the better the AI output. Generic brief = generic content. Detailed brief = surprisingly compelling content.