The Lobbi Delivery Team
Operational Systems Engineering
Picture this. A mid-sized insurance brokerage rolls out an AI-powered retention tool. It's supposed to flag clients at risk of leaving so producers can intervene early. Smart move.
Except the client data feeding the model is a mess: three systems, three different spellings of company names, policy statuses that don't match between the agency management system and the accounting platform, coverage records missing entirely because a legacy migration was never finished. The AI doesn't know any of this. It just runs. Within a week it's surfacing confident recommendations built on garbage, and the agency is making calls to the wrong people about the wrong policies. Nobody catches it for a month.
That's not a hypothetical. It's a composited version of real situations we've seen across regulated industries. And it illustrates a truth that's becoming impossible to ignore: AI doesn't fix bad data. It amplifies it. At machine speed. With machine confidence.
Before you bolt AI onto your operations, you need a source of truth. Not a data warehouse. Not a dashboard. An actual, governed, trustworthy foundation that every system and every person in your organization can rely on.
Let's talk about how to build one.
The Data Quality Crisis Hiding in Plain Sight
Most business leaders think their data is fine. It isn't.
Poor data quality costs the average organization $12.9 million a year (Gartner). For smaller firms, the proportional hit is often worse because there are fewer resources to recover from data-driven mistakes and fewer people to catch them before they cascade [1].
The Federal Reserve's 2024 Small Business Credit Survey found that 73% of small firms experienced financial challenges in the prior year [2]. Dig into the details and a pattern emerges: many of those challenges are operational. Doing the wrong work.
Missing deadlines. Misrouting requests. And at the root of most operational problems? Bad data.
What does bad data actually look like in a regulated business? It's rarely dramatic. It's quiet. Mundane. Easy to dismiss until it isn't.
- An insurance agency has the same client in their CRM, their agency management system, and their quoting platform, each with a different phone number.
- A mortgage broker has a loan file where the borrower's income is entered differently in the 1003 application and the underwriting worksheet.
- A financial advisory firm has client risk tolerance recorded as "moderate" in their planning software and "aggressive" in their trading platform.
- A title company has the property address formatted differently in their title search system, their closing software, and their document management system.
Every one of these is real. And in each case, the business was running fine on the surface, right up until they tried to automate something. Then the inconsistencies went from minor annoyances to operational failures. What a human could paper over with a phone call, software can't.
When AI Meets Messy Data, Speed Becomes the Problem
McKinsey's 2024 State of AI report found that 72% of organizations have adopted AI in at least one business function [3]. But adoption without data readiness is like putting a turbocharger on an engine with dirty oil. You'll go faster. You'll also break faster.
A human clerk might notice that two records don't match. They might pause, double-check, call someone. AI doesn't pause. It processes and moves on. And now you've got a wrong decision propagating through your business at a pace no one can keep up with.
Think about an insurance agency that deploys AI to automate policy renewal recommendations. The AI examines each client's current coverage, claims history, and risk profile to suggest the best renewal option. Sounds great. But what if the claims history is incomplete because some claims were recorded in a legacy system that never got migrated?
The AI underestimates risk. It recommends lower coverage. The client ends up underinsured. And the agency won't know until there's a claim, which is the worst possible time to find out.
Or take a mortgage company using AI to pre-qualify borrowers. The AI pulls credit data, income verification, and property information to generate a preliminary qualification. But the income data in the CRM was entered six months ago, and the borrower has since changed jobs.
The AI pre-qualifies someone who shouldn't be pre-qualified. The loan officer wastes time. The borrower is disappointed. Conversion metrics look good on paper but fall apart at underwriting.
The NIST AI Risk Management Framework calls out data quality as a foundational requirement for trustworthy AI [4]. Not as a nice-to-have. As a requirement. The quality, relevance, and representativeness of your data directly affect the reliability of every AI output. If the foundation is cracked, everything built on it is at risk.
So What Does "Source of Truth" Actually Mean?
It's not a single database. It's not a data warehouse. It definitely isn't a master spreadsheet that someone updates every Friday.
A source of truth is an agreement across your organization about which system holds the canonical version of each important piece of data. It answers one deceptively simple question: when two systems disagree, which one is right?
Getting there requires three things.
1. Canonical Entities
Every business has core entities, the things it actually cares about. For an insurance agency, that's clients, policies, carriers, claims, and commissions. For a mortgage company, it's borrowers, loans, properties, lenders, and documents. For a financial advisory firm, it's clients, accounts, holdings, plans, and compliance records.
Each entity needs a canonical definition. Not just a name, but a schema. What fields define a "client"? What's required versus optional? What format should a phone number be in? What are the valid values for "policy status"?
Salesforce's 2024 Small and Medium Business Trends Report found that 75% of SMBs expect AI to help them compete with larger companies [5]. Here's the catch: larger companies have had data governance programs for years. If you want AI to work for you the way it works for them, you need to define your entities with the same rigor a company ten times your size would.
2. Ownership
Every canonical entity needs an owner. Not a system. A person. Someone who's responsible for the quality of that data and accountable when standards slip.
The client record owner might be the operations manager. The policy data owner might be the account manager. The financial data owner might be the controller. Whoever it is, they need the authority to enforce data standards, and they need visibility into what's actually happening.
The World Economic Forum's Future of Jobs Report 2025 projects that 39% of existing skill sets will be transformed by 2030 [6]. Data stewardship is one of the capabilities that's growing, not shrinking. Investing in data ownership now isn't overhead. It's building a muscle your organization will need more and more.
3. Resolution Rules
When two systems disagree, what happens? You need explicit rules, written down, agreed upon:
- The agency management system is the source of truth for policy data.
- The CRM is the source of truth for prospect and client contact information.
- The accounting system is the source of truth for commission amounts.
- When the CRM and the AMS disagree on a client's address, the AMS wins, and a ticket is created to update the CRM.
These rules sound obvious once you write them down. That's the point. In most organizations, they don't exist. People make ad hoc decisions about which data to trust based on gut feeling, personal preference, or whichever system they happen to be looking at when the question comes up.
Standardize the Vocabulary Across Your Tools
This is where things get practical and where most data quality initiatives either succeed or stall. Every tool in your business has its own vocabulary for the same concepts. That vocabulary mismatch is one of the biggest sources of inconsistency you'll find.
Take something as simple as "lead status" in an insurance agency:
- The CRM might use: New, Contacted, Qualified, Proposal Sent, Won, Lost.
- The quoting platform might use: Draft, Quoted, Bound, Declined.
- The agency management system might use: Prospect, Active, Inactive, Cancelled.
All three are describing aspects of the same customer journey. Different words, different stages, different granularity. When you try to build a report, or when AI tries to make a decision, the mismatch creates confusion at best and wrong answers at worst.
Deloitte's 2025 Tech Trends report talks about "ambient intelligence," AI woven into the fabric of business operations [7]. For that to work, your systems need a shared vocabulary. Otherwise it's like having a translator who speaks three dialects and can't agree with itself on what a word means.
Standardization isn't glamorous, but it follows a straightforward process:
Step 1: Inventory every status field across every tool. List every system, every entity, every status or category field. This is tedious. It's also the most valuable exercise you'll do all quarter.
Step 2: Map those statuses to a canonical set. Create a master list that makes sense for your business. Then map each system's statuses to it.
Step 3: Decide where the mapping lives. It could be in a middleware layer, an integration platform, or a lookup table in your primary system. The important thing is that it exists, it's documented, and someone maintains it.
Step 4: Enforce the mapping in every integration. Every time data moves between systems, it passes through the mapping. No exceptions. No "we'll fix that later."
Gartner's customer service predictions suggest that by 2029, agentic AI will resolve 80% of common customer service issues without human intervention [8]. For that to work in your business, the AI needs to understand what "resolved" means consistently across every system it touches.
Guard the Borders: Data Quality Checks on Inbound Integrations
Data flows between your systems constantly. CRM to email platform. Agency management system to carrier portals. Accounting system to payroll. Each integration point is an opportunity for bad data to enter your ecosystem and spread.
Think of data quality checks at integration points like border control. They inspect what's coming in and make sure it meets your standards before it gets through.
Validation rules. Is the email address formatted correctly? Is the phone number a valid length? Is the policy effective date in the future for new policies, or in the past for renewals?
Completeness checks. Are all required fields populated? Is the client's tax ID present on records that need it? Is the property address complete, including zip code?
Consistency checks. Does the incoming data match what you already have? If a system sends a client record with a different name than what's on file, flag it for review. Don't just overwrite silently.
Deduplication. Is this a new record or an update to an existing one? Matching on a single field like email isn't enough. Use fuzzy matching on name plus address plus date of birth to catch duplicates that differ by a typo or a formatting choice.
Organizations with strong data quality management see significantly better outcomes from their AI and analytics investments (Gartner) [1]. The quality checks aren't overhead. They're the foundation that makes everything downstream work.
NIST's AI framework recommends continuous monitoring of data inputs to AI systems [4]. That monitoring starts at the integration layer. Catch bad data before it enters your system and you don't have to worry about AI making decisions with it.
The Handoff Problem Nobody Talks About
There's a data quality issue that hides in the cracks between workflow steps. Every business process has handoffs. A lead becomes a client.
A quote becomes a policy. An application becomes a loan. At each transition, data should be validated. In most businesses, it isn't.
Consider the moment an insurance quote becomes a bound policy. At that transition:
- The client's information should be verified against the carrier's records.
- Coverage details should match exactly between the quoting system and the AMS.
- The premium should be confirmed.
- The effective date should be within the acceptable window.
- The agent's license should be valid in the state of issue.
If any of these checks fail, the bind shouldn't proceed. But in most agencies, the bind happens in one system, the data gets manually copied to another, and nobody checks the details until there's a problem. By then, fixing it costs ten times what catching it would have.
McKinsey's research on AI adoption maturity shows that the highest-performing organizations automate their quality checks, not just their workflows [3]. The checks are part of the workflow. They aren't a separate activity that someone remembers to do, or forgets.
The Federal Reserve's survey data shows that small businesses are increasingly relying on technology to manage their operations [2]. But technology without quality controls just moves errors faster. Adding validation at workflow transitions is one of the highest-return investments you can make, and one of the least expensive to implement.
What This Actually Looks Like: A Before and After
Let's make this concrete with an example that mirrors what we see regularly.
A mid-sized insurance brokerage runs four main systems: a CRM for prospects and sales activity, an agency management system for policies and client service, a comparative rater for quoting, and an accounting system for commissions and billing.
Before building their source of truth:
- Client data lived in all four systems with no clear primary. Each system had its own version of the truth.
- Policy status was defined differently in the AMS and the accounting system. "Active" in one didn't always mean "active" in the other.
- New client records were created in the CRM by sales, then re-entered manually in the AMS by service. Typos and inconsistencies were the norm, not the exception.
- Commission calculations ran off accounting system data, which sometimes lagged behind the AMS by weeks.
- When they tried to implement AI-powered client retention predictions, the model performed poorly. Not because the model was bad, but because the data was inconsistent across systems.
After building their source of truth:
- They designated the AMS as the canonical source for all client and policy data.
- The CRM became the canonical source for sales pipeline and prospect data.
- A middleware integration synced client records from the CRM to the AMS when a prospect converted, with validation checks at the transition point.
- Status fields were standardized across all four systems, with a mapping table maintained by the operations manager.
- Data quality checks were added to every integration: email validation, address standardization, phone number formatting, duplicate detection.
- Each canonical entity got a named data owner.
- Data quality metrics were reviewed monthly.
The AI retention model worked after that. Not because they changed the model. Because they fixed the data.
The Cost of Ignoring This
The cost of bad data isn't just the $12.9 million figure Gartner cites for large enterprises [1]. For smaller firms, it shows up differently, but it's no less painful.
Wasted labor. People spend hours reconciling data between systems, tracking down the "right" number, fixing errors that shouldn't have happened. Salesforce reports that the average SMB employee spends significant time on repetitive manual tasks that could be automated [5]. But you can't automate a process that runs on inconsistent data. Automation without clean data just produces wrong answers faster.
Compliance risk. In regulated industries, wrong data isn't just inefficient. It's dangerous. A wrong address on a policy document.
A wrong beneficiary on a life insurance policy. A wrong income figure on a mortgage application. Each of these can result in regulatory action, lawsuits, or financial loss. And "our system had bad data" isn't a defense that regulators find compelling.
Failed AI initiatives. This is the big one. You invest in AI, it doesn't work, and the organization concludes that "AI isn't ready for us." But AI was ready. Your data wasn't. That's an expensive misdiagnosis, because now you've poisoned the well for future AI investment.
Eroded customer trust. When a client calls and your team has different information on different screens, confidence erodes fast. Gartner's customer service research shows that consistency is one of the top factors in customer satisfaction [8]. Inconsistent data creates inconsistent experiences, and clients in regulated industries have especially low tolerance for it.
The World Economic Forum projects that data and AI capabilities will be among the fastest-growing skill demands through 2030 [6]. Organizations that build their data foundations now will be positioned to adopt AI as it matures. Organizations that don't will find themselves locked out, not because the tools aren't available, but because their data can't support them.
A Practical Path Forward
You don't need a multi-million dollar data governance program. You need to start with the basics and build from there. Here's a realistic timeline.
Weeks 1-2: Inventory
List every system that holds business data. For each one, document the entities it contains (clients, policies, accounts, etc.) and the key fields for each entity. This is your data landscape. It doesn't have to be pretty. It has to be complete.
Weeks 3-4: Define Canonical Sources
For each entity, decide which system is the canonical source. Document this in a simple table. Get leadership to sign off. This step sounds easy, but it often surfaces disagreements that have been simmering for years. That's a feature, not a bug.
Month 2: Standardize Taxonomies
Pick the three most important status fields. They're probably lead status, policy status, and payment status. Map them across all systems. Build the canonical set. Start enforcing it in your integrations.
Month 3: Add Quality Checks
Start with your highest-volume integration. Add validation, completeness, and consistency checks. Measure the failure rate. You'll likely be surprised by how high it is. Fix the most common failures first and work your way down.
Month 4: Assign Owners
Name a data owner for each canonical entity. Give them access to quality metrics. Meet monthly to review trends. Make data quality part of someone's job description, not just something that happens when there's a crisis.
Ongoing: Monitor and Improve
Data quality isn't a project with an end date. It's a practice. Build it into your operating rhythm. Review metrics.
Fix issues. Update standards as your business evolves. The organizations that treat data quality as continuous get compounding returns. The ones that treat it as a one-time cleanup end up right back where they started.
The Bottom Line
AI is coming to every regulated industry. Insurance. Mortgage.
Financial advisory. Healthcare. The question isn't whether you'll use AI. It's whether your data is ready for it.
If your data is clean, consistent, and governed, AI will make your business faster, smarter, and more competitive. If it's messy, inconsistent, and unowned, AI will make your mistakes faster, bigger, and more expensive. Same technology. Radically different outcomes. The variable is the data underneath.
Build the source of truth first. Everything else gets easier after that.
If you want help figuring out where your data stands today and what to fix first, that's exactly what we do at The Lobbi. No jargon. No multi-year roadmap. Just a practical assessment and a clear path forward.
Book a discovery call at thelobbi.io/discovery.
Topic clusters
Ready to see where the friction is?
The Lobbi's Operations Discovery maps your workflows, identifies your highest-impact bottlenecks, and gives you a clear picture of what's possible.