sei
AI Agents

AI Agents Inside the LOS: The System-of-Record Boundary, the Write-Back Discipline, and the Audit Trail That Survives an Exam

6 min read
Ramkumar Venkataraman
Share

Where Mortgage AI Actually Breaks

The demo works. The model reads the pay stub, calculates the income, clears the condition. Then it meets the loan origination system, and the project stalls for three months. Not because the model got worse, but because the LOS is the system of record for a regulated financial product, and writing to it is a different discipline than reading from it.

We have integrated AI agents with the major origination platforms, and the pattern that separates a shipped agent from a stuck pilot has almost nothing to do with the model. It has to do with how the agent treats the boundary between what it computes and what the LOS records. Cross that boundary carelessly and you get duplicated conditions, overwritten underwriter decisions, and a loan file that cannot pass QC because no one can reconstruct who changed what. This is the architecture we use to keep that from happening.

The LOS Is the System of Record. The Agent Is Not.

Start from the constraint that governs everything else. Encompass, Empower, or whatever platform the lender runs is the authoritative record of the loan. It is what the auditor reviews, what the investor buys against, and what the examiner pulls. The AI agent is a participant in the workflow, not a second source of truth. The moment the agent's internal state and the LOS disagree about the loan, the LOS wins, and the agent has a reconciliation bug to fix.

This sounds obvious and is violated constantly. A team builds an agent that maintains its own model of the loan, makes decisions against that model, and syncs to the LOS on a timer. Between syncs, a human underwriter touches the file in the LOS. Now the agent is acting on stale state, and its next write clobbers the underwriter's change. We have walked into exactly this, and the fix is architectural: the agent reads the current LOS state at decision time, and it never assumes its cached view is authoritative.

Propose, Then Record

The single most important pattern is separating what the agent proposes from what gets recorded. The agent does not write a decision directly into the field the underwriter's determination lives in. It writes a proposal into a staging structure, and a defined event (a human approval, or a rule that the loan meets the criteria for automated recording) promotes the proposal into the system of record. The staging layer is where the agent's confidence, its citations, and its reasoning live. The system-of-record field carries only the recorded value and a pointer back to the proposal that produced it.

This maps directly to the decision-rights line we draw in every deployment. In our loss mitigation architecture and our underwriting work, the agent does the high-volume preparation and a human owns the determination. Propose-then-record is how that line is enforced in the data, not just in the policy document. An examiner reviewing the file sees the recorded value, the human who promoted it, and the full proposal chain behind it. The agent cannot silently become the decision-maker, because it structurally cannot write to the decision field.

Write-Backs Have to Be Idempotent

Origination platforms integrate through APIs and event streams, and those streams are not exactly-once. Webhooks fire twice. A retry after a timeout re-sends a request the LOS already processed. A batch job re-runs after a partial failure. If the agent's write-back is not idempotent, every one of these turns into a duplicated condition, a doubled fee, or a second copy of a document in the file.

We make every write carry an idempotency key derived from the loan, the field, and the logical operation, so a replay is a no-op rather than a duplicate. The agent also reads-before-writes on any field a human might have touched, and it treats a value it did not itself propose as a signal to stop and reconcile, not to overwrite. The cost of a duplicated condition is an annoyed processor. The cost of an overwritten underwriter decision is a manufacturing defect that surfaces in post-close QC or, worse, in a repurchase demand. Idempotency is cheap insurance against both.

The Field Mapping Is Compliance Surface, Not Plumbing

The unglamorous work of mapping the agent's outputs to LOS fields is where correctness lives. A mortgage loan file speaks MISMO and, at delivery, the GSE Uniform Loan Delivery Dataset. When the agent computes qualifying income, that number lands in specific fields that flow to the AUS, to the disclosures, and to the delivery file. Put it in the wrong field and the error propagates through the Loan Estimate, the AUS findings, and eventually the HMDA LAR. We treat the field map as a governed artifact with its own version history, reviewed by someone who knows both the LOS data model and the downstream regulatory reporting, because a mapping error is not a bug that throws an exception. It is a bug that produces a plausible, wrong, recorded value.

Governing the Agent as a Model

An agent that touches income, credit, or pricing is a model, and it is governed as one. SR 11-7, the interagency guidance on model risk management, and the NIST AI Risk Management Framework are the standards the second line will hold the integration to. We covered the model-governance program in our SR 11-7 playbook, and the LOS integration is where that program becomes concrete: the agent's version, the field map's version, the prompt's version, and the retrieval sources are all recorded on every write, so a decision recorded in the LOS on a Tuesday can be reproduced with the exact model configuration that produced it.

That reproducibility is not a nicety. When an examiner questions a recorded decision, "we cannot reconstruct what the model was doing that day" is the answer that turns a question into a finding. The change log we attach to every write carries the model version, the config, the inputs the agent saw, and the human sign-off. It is the SR 11-7 audit trail expressed at the row level.

Data Protection Across the Boundary

The loan file is a pile of nonpublic personal information, and moving it between the LOS and the agent is a GLBA Safeguards Rule event. Our GLBA playbook covers the program; at the integration layer it means the data the agent pulls is scoped to what the task needs, encrypted in transit and at rest, access-logged, and retained on the schedule the lender's policy sets rather than accumulating in the agent's own store indefinitely. The agent is a service that operates on the loan file, not a warehouse that quietly acquires a second copy of every borrower's tax returns.

The Reconciliation Job Nobody Wants to Build

The control that catches the problems the other controls miss is a daily reconciliation between the agent's record of what it wrote and the LOS's record of what it holds. Any divergence (a write the agent believes it made that the LOS does not reflect, a field the agent last proposed that now holds a different value, a condition the agent cleared that reappears) becomes a same-day exception for a human to resolve. Teams skip this because it feels redundant when the write-backs are idempotent and the boundary is clean. It is not redundant. It is how you find the integration bug before the auditor does, and it is how you catch the case where a human change and an agent change collided in a way the write-back logic did not anticipate.

A Rollout That Does Not Corrupt the File

For a lender integrating an agent into an existing origination workflow, the sequence we use:

  • Read-only first. The agent reads the loan file and produces proposals into the staging layer with zero write-back. The team compares proposals to what humans actually recorded, and tunes until the proposals are trustworthy.
  • Shadow write-back. The agent writes to the staging layer in production, promotion stays fully manual, and the reconciliation job runs daily against a live queue.
  • Scoped automated recording. For the narrow, well-understood cases where the criteria are clear, promotion becomes automatic under a rule, with a human review of a sample. Everything else stays manual.
  • Steady state. The automated-recording scope widens only as the evidence supports it, and every widening is a change-control event.

At no point does the agent get unrestricted write access to decision fields. The scope of what it may record automatically grows from evidence, and the reconciliation job runs the entire time.

What We Tell Engineering Leaders

The model is the part everyone wants to talk about and the smallest part of the risk. The integration is where a mortgage AI program either becomes an auditable participant in the loan file or becomes a source of manufacturing defects that surface months later at the worst possible time. Treat the LOS as the system of record it is, keep the agent on the proposing side of a clean boundary, make every write idempotent and logged, and build the reconciliation job you would rather skip. Do that, and the agent survives the first exam, which is the only proof that matters.

Ramkumar Venkataraman

Ramkumar Venkataraman

CTO & Co-Founder

Related Articles

AI Agents

The First 90 Days of a Mortgage AI Deployment: The Controls We Stand Up Before the Agent Touches a Live File

Most mortgage AI deployments fail at the start, when the agent goes live before the controls that make it safe exist. The first 90 days are a control build, not a rollout. What we run in shadow mode before the agent touches a file, why the go-live gate is set per control instead of globally, and how deploying controls-first is also the posture an examiner expects to see.

Sep 11, 20266 min read
Read more
AI Agents

UCC Article 4A and the AI Wire-Verification Architecture: Commercially Reasonable Security Procedures When the Caller Is Verified But the Instruction Is Not

Wire fraud losses are running at multi-billion-dollar annual totals and the legal allocation of those losses runs through UCC Article 4A's commercially-reasonable-security-procedure standard. AI voice authentication of the caller does not, by itself, satisfy the security procedure for a payment instruction. The architecture we run so the bank's Article 4A position holds in court when the instruction was the fraud.

Jun 26, 202614 min read
Read more
AI Agents

Voice Cloning and the End of Voice Biometrics as a Sole Factor: A Caller-Verification Architecture for Banks

Cheap, high-fidelity voice cloning has collapsed voiceprint and knowledge-based authentication as standalone factors on bank phone channels. The NIST 800-63 level we hold caller authentication to, the phishing-resistant factors that survive a synthetic caller, and the agent-side controls we wire around them.

Jun 5, 20267 min read
Read more

BOOK A DEMO

Embed Sei AI in your workflows
Tell us about your operations. We'll show you how Sei handles borrower calls, processes loan documents, and monitors compliance for mortgage lenders and banks.
  • Deploy in weeks, not months
  • Trained on FDCPA, TCPA, TILA, UDAAP, and RESPA
  • SOC 2 Type II and PCI DSS L1 certified
  • Integrates with your LOS, CRM, and telephony

Please provide your full name so we know how to address you.

Tell us which company you represent so we can personalise our response.

Use your work email so we can connect you with the right specialist.

Choose the topics you’d like us to cover during the demo.

Complete the verification to submit the form.

sei

AI operations platform for mortgage lenders, servicers, and banks. Handle borrower calls, process loan documents, and monitor compliance.

© 2026 Sei Software Technologies Inc. All rights reserved.