/ source conflict / AI verification / case review
Handling Contradictory Sources in AI Verification
When documents disagree, AI should show the conflict and source strength rather than choosing a neat answer.
Supplier files often contain contradictions. A website shows one company name, a license shows another, the invoice uses a third, and the bank account belongs to a fourth. AI can help only if it keeps the conflict visible.
Rank sources by strength for the specific question. A business license may anchor legal identity. A bank document anchors payment route. A website footer may support branding but should not override official or transaction documents.
Ask the system to present conflicts in a matrix. Field, value, source, date, and reviewer status work better than a paragraph that tries to reconcile everything.
Do not force contradiction into a pass or fail too early. Some conflicts have normal explanations. Others reveal hidden intermediaries. The analyst needs source visibility before deciding.
The final note should say how the conflict was resolved. If the supplier provided authorization or corrected the invoice, record that outcome.
Working checklist
- Keep all conflicting fields visible.
- Rank source strength by question.
- Use a matrix for review.
- Avoid premature pass or fail labels.
- Record how the conflict was resolved.