How VetGeni validates its clinical answers

Benchmark gate: a scored run must reach at least 80% MCQ pass rate, 75% clinical-reasoning pass rate, and 90% citation coverage, or the run fails. These floors are pinned by automated tests and can only hold or rise — never be quietly lowered.

Documents still in license review are excluded from the live corpus until cleared — being useful is not a license.

1. 1.Does the tool answer the precise question you are asking?

   Yours to ask — we disclose

   Each VetGeni capability states its job narrowly: draft documentation for veterinarian review, guideline-backed answers with bibliographic citations, dose math relayed only from the verified runtime, and simulated cases for training. VetGeni does not diagnose, and questions outside the corpus get a plain "outside my sources" rather than an improvised answer.

2. 2.Does your patient resemble the population the tool was built on?

   Yours to ask — we disclose

   Every knowledge answer carries its sources — organization, year, DOI — so you can see exactly which guideline an answer rests on and judge its fit to the patient in front of you. The full corpus is listed above; documents still in license review never reach it.

3. 3.Can you supply the correct, complete input the tool needs to be reliable?

   Yours to ask — we disclose

   Verified answers are computed against the patient chart. When the chart lacks what an answer needs — a current weight for a dose, for example — the runtime declines and names what is missing instead of guessing.

4. 4.Has functional testing taken place?

   Met

   Hundreds of automated tests gate every release, and the benchmark floors on this page are pinned by tests that can hold or rise but never quietly fall.

5. 5.Has cross-validation been performed?

   Not applicable

   Cross-validation appraises a model you trained. VetGeni deliberately trains no clinical model of its own — answers come from general-purpose frontier models grounded in the licensed corpus — so we evaluate the assembled system with VetBench instead.

6. 6.Has A/B testing taken place?

   Met

   New grading and answering configurations run in staged shadow evaluations alongside the current production configuration, and are promoted only when they hold or improve results.

7. 7.Has ground-truth validation taken place?

   Met

   The knowledge lane is scored deterministically against fixed answer keys, reasoning rubrics are veterinarian-written, and documentation pipelines are probed against veterinarian hand-corrected gold cases before prompt changes ship.

8. 8.Has performance, robustness, and usability testing taken place?

   In progress — gap stated

   Performance and robustness are tested by VetBench and pinned regression suites, and every production answer stage is flight-recorded. Usability is shaped by daily in-clinic use; formal usability studies have not yet been run.

9. 9.Have ethics and bias testing taken place?

   In progress — gap stated

   The safeguards are tested — verifier and challenger passes, the no-citation-no-clinical-claim rule, and refusal behavior all have automated coverage. A formal bias audit has not yet been conducted, and we state that here rather than imply one.

10. 10.Have cybersecurity and privacy been addressed?

    Met

    Documented plainly on the Security & Data Ownership page, including what we are not: VetGeni holds no company-level SOC 2; our infrastructure providers maintain theirs. Higher-education security documentation is available to institutions on request.

11. 11.Has the tool been tested in the real world, by independent parties, with ongoing quality assurance?

    In progress — gap stated

    VetGeni runs in real clinical use daily, the results above come from a pinned, re-runnable benchmark, and production incidents feed a regression suite so the same failure cannot ship twice. Independent third-party evaluation has not yet happened — we publish our methodology and invite it.

12. 12.Is the tool — and your use of it — compliant with applicable rules?

    Yours to ask — we disclose

    No dedicated regulator certifies veterinary clinical AI today. VetGeni aligns with the data-protection and education-records obligations that apply to it, and the practice-side half of this question — local veterinary rules on records, delegation, and telemedicine — stays with the licensed veterinarian, which is where the statement places it.