← Back
Kaiser Permanente cover

Kaiser Permanente · May 2026 - Present · California - Remote

AI Engineer (Contract)

Policy assessment meant analysts manually cross-referencing 5,000+ pages of compliance documentation, roughly three months and 300 analyst-hours per cycle.

In healthcare an answer without a source is a liability, so the system was designed backwards: citations first. Every generated claim carries a page-level source attribution, anything the retriever cannot ground is refused rather than guessed, and humans stay in the loop for sign-off.

The eval set was not synthetic: every analyst rejection became a labeled case, so retrieval was tuned against "would an auditor sign this," not just precision@k.

  • Assessment cycle: 3 months to 1 week, ~300 analyst-hours reclaimed per cycle
  • Citation-backed RAG over 5,000+ pages of compliance docs with source-attribution guardrails
  • LangGraph agents with dynamic prompt routing and multi-tool orchestration
  • RAG knowledge assistant over distributed enterprise sources for self-serve domain Q&A
  • GitHub CI/CD for the agent system, build failures down 65%
RAGLangGraphCI/CDHealthcare