Washington, DC metro area (hybrid/remote considered)
About the Role
We’re looking for an AI/ML Data Specialist to design and deploy AI capabilities — including document ingestion, retrieval-augmented generation (RAG), and secure knowledge-base services — that improve a federal client’s ability to discover, access, and analyze internal information, with guardrails for accuracy, reliability, and human oversight.
Key Responsibilities
- Build automated document ingestion and indexing pipelines for unstructured content
- Develop RAG capabilities for internal information retrieval, combining relevant-document retrieval with LLM-generated, citation-backed answers grounded strictly in internal content
- Deploy secure AI-driven knowledge-base and query services appropriate for internal use
- Define and implement evaluation metrics for accuracy, reliability, bias, and error rate
- Establish AI guardrails, including monitoring, usage boundaries, and human oversight
- Produce comprehensive documentation for models, data flows, interfaces, and evaluation results
- Meet defined performance standards for accuracy, retrieval precision, and citation coverage
Required Qualifications
- Experience building RAG or retrieval-based AI systems, including document ingestion, embedding, and indexing pipelines
- Experience with LLM integration, prompt design, and evaluation of model accuracy, reliability, and bias
- Familiarity with AWS-native AI/ML services and secure deployment of AI applications in a government environment
- Understanding of AI governance and compliance requirements, including guardrails and human-oversight design
- Strong documentation skills for model behavior, limitations, and user expectations
Preferred Certifications
- AWS Certified Machine Learning – Specialty
- AWS Certified Security – Specialty
Additional Requirements
Must be able to pass a federal background investigation prior to starting work and maintain eligibility throughout the engagement. All AI deliverables must comply with applicable federal AI governance requirements.
📢 For Job updates: Follow us on LinkedIn.