AI Engineer (A1022)

As an AI Engineer, you will own the evaluation layer of systems. Your task is to design and implement a structured, configurable evaluation engine that combines deterministic checks with LLM-based verdicts. You will also be responsible for creating calibration workflows using expertly labeled examples and properly measuring precision and recall. A crucial part of your responsibilities will be monitoring drift and initiating recalibration when alignment drops.

• Experience building LLM systems in production where the quality of output mattered.
• Experience building evaluation, QA, or scoring pipelines.
• Ability to understand precision/recall trade-offs in real data.
• Proficiency in strong Python and asynchronous programming.
• Experience deploying services on AWS.

• Opportunity to work on advanced evaluation systems.
• An environment enriched with modern technologies like Python, Docker, PostgreSQL, and cloud solutions like AWS.
• Opportunity to work with cutting-edge AI technologies.
• Working in a team that emphasizes the importance of business outcomes over model parameters.