🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Role Overview: We are hiring for one of our clients, seeking an AI Evaluation Analyst to assess and improve the performance of AI models. The role involves designing evaluation frameworks, analyzing model outputs, and ensuring alignment with business objectives. Key Responsibilities: • Design and implement evaluation frameworks to assess AI model performance. • Analyze model outputs to identify strengths, weaknesses, and areas for improvement. • Collaborate with cross-functional teams to define evaluation criteria and metrics. • Document evaluation results and provide actionable insights for model refinement. • Ensure evaluations are scalable, reproducible, and aligned with industry standards. Required Skills & Qualifications: • Experience with AI model evaluation, including benchmarking and validation. • Proficiency in Python and relevant libraries (e.g., Pandas, NumPy, Scikit-learn). • Familiarity with evaluation metrics such as accuracy, precision, recall, and F1-score. • Experience with machine learning frameworks (e.g., TensorFlow, PyTorch). • Strong analytical and problem-solving skills with attention to detail. • Ability to communicate technical findings to non-technical stakeholders.