Remote Data Annotator (Greek) | $15/hr Remote

Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a part-time LLM AI Quality Analyst for a short-term contract role. The analyst will evaluate a personalization feature for Gemini, design conversational prompts, and assess the effectiveness of AI model responses based on various data sources. Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations, Gmail, Google Search, and YouTube activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses without overnarration Perform side-by-side evaluations and stack-rank model responses based on helpfulness, naturalness, and usability Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion Skills Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Greek proficiency (reading and writing) BS/BA degree or equivalent experience in a relevant field (Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or similar) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to evaluate nuanced and ambiguous AI responses Ability to provide structured feedback and clear written explanations Excellent written communication and collaboration skills Ability to work independently in a remote environment Desktop or laptop with a stable internet connection Company Overview Crossing Hurdles connects skilled professionals with opportunities across AI training platforms and high-growth companies. It was founded in 2019, and is headquartered in Gurgaon, Haryana, IND, with a workforce of 51-200 employees. Its website is https://www.crossinghurdles.com. Apply To this Job .