As an AI Quality Analyst, you will evaluate a new personalization feature for Gemini. You will assess how well the model uses information from your past Gemini conversations, Gmail, Google Search, and YouTube activity to make responses more relevant and helpful. This role requires a unique blend of creativity and analytical rigor. You will actively design prompts from the perspective of your own personal experiences. You will then use your analytical skills to assess the quality of the model's personalized responses, evaluating dimensions like Grounding, Integration, and Helpfulness.
You will work as part of a multilingual team focused on languages such as Italian, German, French, Polish, Dutch, Bulgarian, Danish, Finnish, Greek, Norwegian, Romanian, and Swedish. This is a short-term contract lasting one month and requires a four-hour overlap with the PST time zone. Candidates must be comfortable using their primary personal Google account to facilitate a genuine assessment of the personalization features. This is a fully remote position available to candidates in Bangladesh and several other eligible countries.
Key Requirements
Language Proficiency in one of the focus languages (Italian, German, French, etc.).
Ability to read and write in the focus language with a high degree of complexity.
Willingness to use a primary personal Google account for testing purposes.
Exceptional analytical thinking to evaluate nuanced and ambiguous AI responses.
Experience in creative prompt engineering and designing multi-turn prompts.
Superior written communication skills for writing clear and structured rationales.
Ability to provide constructive feedback and detailed annotations.
Functional desktop or laptop setup with a stable internet connection.
Ability to work a schedule with a 4-hour overlap with PST time zone.
Commitment to a 1-month short-term contract duration.
Knowledge of Google ecosystem services like Gmail, Search, and YouTube.