About the role
Opportunity Overview
Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job — you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
Provide clear written feedback that helps AI better understand and personalize responses for individual users
Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
Location — Based in Japan and able to work remotely in an asynchronous, self-directed capacity
Language — Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly
AI experience — Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another
Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)
Strong written communication in Japanese
Ability to work independently in a remote, asynchronous environment