Job Description

This role offers an exciting opportunity to engage in a high-impact AI research project, collaborating with a leading lab to evaluate advanced language models. As a detail-oriented writing expert, you will craft AI input prompts and assess model outputs, making this position ideal for professionals who excel at translating complex concepts into clear, effective text. Key Responsibilities:

• Design and Optimize Prompts: Create detailed prompts with multiple constraints and instructions.
• Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations, choosing and explaining model preferences.
• Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

• Minimum Qualifications:
• BS or BA from a reputable institution
• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Significant familiarity with ChatGPT or similar tools for professional questions
• Use of macOS and/or iOS on a day-to-day basis
• Based in the US or Canada
• Preferred Qualifications:
• 3-6 years of experience in a professional domain such as:
• Medicine
• Law
• Finance
• Consulting
• Accounting
• Data Science
• Coding
• Engineering

• Commit to at least 20 hours per week
• Initial commitment of 2-3 weeks, with strong potential to expand
• Structured project environment with clear goals and tools

• Complete an AI-led interview, approximately 15 minutes in duration
• If selected, you will be invited to work on the project

Job Tags

Similar Jobs