AI Prompt Design and Evaluation Specialist Job at SaidGig, Remote

ZGpXZ1NuYmdpRkJxSDhab1ZiYU1RaG89
  • SaidGig
  • Remote

Job Description

This role offers an exciting opportunity to engage in a high-impact AI research project, collaborating with a leading lab to evaluate advanced language models. As a detail-oriented writing expert, you will craft AI input prompts and assess model outputs, making this position ideal for professionals who excel at translating complex concepts into clear, effective text. Key Responsibilities:

  • Design and Optimize Prompts: Create detailed prompts with multiple constraints and instructions.
  • Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations, choosing and explaining model preferences.
  • Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
Qualifications:
  • Minimum Qualifications:
  • BS or BA from a reputable institution
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for professional questions
  • Use of macOS and/or iOS on a day-to-day basis
  • Based in the US or Canada
  • Preferred Qualifications:
  • 3-6 years of experience in a professional domain such as:
    • Medicine
    • Law
    • Finance
    • Consulting
    • Accounting
    • Data Science
    • Coding
    • Engineering
Work Terms:
  • Commit to at least 20 hours per week
  • Initial commitment of 2-3 weeks, with strong potential to expand
  • Structured project environment with clear goals and tools
Application Process:
  • Complete an AI-led interview, approximately 15 minutes in duration
  • If selected, you will be invited to work on the project

Job Tags

Remote job

Similar Jobs

Solvet

RN - Registered Nurse Job at Solvet

 ...place physicians, advanced-practice providers, allied health and nursing personnel, on short-term and long-term assignments nationwide....  ...(ESI) system Participate in clinical supervision of nursing students, PBNRs, Valor, and new hires through role modeling and... 

HealthPartners

Medical Receptionist Orthpedics Job at HealthPartners

 ...Description TRIA is looking to hire a Medical Receptionist to join our orthopedic team! Come join us as a Partner for Good and help us make an impact on the care and experience that our patients and their families receive every day. Position Summary: The primary... 

SGS Consulting

X-ray Technician Job at SGS Consulting

 ...Job Responsibilities: Verifying patients' identity and reviewing physicians orders before beginning x-ray procedures. Using x-ray equipment to take radiographic images of patients' bones, tissues, and organs as per physicians written orders. Explaining x-ray... 

Reno-Tahoe Airport Authority

Manager of Reno-Stead Airport Job at Reno-Tahoe Airport Authority

 ...Manager of Reno-Stead Airport RenoTahoe Airport Authority (RTAA) Reno, NV The Reno - Stead Airport is a 5,000 acre general...  ...in interacting with the public and providing superior customer service when answering questions or complaints. You are a trusted resource... 

EZ FILE NOW

Licensed CPA or Enrolled Agent (EA) - Independent Contractor | 2026 Tax Season Job at EZ FILE NOW

 ...EZ FILE NOW is expanding its licensed professional division and seeking Certified Public Accountants (CPA) and Enrolled Agents (EA) to support our growing national client base for the 2026 tax season. This opportunity is structured for licensed professionals who are...