We're looking for a Freelance Agent Evaluation Engineer to create challenging tasks and evaluation criteria for AI coding agents, with a focus on testing and improving AI systems.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, or related fields
- 5+ years of software development experience, primarily in Python
- Background in full-stack development with experience in React-based interfaces and robust back-end systems
- Experience writing tests, including functional and integration tests
- Familiarity with Docker containers, infrastructure tools (Postgres, Kafka, Redis), and CI/CD (GitHub Actions)
Benefits
- Opportunity to work on challenging projects with leading tech companies
- Competitive hourly rate ($50/hour equivalent)
- Flexibility to work part-time and choose own pace
Originally posted on Himalayas