Member of Technical Staff, Coding Agent Research & Evaluations

micro1 is hiring a Member of Technical Staff, Coding Agent Research & Evaluations. This is a remote job – you can work from home in Sri Lanka for a company abroad.

Job summary

• Post: Member of Technical Staff, Coding Agent Research & Evaluations
• Employer: micro1
• Where: Remote – open to Worldwide (includes Sri Lanka)
• Job type: Full-time
• Level: Senior
• Salary: USD 600,000 – 1,300,000 per year
• Apply by: 7 January 2027 (or until the post is filled)

About this kind of job

Technical posts are about installing, checking and repairing equipment or supervising work on site. Safety, practical skill and the ability to solve problems quickly matter most.

What the job involves

• What You'll Do
• Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards
• Lead end-to-end research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation
• Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines
• Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality
• Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities

Working remotely from Sri Lanka

• You need a laptop, a stable internet connection and good written English.
• Check the working hours (time zone) and how you will be paid (for example bank transfer, Payoneer or Wise) before you accept an offer.
• Foreign income received through banks in Sri Lanka may have tax rules – keep your payment records.

Tip from JobPortal

Mention your NVQ, diploma or degree and the machines, tools or projects you have worked with. Apply only through the official link and never pay money to get a job.

Source

This listing comes from Himalayas. Read the full original advert and apply there.