
Lead Research Scientist/Engineer (Embedded Evaluations)
Apollo Research
You can work from
United Kingdom, USA
Countries specified by the employer
About the job
Application deadline: We are conducting interviews actively and aim to fill this role as soon as we find someone suitable.
ABOUT THE OPPORTUNITY
The OpenAI/Hugging Face incident may be the biggest warning shot we get before catastrophic loss-of-control. In its aftermath, Anthropic and OpenAI publicly committed to giving embedded evaluators an unprecedented level of access.
Embedded evaluations are the best existing method to find out whether alignment is on track. With OpenAI predicting an automated researcher by March 2028, we don't have time to start with an MVP embedded evaluation and iteratively improve it. The first embedded evaluations will set the standard and we have to get it right.
Apollo has taken steps toward becoming an embedded evaluator at frontier labs. We want to hire experienced senior researchers with a strong track record of getting things done to execute our embedded evaluation plans.
If embedded evaluations happen, you will be on one of the following teams:
On-site embedded evaluators: This team will spend weeks or months embedded at a frontier AI lab, where they will conduct interviews, review the lab’s evidence, gather new evidence, and write a report. They will execute a playbook quickly and adapt to unforeseen circumstances. We hold our embedded evaluators to the highest standards, so you will likely have to first prove yourself within Apollo before being sent into an embedded campaign. That is, you will probably start on the applied research team to gain context on embedded evaluations. For this team, we prefer candidates with the right to work in the US who can be based in San Francisco.
Applied researchers: This team will be the force-multiplier behind embedded evaluations. They will prepare on-site evaluators before they are embedded and support them while they are embedded. They will do the conceptual work to determine what evidence would support a safety case, and write the playbook for on-site evaluators to optimize how fast they can gather evidence. They will develop tooling for embedded evaluators, both ahead-of-time and urgently on demand. They will be the bridge connecting fundamental research and the on-site evaluators. For example, they might convert the methodology of “Measuring Reward-Seeking via Contrastive Belief Updates” into turnkey code and procedures. This team can work from any of our offices.
Both are high-stakes teams. On-site embedded evaluators should be exceptionally strong at quick execution under high pressure, and very strong at planning and research. Applied researchers should be exceptionally strong at planning and research, and very strong at quick execution under high pressure. For both teams, we are excited for experienced candidates who have owned ambitious projects end-to-end under tight deadlines.
We don’t require a formal background or industry experience and welcome self-taught candidates. We assess demonstrated ability, including through independent research and nontraditional paths; prior formal management titles are not required.
NICE TO HAVES
Software engineering skills: Strong software engineering skills correlate highly with effective execution, even in an era of AI agents. Our entire stack uses Python.
Prior embedded expertise: You have previous experience in professional services like auditing or consulting. You’ve learned lessons from working on-site with clients that will generalize to working with frontier AI labs.
We want to emphasize that people who feel they don’t fulfill all of these characteristics but think they would be a good fit for the position, nonetheless, are strongly encouraged to apply. We believe that excellent candidates can come from a variety of backgrounds and are excited to give you opportunities to shine.
This role offers a market-competitive salary, equity, and competitive benefits.
Depending on your experience, you may be offered a Lead or individual contributor position.
Salary:
Recognised experts who can lead projects of significant scope: USD 350,000 - USD 590,000 or £230,000 - £395,000
Strong individual contributors: USD 245,000 - USD 405,000 or £160,000 - £270,000
Unlimited vacation
Unlimited sick leave
Up to 6 months of paid parental leave
Comprehensive health, dental and vision insurance
Retirement savings with competitive employer matching (e.g. 401(k) for US employees)
Lunch, dinner, and snacks are provided for all employees on workdays
Paid work trips, including staff retreats, business trips, and relevant conferences
A yearly $1,000 (USD) professional development budget
Relocation support and visa fees (if applicable). We are able to sponsor visas to the UK and US.
Time Allocation: Full-time
Location: This is an in-person role working out of our London or San Francisco office.
We prefer on-site embedded evaluators to be permanently located in San Francisco.
Applied researchers can work from any of our offices. We offer flexible working hours and WFH arrangements. Remote candidates will only be considered if they are exceptional and can travel at least 1 week/month to either office.
Visa sponsorship: We sponsor visas in both the UK and US. Sponsorship isn't guaranteed for every role or candidate, but if we make you an offer, we'll work with you to find the right visa route
Posted: 23 days ago