HUD (YC W25) is developing agentic evals for Computer Use Agents (CUAs) that browse the web. Our CUA Evals framework is the first comprehensive evaluation tool for CUAs.
Our Mission: People don't actually know if AI agents are working. To make AI agents work in the real world, we need detailed evals for a huge range of tasks.
We're backed by Y Combinator, and work closely with frontier AI labs to provide agent evaluation infrastructure at scale.
About the roleWe're looking for a systems/full-stack engineer to help build out the technical infrastructure that enables comprehensive CUA testing at scale.
ResponsibilitiesBuild out HUD's existing CUA evaluation framework
Optimize our evaluation infrastructure at scale
Technical Skills
Experience with AWS, Kubernetes, Docker, Redis, Linux, Python, PostgreSQL
Systems design, performance security, CI/CD management experience preferred
You may be a good fit if you:
Have hands-on experience with scalable infrastructure design and implementation
Have contributed to large-scale system architecture projects
Built reliable, high-performance distributed systems
Worked with containerized applications and orchestration platforms
Strong candidates may have:
Startup experience in early-stage technology companies with ability to work independently in fast-paced environments
Strong communication skills for remote collaboration across time zones
Familiarity with current AI tools and LLM capabilities
Understanding of LLM evaluation frameworks and methodologies
Evidence of rapid learning and adaptability in technical environments
We prioritize technical aptitude and learning potential over years of experience. Motivated candidates are encouraged to apply even if they don't meet all criteria.
Team & Company DetailsTeam Size: ~15 people currently, mostly full-time in-person, but some remote.
Our team: Our team includes 4 international Olympiad medallists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS etc
Company stage: We have received $2 million in seed funding, plus very strong demand and revenue growth beyond that. We are scaling profitably and fast to meet demand.
Employment: Fulltime.
Location: On-site only, for now. You can join the team in the San Francisco Bay Area or Singapore, offices.
Visa Sponsorship: We provide support for relocation and visas for strong full-time candidates to USA or Singapore. For part-time/contract/internship arrangements, we'll work fully remote (which makes things simpler anyway).
Timeline: Applications are rolling. The process should involve 2 technical interviews and a 1-week work trial.
Due to high volume, we may not actively respond to every application, but feel free to contact us at [email protected] or elsewhere if we missed your application!
.jpeg)
