ML Engineer - LLM & Agentic Evaluations · Turing
Turing lists an AI-training opportunity for ml engineer - llm & agentic evaluations. Confirm requirements, eligibility, and task availability on the original listing.
Not disclosed — Unknown. LATAM Evaluation Process Technical Interview. Specific opening; active.
Requirements
Requirements Currently pursuing or recently completed a Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Data Science, Mathematics, or a related quantitative field. Strong programming skills in Python, including familiarity with the standard data and ML stack (NumPy, Pandas, Jupyter, etc.). Working understanding of how modern LLMs are trained, prompted, and evaluated. Experience interacting with LLM APIs (OpenAI, Anthropic, Google, open-source via Hugging Face / vLLM, etc.). Strong analytical and writing skills — ability to clearly document tasks, results, and recommendations. Comfortable working independently in a fully remote environment with overlapping collaboration hours. Nice to Have Prior experience designing or running LLM evaluations or benchmarks (e.g., MMLU, GPQA, SWE-bench, GAIA, AgentBench, BIG-bench, HumanEval, TerminalBench, WebArena). Hands-on experience with AI agent frameworks (LangGraph, AutoGen, CrewAI, OpenAI Agents SDK, etc.) or building tool-using agents from scratch. Familiarity with LLM-as-a-judge methodologies, inter-annotator agreement, a
Publisher checked 2026-11-21T18:24:19.244Z.