01Roles, skills and tasks / Skill map
2026 Q4 skill 06 of 12
Evals and observability.
Evals from real tasks, tracing, failure analysis.
46%of AI job ads since 1 October ask for Evals and observability01/07
46%of AI job ads ask for itnumber 5 of 12 skills
883AI job ads name itsince 1 Oct 2026
5years, the median askin the 28% of these ads that say
24%are remoteagainst 22% of all AI ads
Who asks for it
Role by role, the ads and the expected level.
The rod is the share of each role's ads that ask for this skill. The beads are the level the role framework expects, from aware to expert.
- Agentic AI Engineer69%Fluent
- Applied AI Engineer57%Expert
- AI Platform Engineer55%Fluent
- AI-Native Architect53%Expert
- AI-Native Developer45%Working
- Applied AI Researcher38%Expert
- Forward Deployed Engineer33%Fluent
- AI Solutions Architect29%Working
What comes with it
The skills it travels with.
How much more often each skill appears in these ads than in all AI ads. Above 1× they go together; below, they rarely do.
Tools that stand out
Named far more often here.
Tools named in at least five of these ads, ranked by how much more often than in all AI ads.
LangSmith 2.2×Braintrust 2.2×Langfuse 2.2×LiteLLM 2.2×Claude API 2.2×OpenRouter 2.2×Modal 2×Agent Skills 1.9×Temporal 1.9×OpenSearch 1.9×
The work around itAt what level
The seniority of these ads.
The labs against everyone else
At the AI labs.
AI labs 60%everyone else 45%
The labs ask for this skill more than other employers do.
Problems that test it
Where this skill earns its keep.
Next steps
Learn it, practise it, prove it.
Check your fit Paste your CV and see how it scores on this skill and the rest, with what to learn next.Practise with the tools 163 tools on the map for this, starting with Running in production.Prove it 9 certificates in the track Build with LLMs and agents, each checked on the provider's page.Learn the words 10 terms in plain words: Evaluation.See the roles What each role does all day, and the level of this skill it expects.Read the market The heatmap, the labs, the stack and how AI reaches other jobs.