01Roles, skills and tasks / Skill map

2026 Q4 skill 06 of 12

Evals and observability.

Evals from real tasks, tracing, failure analysis.

46%of AI job ads since 1 October ask for Evals and observability01/07
46%of AI job ads ask for itnumber 5 of 12 skills
883AI job ads name itsince 1 Oct 2026
5years, the median askin the 28% of these ads that say
24%are remoteagainst 22% of all AI ads
Who asks for it

Role by role, the ads and the expected level.

The rod is the share of each role's ads that ask for this skill. The beads are the level the role framework expects, from aware to expert.

What comes with it

The skills it travels with.

How much more often each skill appears in these ads than in all AI ads. Above 1× they go together; below, they rarely do.

Tools that stand out

Named far more often here.

Tools named in at least five of these ads, ranked by how much more often than in all AI ads.

The work around it
  • Build agents and tool use27%
  • Ship AI features to production26%
  • Evaluate models and outputs26%
  • Prototype and iterate fast21%
  • Integrate with existing systems21%
  • Train and fine-tune models21%
At what level

The seniority of these ads.

  • Mid39%
  • Senior29%
  • Staff15%
  • Lead7%
  • Intern4%
  • Principal3%
  • Junior1%
  • Head1%
The labs against everyone else

At the AI labs.

AI labs 60%everyone else 45%

The labs ask for this skill more than other employers do.