Skip to content

AWS releases open-source UAEF agent closed-loop evaluation framework

What happened

AI digest

On 11 November 2026, the AWS Machine Learning Blog released UAEF, an open-source framework for closed-loop evaluation of AI agents across frameworks. Through adapters, the framework converts execution traces from LangGraph, LangChain, Strands Agents, Amazon Bedrock AgentCore and Langfuse into a unified AgentTrace format, then scores them across 7 dimensions with 36 built-in metrics. The framework is now open source; the report does not mention later applications or updates.

Written by AI from the reports · updated 4 d ago

Timeline

Follow the reports to see the event from each side.

Nov 11
  1. AWS Machine Learning BlogSelected
    UAEF: A framework-agnostic system for closed-loop evaluation of AI agents

    The Universal Agent Evaluation Framework (UAEF) is a framework-agnostic system for evaluating AI agents. UAEF converts each framework's traces into one canonical format, scores them with 36 built-in metrics across 7 dimensions, and stores results so teams can compare agent versions and catch regressions.

Heat of this event

Current heat 3·Peak in the comparable range 9(Nov 12 04:00)·Change over 24 hours in the comparable range -49%

02.557.510Nov 1204:00Nov 1218:00Nov 1309:00Nov 1323:00

The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.