AWS releases open-source UAEF agent closed-loop evaluation framework
What happened
On 11 November 2026, the AWS Machine Learning Blog released UAEF, an open-source framework for closed-loop evaluation of AI agents across frameworks. Through adapters, the framework converts execution traces from LangGraph, LangChain, Strands Agents, Amazon Bedrock AgentCore and Langfuse into a unified AgentTrace format, then scores them across 7 dimensions with 36 built-in metrics. The framework is now open source; the report does not mention later applications or updates.
Written by AI from the reports · updated 4 d ago
Timeline
Follow the reports to see the event from each side.
- AWS Machine Learning BlogSelectedUAEF: A framework-agnostic system for closed-loop evaluation of AI agents
The Universal Agent Evaluation Framework (UAEF) is a framework-agnostic system for evaluating AI agents. UAEF converts each framework's traces into one canonical format, scores them with 36 built-in metrics across 7 dimensions, and stores results so teams can compare agent versions and catch regressions.
Heat of this event
Current heat 3·Peak in the comparable range 9(Nov 12 04:00)·Change over 24 hours in the comparable range -49%
The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.