MLflow Release Notes

MLflow 3.15.1 is a patch release that includes bug fixes and documentation updates.

Bug fixes:

• [Model Registry] Skip env_pack on ARM client images (#24762, @qyc)
• [Scoring / Tracking] Harden version parsing against missing/non-PEP440 versions on Databricks Serverless (#24799, @PattaraS)

Documentation updates:

• [Docs] Clarify scorer versioning documentation (#24769, @nihalmenon)

For a comprehensive list of changes, see the release change log, and check out the latest documentation on mlflow.org.

MLflow 3.15.0 includes several major features and improvements

Major New Features

🧩 MCP Registry: A centralized catalog for registering, versioning, and sharing Model Context Protocol servers — with semantic-versioned configs, promotable aliases, tags, auto-discovered tools, and ready-made connection instructions for Claude Code and .mcp.json. Manage it from the UI, REST API, or Python!

🤖 MLflow Assistant enhancements: The in-app AI assistant now supports multiple LLM providers (Claude Code, Codex, and OpenAI-compatible/Gateway endpoints) chosen from a single settings page, displays live per-session token usage and estimated cost in the composer, and is easier to set up — mlflow agent setup can enable it in one prompt, with API keys stored securely in the Gateway's LLM Connections.

🗂️ Sharable table views: Save named views of the Runs table — capturing columns, order, widths, filters, and sort — and share them by URL.

⚡ Proxy-less artifact upload/download via presigned URLs: Large artifact transfers can now bypass the tracking server and talk directly to cloud storage (e.g. S3) through presigned URLs, cutting server load and timeouts on big files. We fall back to proxied transfer automatically for backward compatibility.

🖼️ Multi-modal attachments in LLM judges: {{ trace }} judges created with make_judge() can now see images captured in trace spans via a new get_span_image tool, which fetches attachments as base64 data URLs and passes them to multimodal models (Anthropic, Gemini, and OpenAI-compatible via litellm) — enabling evaluation of vision tasks, screenshots, and other visual content.

Other Assorted Features & Improvements:

• [Tracing / Tracking] Add Pydantic AI 2.x autologging support (#24721, @B-Step62)
• [Tracing / UI] [3/3] Add action recommendation for low-value issue detection result (#24580, @B-Step62)
• [Gateway] Support per-endpoint budget policies in the AI Gateway (#24370, @joelrobin18)
• [Evaluation / Gateway] Add sap-ai-core:/ provider for SAP AI Core Orchestration v2 with extra_headers support (#24356, @shivamxtech)
• [Model Registry] [Model Registry] Migrate UC model artifact download to native temp-creds (#24576, @AknA13)
• [Gateway / Tracing / UI] [2/3] Simplify issue detection start modal (#24579, @B-Step62)
• [Tracing / UI] [1/3] Run issue detection in the background (#24578, @B-Step62)
• [Tracing] [BUG] Fix otel parent context propagation (#24444, @iyashk)
• [Model Registry] [Model Registry] Gate UC model-registry client on native /api/2.1 endpoints (#24517, @AknA13)
• [Docs / Tracking] Enable artifacts-only mode with workspaces (#24452, @kramaranya)
• [Tracing / UI] Stop eagerly prefetching full neighboring traces in tracing UI (#24411, @DaoDaoNoCode)
• [Docs / Gateway] Authenticate OpenAI-protocol coding agents through the RBAC gateway (#24294, @joshuawong-db)
• [Tracing] feat: add search traces to typescript sdk (#23660, @WUMIKE233)
• [Prompts / UI] Add per-tool cards with a Monaco JSON editor and Format action to the Playground (#24129, @tanghaoji)
• [Prompts / UI] Redesign Playground Tools settings with an Add-tools entry flow (#24102, @tanghaoji)
• [] feat: add Cursor model catalog with Auto and Composer 2.5 pricing (#24078, @TomeHirata)
• [Tracing / Tracking] Support numeric assessment trace filters (#23948, @tanghaoji)

Bug fixes:

• [Tracing] Compute mlflow.llm.cost for Claude Code plugin traces on Databricks (#24416, @harupy)
• [UI] Fix artifact direct download capability checks in UI (#24748, @B-Step62)
• [Tracing / UI] Refresh traces saved-view on load across multiple windows (#24746, @joshuawong-db)
• [UI] Fix UnauthorizedError constructor message (#24729, @mihir2921)
• [UI] Fall back to nested spans for Chat Sessions turn content (#24703, @MannXo)
• [Tracing / Tracking] Fix experiment GC cascades for traces and logged models (#24351, @copilot-swe-agent)
• [Tracking] Fix workspace-enabled tracking store crash-loop when the default experiment is renamed (#24598, @daniellok-db)
• [Tracking] Fix Kubernetes auth token extraction for kubernetes-client 36+ (#24687, @HumairAK)
• [UI] Refresh Assistant config when leaving settings so the provider indicator isn't stale (#24704, @joshuawong-db)
• [Build] Fix imagePullSecrets for garbage collection CronJob (#24626, @nightcityblade)
• [UI] Lift Assistant floating button above bottom-pinned action bars (#24606, @joshuawong-db)
• [Evaluation / Tracing] Fix issue detection structured output schema (#24674, @B-Step62)
• [Models] Add MLFLOW_ALLOW_PICKLE_DESERIALIZATION guard to mlflow.statsmodels flavor (#24686, @B-Step62)
• [Tracking] Preserve static prefixes in notebook trace renderer URL (#24682, @mprahl)
• [UI] Fix blank and fields in run detail sidebar (#24634, @aishdbx)
• [Models / Scoring] Normalize reasoning content parts for ChatAgentMessage in parse_message (#24642, @iyashk)
• [UI] Fix Evaluation Runs Actions dropdown remaining clickable when no runs are selected (#24676, @daniellok-db)
• [UI] Surface truncated assistant streams as errors instead of a silent done (#24603, @joshuawong-db)
• [Tracking] Honor experiment grants on --artifacts-only servers when workspaces disabled (#24585, @PattaraS)
• [Tracking / UI] Bound get-history-bulk-interval memory by sampling metric history by row (#24305, @Mytolo)
• [Tracking] [BUG] Enforce artifact authorization on presigned download route in basic-auth (#24571, @iyashk)
• [Evaluation] Preserve explicit expectations in mlflow.genai.evaluate (#24561, @yangbaechu)
• [Gateway / UI] Support Portkey routing configuration in the AI Gateway (#24398, @rs-03)
• [UI] Show input modal submission errors inline instead of a transient toast in GenericInputModal (#23918, @Vedant-Agarwal)
• [Evaluation / Tracking] Enforce experiment permission on online scoring config endpoints (#24562, @aaronteo-db)
• [Tracing / Tracking] Propagate contextvars into trace read thread pool workers (#24456, @iyashk)
• [] Fix Windows path handling in artifact downloads (#20225, @acepace)
• [UI] Fix sidebar navigation and workflow type not updating on URL navigation or browser Back/Forward (#22116, @DaoDaoNoCode)
• [Gateway] Don't send stream_options from the Assistant to the gateway (#24552, @joshuawong-db)
• [Evaluation] Fix MemAlign guideline distillation against Databricks structured-output models (#24547, @veronicalyu320)
• [UI] fix: sort tags alphabetically in runs tag multiselect dropdown (#24134, @mysticalayushi)
• [Tracing] Fix LLM cost on autologged ChatDatabricks traces by preferring ls_provider (#24185, @james-fletcher-db)
• [Tracking] Fix pytorch pt2 export for batch-size-1 input_example (use Dim.AUTO) (#24494, @B-Step62)
• [Tracing / Tracking] Fix double-counted trace token usage for rollup parent spans in SqlAlchemyStore.log_spans (#24339, @gauthierpiarrette)
• [Tracking] Fix MlflowSparkStudy pruner and direction handling (#24425, @hellocybernetics)
• [Gateway / Tracing / UI] Fix gateway Try-in-Browser traces rendering as raw kvlist data in the UI (#24400, @joelrobin18)
• [UI] Fix role modal resource pickers failing with FEATURE_DISABLED when workspaces are disabled (#24441, @joelrobin18)
• [Model Registry] [Model Registry] Restore oneof on TemporaryCredentials.credentials (#24489, @AknA13)
• [UI] [fix] Fix runs-table column reordering before pinned anchors (#24465, @joshuawong-db)
• [UI] Fix admin permission grants failing with FEATURE_DISABLED when workspaces are disabled (#24383, @joelrobin18)
• [UI] Fix Columns dropdown anchoring on the runs table (#24419, @joshuawong-db)
• [UI] Fix artifact viewer crash on text files with many lines (#23899, @jayceguo)
• [Tracing] Fix async trace export dropping workspace context (#24093) (#24275, @vatsalyd)
• [Tracing] fix: store OpenAI agent Generation span attributes under correct SpanAttributeKey constants (#24290, @RudraDudhat2509)
• [Tracing / Tracking] Fix Postgres deadlock between start_trace() and log_spans() on trace metadata (#24338, @joshuawong-db)
• [Tracing / Tracking] Avoid eager span deserialization for TRACKING_STORE trace reads. (#24331, @shivamAmrutia)
• [Gateway] Resolve workspace context before running FastAPI auth validators (#24368, @joelrobin18)
• [Tracing] Fix RecursionError corrupting deeply nested traces (#24362, @joshuawong-db)
• [Evaluation / Tracing] Fix genai.evaluate crash when a cloned trace is unavailable (#24357, @joshuawong-db)
• [Scoring] Handle uncut {major}.x minor in DatabricksRuntimeVersion.parse (#24353, @PattaraS)
• [Evaluation / Tracing] Fix basic-auth before-request validators invoking view functions (#24354, @joshuawong-db)
• [UI] Fix promo modal focus (aria-hidden) and show it on the empty models page (#24278, @aminehd)
• [Scoring] Fix spark_udf InvalidVersion on Databricks Serverless for {major}.x runtime image strings (#24336, @PattaraS)
• [Tracing] Fix trace OTLP encoding for lone surrogates (#24318, @sanatb187)
• [Model Registry / Models] Forward tags to registered ModelVersion in Model.log() (#24271, @Ankita7033)
• [Tracing / UI] Fix duplicate full-trace fetch for TRACKING_STORE traces in the trace UI (#24319, @PattaraS)
• [Models / Scoring] Honor declared ONNX execution providers at load time (#24232, @qyc)
• [Evaluation] Fix pos_label not propagated to evaluate ROC/PR/calibration curves (#24049, @immu4989)
• [Tracking] Resolve experiment id from workspace-prefixed artifact paths in auth proxy (#24214, @rakshithbk-moeng)
• [] Fix DatabricksSDKModelsArtifactRepository auth on serverless executors (#24247, @harupy)
• [Evaluation] Send strict-compatible response_format for AI Gateway judges and scorers (#24048, @B-Step62)
• [Model Registry] Require read permission on the source run or model when creating a model version (#24293, @PattaraS)
• [] Fix Vertex AI Gemini multi-turn tool calling (#24266, @joshuawong-db)
• [Tracking] Enforce update-run authorization on the LogInputs endpoint (#24291, @PattaraS)
• [Tracking] Honor MLFLOW_S3_IGNORE_TLS in multipart artifact upload (#24113, @yashmahamulkar)
• [Gateway / Tracking] Reject non-HTTP scopes in WSGI mount to fix WebSocket crash (#24274, @joshuawong-db)
• [Model Registry / Tracing / Tracking] Fix tracing provider thread leak and set_experiment silently re-enabling tracing (#24267, @PattaraS)
• [Tracing] Fix @mlflow/opencode dropping session metadata against published core (#24252, @joshuawong-db)
• [UI] [BUG] Fix #24170: surface direct (per-resource) permissions in Admin UI (#24253, @nghessss)
• [Model Registry] Fix DNS-rebinding SSRF bypass in webhook delivery (#24258, @PattaraS)
• [Tracing / Tracking] Fix Summary ignoring valid=False Assessments (#24251, @joshuawong-db)
• [Evaluation] Route DSPy judge optimizer Databricks models to Mosaic AI Gateway for Unity Catalog names (#24177, @veronicalyu320)
• [UI] Allow granting of tool call permissions on MLflow assistant (#24084, @joshuawong-db)
• [Build] Fix Python 3.14 compatibility in skill_installer by using pathlib.Path (#24103, @krishtyagi0109-pixel)
• [UI] Render playground tool-call args and JSON responses as code blocks (#24086, @tanghaoji)
• [Gateway] Support Gemini thought signature in AI Gateway (#24051, @vatsalyd)
• [UI] fix(playground): render tool_calls so prompts run with tools no longer show empty result (#24073, @tanghaoji)

Documentation updates:

• [Docs] Add documentation for MCP Registry feature (#24713, @dkuc)
• [Docs / Tracing] docs: troubleshoot $0 trace cost for unknown model names (#24705, @daniellok-db)
• [Docs] docs: credential-expiry trace-drop cause in tracing FAQ, experiment_id in quickstart (#24692, @adamgurary)
• [Docs] Add Swagger UI API docs for MCP Server Registry (#24519, @dkuc)
• [Docs] docs: update auth REST API docs to reflect new RBAC endpoints (#23965, @Farzah11)
• [Docs] docs: fix broken auth REST API links causing Access Denied (#24280) (#24350, @Farzah11)
• [Docs] Add Artifact Hub repository metadata and OCI install docs for the Helm chart (#24313, @B-Step62)
• [Docs] docs: update Omnigent integration page for pure OTel setup (#24240, @TomeHirata)
• [Docs] docs: add Omnigent tracing integration page (#24072, @TomeHirata)

Small bug fixes and documentation updates:

#24746, #24747, #24671, #24637, #24655, #24459, #24510, #24629, #24426, #24554, #24555, #24556, #24359, #24460, #24445, #23676, #24446, #24268, #24417, #24358, #24288, #24250, #24206, #24165, #23939, #23936, #23881, @joshuawong-db; #24743, #24723, #24720, #24694, #24695, #24706, #24698, #24693, #24636, #24675, #24673, #24672, #24663, #24632, #24630, #24628, #24627, #24625, #24548, #24216, #24208, #24205, #24158, #24159, #24136, #24095, #24119, #24106, #24104, #24085, @harupy; #24736, @henishborad; #24717, #24583, #24582, #24584, #24685, #24621, #24604, #24521, #24482, #24495, #24484, #24480, #24481, #24490, #24374, #24317, #24299, @B-Step62; #24656, @rrioh; #24696, #24600, #24601, @daniellok-db; #24657, @DaoDaoNoCode; #24217, @nananosirova; #24645, #24377, #24492, #24380, #21417, #24346, #24297, #24108, @mprahl; #24477, @dkuc; #24572, #24520, #24479, @jonburdo; #24505, @PattaraS; #24242, @Killian-fal; #24558, #24540, #24090, #24139, #24089, #24061, #24032, #24030, @aaronteo-db; #24176, @zcin; #24412, @AknA13; #24437, @smoorjani; #24361, @sun-andsky; #23873, @WeichenXu123; #24240, #24203, #24178, @TomeHirata; #24225, #24204, #24166, #24054, @tanghaoji; #23794, #24171, @kramaranya; #23251, @aakankshaduggal; #24151, #24150, @xq-yin; #24075, @kevin-lyn

MLflow 3.15.0

MLflow 3.15.0 is all about making GenAI development faster and more collaborative. This release introduces a centralized MCP Registry for managing Model Context Protocol servers, a significantly upgraded MLflow Assistant with multi-provider support and a friction-free setup, shareable table views for the Runs table, proxy-less artifact transfers for big files, and multimodal LLM judges that can finally see the images in your traces. Here's what's new.

1. MCP Registry

Model Context Protocol servers are quickly becoming the connective tissue between agents and the tools they use — but until now, keeping track of them meant passing around config snippets and hoping everyone had the right version. The new MCP Registry gives you a single, centralized catalog to register, version, and share MCP servers across your team.

Every server gets semantic-versioned configs, promotable aliases (think @production and @staging), and tags for easy organization. MLflow auto-discovers each server's tools so you always know what a given version exposes, and it generates ready-made connection instructions for both Claude Code and .mcp.json — copy, paste, and you're connected. Manage the whole thing however you prefer: through the UI, the REST API, or Python.

2. A Smarter, Easier MLflow Assistant

The MLflow Assistant just got a major upgrade, and the theme is simple: less setup, more power.

• Bring your own model. The Assistant now supports multiple LLM providers — Claude Code, Codex, and API/Gateway endpoints — all selectable from a single settings page. Use the model that fits your workflow.
• Setup in seconds. Getting started is now as easy as pasting an API key directly into the pane. MLflow stores it securely in the Gateway's LLM Connections, so there's no fiddling with environment variables or config files.
• Full transparency as it works. Tool calls, approvals, and token costs are now displayed inline, so you can see exactly what the Assistant is doing — and what it's costing you — as it happens.

3. Shareable Table Views

Everyone builds their Runs table a little differently — the columns that matter, the sort order, the filters that cut through the noise. In 3.15.0, you can capture all of it. Save a named view that remembers your columns, their order and widths, your filters, and your sort — then share it with a teammate by simply sending them the URL. No more "here's how to set up your table" walkthroughs; just send the link.

4. Proxy-less Artifact Upload & Download

Large artifact transfers no longer have to funnel through the tracking server. Using presigned URLs, MLflow can now talk directly to your cloud storage (e.g. S3), cutting server load and eliminating the timeouts that plagued big-file uploads and downloads. It's faster for you and lighter on your infrastructure — and if presigned URLs aren't available, MLflow automatically falls back to the proxied transfer path, so existing setups keep working without any changes.

5. Multimodal Attachments in LLM Judges

LLM judges have been great for evaluating text — but a lot of real-world agents work with images, screenshots, and other visual content. Now your judges can see them too. {{ trace }} judges created with make_judge() gain a new get_span_image tool that fetches image attachments captured in trace spans, encodes them as base64 data URLs, and passes them straight to a multimodal model.

With support for Anthropic, Gemini, and OpenAI-compatible models (via litellm), you can now write judges that evaluate vision tasks, assess generated or captured screenshots, and reason about any visual content flowing through your traces — unlocking a whole new class of automated evaluation.

Full Changelog

For a comprehensive list of changes, see the release change log.

What's Next

Get Started

Upgrade to try these new features:

pip install mlflow==3.15.0

Share Your Feedback

We'd love to hear about your experience with these new features:

• GitHub Issues - Report bugs or request features
• MLflow Roadmap - See what's coming next and share your ideas
• ⭐ Star us on GitHub - Show your support for the project

Learn More

Check out the MLflow documentation for detailed guides

For a comprehensive list of changes, see the release change log, and check out the latest documentation on mlflow.org.

MLflow 3.14.0

MLflow 3.14.0 is a major release focused on closing the GenAI development loop, from getting an app instrumented in the first place to reviewing, testing, and iterating on it. Highlights include one-command observability onboarding with mlflow agent setup, durable low-latency tracing for Claude Code, Review Queues for collecting structured feedback on traces, a revamped evaluation dataset UI, a pytest integration that gates GenAI quality in CI, and an in-browser LLM Playground.

1. One-Command Onboarding with mlflow agent setup

Getting an app onto MLflow observability should not mean reading setup guides and wiring things together by hand. The new mlflow agent setup command does it all in a single line: it installs a curated set of MLflow skills and launches your favorite coding agent, which installs MLflow, sets up tracing, and instruments your app for you. Run it from inside your project, choose which coding agent to drive it (Claude Code, OpenAI Codex, or OpenCode) and where traces should land (a fresh local server, a Databricks workspace, or an existing one), and the agent adds tracing to your real entry point and verifies a trace end to end.

Because the actual instrumentation is delegated to your coding agent rather than a rigid script, it adapts to whatever package manager, framework, and entry point your project uses.

Run inside your project: your coding agent instruments it for MLflow Tracing

uvx mlflow@latest agent setup

Learn more in the Tracing Quickstart

2. Durable, Low-Latency Tracing for Claude Code

Rolling out Claude Code tracing to a whole team should be something you can switch on for everyone and stop thinking about. MLflow 3.14.0 makes it durable and low-overhead so organizations can adopt it with confidence: tracing never slows down the developer's Claude Code session, it will not overwhelm your central tracking server under load, and it does not lose traces when a network blip or a crash interrupts a session.

It achieves this with a write-ahead-log: each trace is written to local disk and uploaded by a background daemon that retries on failure, so the agent never blocks on the network and any traces already on disk are replayed even if the session exited unexpectedly. You can also send Claude Code traces to a Databricks Unity Catalog location with MLFLOW_TRACE_LOCATION.

Learn more about Claude Code tracing

3. Review Queues for Traces

Collecting feedback on GenAI traces used to be ad-hoc: spreadsheets, side channels, and no shared sense of what had already been reviewed. Review Queues turn that into a structured, in-UI workflow, and the quickest path needs no setup at all. From the trace table, select the traces you want a second opinion on and assign them directly to teammates, who find them waiting in their personal review queue. Each reviewer opens a focused review page and works through their traces one at a time.

When you want more structure, create a custom queue with a specific set of review questions (Pass/Fail, categorical, numeric, or free text) and assign it to a group of reviewers. Because a queue's status is shared across everyone assigned to it, the first reviewer to finish a trace clears it for the whole group. Either way, answers are never stored off to the side: each one is written straight back onto the trace, with feedback questions logging assessments and expectation questions logging ground truth. That makes review output immediately usable for evaluation, for aligning an LLM judge, or for building a dataset. The whole workflow is also scriptable through the mlflow.genai.review_queues SDK.

Learn more about Review Queues

4. Revamped Evaluation Dataset UI

Evaluation datasets are living collections of test cases that grow from production traces and hand-curated golden examples, but inspecting and maintaining them used to mean dropping into the Python SDK. MLflow 3.14.0 ships a fully revamped evaluation dataset experience in the UI. From an experiment's Datasets tab you get a searchable list of datasets, and clicking one opens a dedicated detail page with a sortable, paginated records table.

On the detail page, each record opens in a side panel where inputs and expectations are edited as validated JSON, with an unsaved-changes guard so you do not lose work. You can add records inline, multi-select and bulk-delete, choose which columns to show, and for any record that originated from a trace, open it in an in-page trace explorer to see where the test case came from. Combined with the existing "Add to evaluation dataset" action on the Traces tab, the whole build-and-maintain loop now lives in the UI.

Learn more about evaluation datasets

5. Pytest Integration for GenAI Regression Tests

If you already evaluate your agent with mlflow.genai.evaluate() and scorers, regression testing in MLflow 3.14.0 asks you to learn nothing new: add the @mlflow.test decorator to a plain pytest function, run your existing scorers, and assert on the result with assert result.passed, result.reason. When it fails, the failing scorers and their judge rationales show up right in the pytest output.

Because it is just a decorator on an ordinary pytest function, your regression suite plugs into the whole pytest ecosystem: parametrize a test across many cases, fan it out across workers with pytest-xdist, and run it in CI like any other test. Every run is captured to MLflow, and the Evaluation runs UI shows your test history and the detailed per-assertion judge results at a glance. The recommended loop is to grow the suite from real failures: each time the agent misbehaves, capture that case as a @mlflow.test so the same issue can never silently return.

import mlflow
from mlflow.genai.scorers import Guidelines

@mlflow.test
def test_answers_concisely(agent):
    result = mlflow.genai.evaluate(
        predict_fn=agent,
        data=[{"inputs": {"question": "What are your hours?"}}],
        scorers=[Guidelines(name="concise", guidelines="Answer in one sentence.")],
    )
    assert result.passed, result.reason

Learn more about regression testing

6. LLM Playground

Iterating on a prompt used to mean editing code and re-running it, or jumping out to a separate vendor playground that knew nothing about your registered prompts. MLflow 3.14.0 adds an in-browser LLM Playground, wired to the same MLflow AI Gateway endpoints and Prompt Registry versions you already govern. Open it from an experiment, pick a model endpoint, and compose a multi-turn conversation with system, user, and assistant messages.

A settings drawer lets you tune temperature, max tokens, top-p, penalties, and stop sequences; supply tool definitions; and constrain output to plain text or a strict JSON schema. Messages support {{ variable }} placeholders you fill in at submit time, and "Load prompt from registry" drops any registered version straight into the conversation, applying its stored model config automatically.

Learn more about the LLM Playground

Full Changelog

For a comprehensive list of changes, see the release change log.

What's Next

Get Started

Upgrade to try these new features:

pip install mlflow==3.14.0

Share Your Feedback

We'd love to hear about your experience with these new features:

• GitHub Issues - Report bugs or request features
• MLflow Roadmap - See what's coming next and share your ideas
• ⭐ Star us on GitHub - Show your support for the project

Learn More

Check out the MLflow documentation for detailed guides.

MLflow 3.14.0 includes several major features and improvements

Major New Features

• 🚀 One-command agent onboarding with mlflow agent setup: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command.
• ⚡ Durable, low-latency tracing for Claude Code: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash.
• 📝 Review Queues for traces: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation.
• 🗂️ Revamped evaluation dataset UI: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace.
• 🧪 Pytest integration for regression testing: Write GenAI regression tests as plain pytest functions with the @mlflow.test marker, gate them in CI, and review test history and per-assertion judge results in the UI.
• 🎛️ LLM Playground: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables.

Breaking Changes

• [Models] Change mlflow.sklearn serialization_format default from cloudpickle to skops (#23987, @copilot-swe-agent)
• [Models] Change serialization_format default to "pt2" for mlflow.pytorch.log_model and mlflow.pytorch.save_model (#23988, @copilot-swe-agent)
• [Models] Change serialization_format default to "skops" in mlflow.lightgbm log_model/save_model (#23986, @copilot-swe-agent)

Other Assorted Features & Improvements

• [Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62)
• [Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62)
• [Prompts] Prompt Playground (#23273, @TomeHirata)
• [Evaluation] [2/3] Add EvaluationResult.passed/.reason for @mlflow.test assertions (#23869, @B-Step62)
• [UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db)
• [UI] Add shareable review queue URLs with a startReview deep link (#23941, @harupy)
• [UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db)
• [Tracing] Add x-mlflow-run-id support to OTLP trace ingestion (#23664, @sanatb187)
• [Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62)
• [UI] Improve review queue empty states with onboarding content (#23903, @B-Step62)
• [UI] Add mlflow skills view/list CLI (#23907, @joshuawong-db)
• [UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62)
• [Tracing] Add MLFLOW_WORKSPACE support to OSS auth provider (#23927, @Nehanth)
• [Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata)
• [Evaluation] Add MLFLOW_GENAI_JUDGE_DEFAULT_MODEL environment variable (#23860, @B-Step62)
• [Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db)
• [Evaluation] Add rule-based built-in scorers: RegexMatch, PIIDetection, ResponseLength (#22571, @debu-sinha)
• [Tracing] Support Databricks backend in mlflow agent setup (#23783, @harupy)
• [Evaluation] Add POST /mlflow/genai/evaluate/invoke handler & job for UI-triggered eval runs (#23779, @aaronteo-db)
• [Tracing] [Claude Code] Support UC trace location via MLFLOW_TRACE_LOCATION (#23770, @B-Step62)
• [Tracing] [Codex] Support UC trace location via MLFLOW_TRACE_LOCATION (#23771, @B-Step62)
• [Evaluation / Tracking] [3/N] Label schemas: handlers + SDK + REST client (#23603, @kriscon-db)
• [Tracing / Tracking] Add run_id support for trace APIs (#23629, @sanatb187)
• [Evaluation / UI] Dataset v2 port (#23560, @B-Step62)
• [Evaluation / Tracking] Add OSS-native label schema entity, validation, and SQL store (#23597, @kriscon-db)
• [Tracing] Support mapping gen_ai.conversation.id to MLflow trace session (#23584, @SahilKumar75)
• [Tracing / UI] Added polling logic to live check and auto-refresh traces tab empty state with trace first ingestion (#23184, @vivian-xie-db)
• [Tracing] Add MlflowWalSpanExporter to hand traces off to the WAL daemon (#23641, @aaronteo-db)
• [Tracing] Support native UC trace ingestion from TypeScript SDK (#23562, @B-Step62)
• [Evaluation] Add Google ADK LLM judge scorers (Hallucination, Safety, ResponseEvaluation) (#22496, @debu-sinha)
• [Gateway] Add OpenAI /responses/compact passthrough route to AI Gateway (#23353, @id-jazzx)
• [Gateway] Add 21 new models to Databricks model catalog (#23520, @TomeHirata)

Bug fixes

• [Evaluation] Fix ChrfScore RAGAS scorer instantiation due to class name mismatch (#24047, @B-Step62)
• [Tracing / Tracking] Map OpenAI Agents SDK guardrail spans to SpanType.GUARDRAIL (#24044, @B-Step62)
• [UI] Surface review-question modal failures as toasts (#24035, @kriscon-db)
• [Tracking] Prevent review queues from shadowing usernames (#24034, @kriscon-db)
• [Tracking] Make review-queue names unique case-insensitively (defined at table creation) (#24015, @kriscon-db)
• [Tracking / UI] Normalize review-queue add-items ids before the trace-existence check (#24029, @kriscon-db)
• [UI] Scope review-queue permission UX gate to the active workspace (#24031, @kriscon-db)
• [UI] Surface review-queue trace-removal failures and keep the selection on error (#24027, @kriscon-db)
• [UI] Surface assignable-users load error in review-queue pickers (#24020, @kriscon-db)
• [UI] Prefill review answers from the most recent assessment by timestamp (#24026, @kriscon-db)
• [UI] Surface review-queue self-assign failures with an error toast (#24018, @harupy)
• [Evaluation / Tracing] Fix genai.evaluate() dropping dataset expectations and tags with scorers=[] (#23957, @Incheonkirin)
• [UI] Require at least one question when saving review queue settings (#24007, @harupy)
• [UI] Send review-queue schema_ids only when the questions actually change (#24017, @kriscon-db)
• [UI] Block saving a review when a previously-answered question is cleared (#24008, @kriscon-db)
• [UI] Compare review-queue picker usernames case-insensitively (#24014, @kriscon-db)
• [Tracking] Bind review-queue completed_by to the authenticated caller (#24006, @kriscon-db)
• [UI] Fix non-functional JSON/Table toggle in the review queue full-trace explorer (#24005, @kriscon-db)
• [UI] Surface review-queue deletion failures instead of swallowing them (#24004, @harupy)
• [Tracing] Fix TS SDK traces storage when MLflow server uses a local FS artifact root without mlflow-artifacts:// uri schema (#23992, @aaronteo-db)
• [UI] Show minute fidelity in the review-queue "Date added" column (#23993, @kriscon-db)
• [UI] Review queues: show the optional rationale box in the question preview (#23995, @kriscon-db)
• [Tracing] Set model provider in Anthropic autolog so LLM cost is computed (#23972, @B-Step62)
• [Evaluation] Add missing ContextUtilization RAGAS scorer class (#23956, @B-Step62)
• [UI] Refresh per-trace queue membership after adding/removing review-queue items (#23940, @kriscon-db)
• [Gateway] Fix JSON response format for Gemini and Anthropic gateway providers (#23932, @tanghaoji)
• [Tracking] Fix metrics/get-history returning empty results when max_results is omitted (#23917, @Vedant-Agarwal)
• [UI] Auto-select default user queue on Review tab load (#23904, @B-Step62)
• [UI] Require at least one answer before completing a focused review (#23923, @kriscon-db)
• [Tracing / Tracking] Clean up review-queue items and assessment errors when a trace is deleted (#23913, @harupy)
• [Evaluation / Tracing] Support common RETRIEVER chunk content fields (#23867, @sanatb187)
• [Tracing / Tracking] Preserve OTel resource attributes during OTLP trace ingestion (#23829, @TomeHirata)
• [Gateway] Fix AI Gateway SSE large-frame read limit (#23880, @yashjiv15-jazzx)
• [Evaluation] Honor OPENAI_BASE_URL env var in OpenAI provider config (#23862, @B-Step62)
• [Build] @mlflow/XXXX package root points to missing dist/index.js (#23874, @WeichenXu123)
• [Build] Add auth extra for full docker image (#23892, @WeichenXu123)
• [Artifacts] Return 404 for missing Azure blob artifacts (#23832, @feynmanliang)
• [Tracking] Fix _stop_listen_for_spark_activity hanging indefinitely on CLOSE_WAIT socket (#23839, @kishor-rkrishnan)
• [UI] Install Codex/OpenCode skills at .agents/skills (#23847, @harupy)
• [Tracing / Tracking] Fix mlflow.openai.autolog span type resolution for ChatCompletions subclasses (#23759, @harupy)
• [Tracking] Fix mlflow db upgrade on a fresh database (#23752, @harupy)
• [Tracking] Expose workspace on experiment response (#23593, @joshuawong-db)
• [UI] Handle missing clipboard API in insecure HTTP contexts (#23598) (#23601, @srinjoy356)
• [Build / UI] Fix PDF artifact viewer import.meta SyntaxError (#23731, @harupy)
• [Tracking] Fix _parse_extra_conf for HDFS config values containing = (#23730, @copilot-swe-agent)
• [Prompts / UI] Hide experiment kebab on prompt details page (#23661, @harupy)
• [Tracking] Enforce upload artifact size for chunked requests (#23712, @dfgvaetyj3456356-hash)
• [Projects] Reject path traversal in project zip extraction (#23713, @dfgvaetyj3456356-hash)
• [Tracking] Prefer routed ASGI paths in FastAPI auth checks. (#23685, @HumairAK)
• [Tracing / Tracking] Restore mlflow.crewai autolog on crewai 1.14.5 (#23682, @harupy)
• [Tracing] Unwrap JSON-encoded session.id / user.id span attributes on ingest (#23642, @SahilKumar75)
• [Evaluation / Tracing / UI] Forward OpenAI custom base URL in Detect Issues flow (#23650, @harupy)
• [Tracking] Add ON DELETE CASCADE relationship for SqlTraceInfo to SqlExperiment (#23194, @Mytolo)
• [Tracing] Extend mlflow.sourceRun metrics filter to cover post-hoc linked OTLP traces (#23591, @RudraDudhat2509)
• [Tracing] UI does not show Judge costs (#23586, @WeichenXu123)
• [Tracking] [Security] Register auth validator for /ajax-api/3.0/mlflow/get-trace-artifact (#23317, @B-Step62)
• [Tracing] Fix pydantic-ai >= 1.78.0 ToolManager module rename (#23508) (#23528, @kishor-rkrishnan)
• [UI] Add .jsonl artifact previews (#23532, @bvolpato)
• [Tracking] Disable credentialed CORS when wildcard origins are configured (#23178, @B-Step62)
• [Evaluation] Fix judge fallback on event-based traces grading itself (#23445, @james-fletcher-db)

Documentation updates

• [Docs / Evaluation] Add docs page for @mlflow.test pytest regression testing (#24011, @B-Step62)
• [Docs] Fix make_judge doc: self-referential deprecation note and link typo (#24046, @B-Step62)
• [Docs] Add documentation for review queues and label schemas (#23975, @kriscon-db)
• [Docs] Surface mlflow agent setup in docs (#23859, @joshuawong-db)
• [Docs] Document MLFLOW_STATIC_PREFIX behavior change in migration guide (#23851, @Sanket2329)
• [Docs] Add Colab warning in Quickstart Step 4 (#23831, @Farzah11)
• [Docs] Fix undefined generate_response in tracing docs (#23814, @llljjjwww333)
• [Docs / Tracing] Use CLI for Claude Code plugin install in docs (#23679, @harupy)
• [Docs / Models] Deprecate validate_serving_input in favor of mlflow.models.predict (#23376, @B-Step62)
• [Docs] Fix incorrect output comment for best_run.info in tracking docs (#23571, @Aksh123100)

Small bug fixes and documentation updates

#24045, #24042, #24024, #24023, #23969, #23970, #23961, #23964, #23963, #23866, #23729, #23670, #23310, #23294, @B-Step62; #24022, #24019, #23937, #23758, #23737, #23735, #23605, #23579, #23545, #23511, #23526, @aaronteo-db; #24025, #24003, #23996, #23915, #23912, #23882, @kevin-lyn; #23910, #23994, #23990, #23974, #23984, #23934, #23935, #23946, #23938, #23931, #23925, #23921, #23924, #23846, #23926, #23844, #23886, #23887, #23885, #23884, #23878, #23879, #23876, #23875, #23807, #23804, #23801, #23799, #23795, #23604, #23599, #23613, @kriscon-db; #23997, #23834, #23853, #23823, #23780, #23630, #23614, @joshuawong-db; #23947, #23920, #23858, #23848, #23845, #23841, #23840, #23838, #23837, #23803, #23827, #23826, #23824, #23806, #23802, #23798, #23796, #23788, #23595, #23776, #23764, #23745, #23743, #23742, #23740, #23739, #23718, #23711, #23710, #23708, #23700, #23699, #23697, #23684, #23677, #23672, #23671, #23669, #23668, #23667, #23666, #23663, #23653, #23644, #23643, #23639, #23640, #23638, #23636, #23632, #23631, #23626, #23625, #23618, #23606, #23596, #23588, #23585, #23582, #23581, #23580, #23576, #23573, #23567, #23566, #23565, #23563, #23558, #23553, #23552, #23523, #23506, #23498, @harupy; #23893, @debu-sinha; #23722, @kishor-rkrishnan; #23833, #23741, #23732, #23727, @TomeHirata; #23769, @mprahl; #23589, @charlesverge; #23690, @pvelayudhan; #23658, @copilot-swe-agent; #23540, @jamesbraza

MLflow 3.13.0 includes several major features and improvements

Major New Features

🔐 Role-Based Access Control & Admin UI: A full RBAC system with reusable roles and workspace-scoped grants, plus a new web Admin UI for managing users, roles, and permissions on self-hosted MLflow.

🗄️ Trace Retention & Auto Archival: Automatically move aged trace span data out of your SQL backend into object storage (e.g. S3) while keeping every trace fully readable in the UI and APIs.

🤖 One-click observability & governance for coding agents: Onboard Claude Code, OpenAI Codex, or Gemini CLI to the AI Gateway in one click for tracing, usage tracking, budgets, and guardrails.

✨ New engines for MLflow Assistant: Run MLflow Assistant on a local Ollama model, the OpenAI Codex CLI, or any MLflow AI Gateway endpoint, in addition to Claude Code.

☸️ Helm chart for Kubernetes: An official, production-ready Helm chart for deploying the MLflow tracking server to any Kubernetes cluster.

🌐 Hermes Agent support: Route the Hermes Agent runtime through the AI Gateway and capture its end-to-end traces in MLflow over OpenTelemetry.

🪵 Span log levels: Python-logging-style severity levels on spans, with a "Minimum log level" filter in the trace UI to hide low-level noise.

Breaking Changes

The permission system has been overhauled into a unified Role-Based Access Control model. The legacy per-resource permission tables, REST endpoints, and client methods are removed and replaced by roles backed by role_permissions, default_permission now acts as a floor rather than an override, and a workspace USE grant is sufficient to create experiments and registered models. Code that relied on the old per-resource permission APIs must migrate to the new role-based APIs. (#22855, #22859, #22941, #23337, #23379, @PattaraS)

MLServer is no longer available as a pyfunc serving backend. The previously deprecated enable_mlserver option has been removed, so mlflow models serve always uses the built-in scoring server. (#23356, @harupy)

mlflow autolog claude no longer installs the old Python autolog hook; Claude Code tracing is now provided by the official Claude plugin, which must be installed separately. (#23339, @B-Step62)

The default optimizer used by judge.align() is now MemAlign, so existing alignment workflows may produce different judges than before unless an optimizer is passed explicitly. (#23254, @veronicalyu320)

Pointing the tracking or model registry store at a local file-system path now raises an error by default; set MLFLOW_ALLOW_FILE_STORE=true to keep using a file-based store. (#22773, @harupy)

Other Assorted Features & Improvements

• [Gateway] Support AI Gateway as a backend of MLflow Assistant (#23559, @B-Step62)
• [UI] Make admin pickers target the workspace they're granting into (#23543, @PattaraS)
• [UI] Bring direct-grant picker to parity with role picker (#23420, @PattaraS)
• [UI] Cherry-pick: Add OpenAI Codex CLI as assistant provider (#22566) (#23517, @B-Step62)
• [Tracing] Support settings.local.json for Claude Code tracing config (#23285, @Gkrumbach07)
• [UI] Add coding-agent endpoint creation flow in AI Gateway UI (#23430, @TomeHirata)
• [Tracking / UI] Unified per-user permission APIs: grant / revoke / get / list under /mlflow/users/permissions/* (#23247, @PattaraS)
• [Evaluation / Tracing] Add mlflow.genai.test_agent for automated agent stress-testing (#22990, @serena-ruan)
• [Gateway] Add /gateway/proxy/{endpoint_name}/{path} raw proxy endpoint (#23330, @TomeHirata)
• [UI] Add Ollama as assistant provider (#22098, @SuperSonnix71)
• [Model Registry / Tracking] feat(tracking): Add reader/writer instance routing for database replicas (#22910, @ravidarbha)
• [Tracing / Tracking] Add workspace trace archival configuration plumbing (#22164, @HumairAK)
• [Prompts / Tracking] Promote prompt to a first-class RBAC resource_type (#23248, @PattaraS)
• [Tracing] Publish claude code integration as a plugin and add a setup wizard. (#23218, @B-Step62)
• [UI] Forward Usage tab MetricsFilter metric filters to chart View traces links by translating to Traces page URL DSL (#23239, @aaronteo-db)
• [Tracing] Claude Code Agent Typescript (#20414, @joelrobin18)
• [UI] Adding metric filter component for Experiment Usage tab (#23120, @aaronteo-db)
• [Tracing] Add Link entity and LiveSpan.add_link() for OpenTelemetry Span Links (#22797, @khaledsulayman)
• [Docs / Evaluation] Add Google ADK and third-party scorers (#22299, @debu-sinha)
• [UI] Open /admin to workspace managers (scoped per their workspace) (#23086, @PattaraS)
• [Tracing] Trace Runner.run_streamed() in OpenAI Agents SDK autolog (#22962, @ktrk115)
• [Tracking] Feature/sagemaker build network option (#22996, @pdifranc)
• [Docs / Tracing / UI] Add log levels for Trace Spans with UI switch to filter (#23017, @rrtheonlyone)
• [Tracing / UI] Improve trace page empty state onboarding with setup and code blocks (#22533, @vivian-xie-db)
• [Tracing / Tracking] Add UC traces upsell message for set_experiment calls on Databricks (#23038, @xsh310)
• [Server-infra / UI] [Admin-UI-3/4] Add Platform Admin pages (#22929, @PattaraS)
• [UI] [Admin-UI-2/4] Add /account page and bottom-left account widget (#22973, @PattaraS)
• [Build] Add Helm charts for deploying mlflow to kubernetes cluster (#21973, @WeichenXu123)
• [Tracking] Fix Databricks unified auth support when MLFLOW_ENABLE_DB_SDK=true (#20599, @vb-dbrks)
• [Tracking] [Admin-UI-1/4] Add backend auth endpoints (#22928, @PattaraS)
• [Evaluation] Support multiple assessments per trace in MemAlign optimizer (#22846, @veronicalyu320)
• [Docs / Model Registry / Prompts] Include workspace in webhook delivery envelopes when workspaces are enabled (#22873, @copilot-swe-agent)
• [Server-infra] Seed default RBAC roles and grant creator on workspace creation (#22857, @PattaraS)

Bug fixes

• [UI] Warn on submit with an unsaved direct-grant draft (#23612, @PattaraS)
• [Tracing] Clear archive-now requests for non-archivable leftovers (#23655, @HumairAK)
• [Tracking] Forward MLflow client telemetry from inside Databricks workloads (#23483, @smoorjani)
• [UI] Drop the vestigial directPermissions parallel pass; hide synthetic user<id>_ roles on Account/UserDetail (#23578, @PattaraS)
• [Gateway] Tighten response format JSON schema type (#23290, @fenil210)
• [Tracking] fix(tracking): return <console> for mlflow.source.name when sys.argv[0] is empty (#23352, @xodn348)
• [Scoring] Fix UnicodeEncodeError on artifact download with non-ASCII filename (#23241, @1fanwang)
• [Artifacts / UI] Preserve pdfjs-dist bundles in webpack build (craco.config.js) (#23349, @B-Step62)
• [Tracking] Improve misleading DB SDK auth error (#23374, @B-Step62)
• [Tracing] Make mlflow.get_trace V4 retry policy configurable (#23443, @artjen)
• [Tracking] Release _post_import_hooks_lock before firing hooks (#23466, @harupy)
• [Model Registry / Prompts] RBAC: extend prompt resource_type to after-request handlers (#23426, @PattaraS)
• [Evaluation] Surface mlflow version mismatch when deserializing scorers (#23215, @smoorjani)
• [Tracing] Ship compiled dist/ in @mlflow/mlflow-openclaw so openclaw plugins install works (#23220, @B-Step62)
• [Tracing] Fix ended LiveSpan state mutation (#23152, @SahilKumar75)
• [Gateway] Fix AmazonBedrockProvider._build_converse_kwargs tool-call history and validation for Bedrock Converse (#23223, @copilot-swe-agent)
• [UI] fenil-fix: experiment name error (#23199, @fenil210)
• [Tracking] Add workspace isolation on scorers when creating a guardrail (#23115, @mprahl)
• [Evaluation] [Security] Add MLFLOW_ALLOW_PICKLE_DESERIALIZATION guard to PickleEvaluationArtifact (#23183, @TomeHirata)
• [UI] Fix getExperimentNameValidator showing incorrect "deleted state" error for active experiments (#23169, @copilot-swe-agent)
• [Tracking] Fix runs:/<run_id>/<model_name> loading by resolving logged-model artifacts via models:/<model_id> (#23130, @copilot-swe-agent)
• [Gateway] Fix Vertex AI gateway to use Anthropic API format for Claude models (#23175, @TomeHirata)
• [Tracing] Fix invalid stop-hook command when using pixi environment manager (#23030, @copilot-swe-agent)
• [Gateway] Fix MySQL-incompatible NULLS LAST syntax in list_endpoint_guardrail_configs (#23168, @copilot-swe-agent)
• [Evaluation] gateway: honor Anthropic api_base from secret auth_config (#23167, @sairavuri-sudo)
• [Gateway] Fix nested array items being stripped from function tool schemas (#23053, @shyamspr)
• [Tracing / Tracking] Fix OTLP trace ingestion: double-encoded request ID and missing trace tags (#23067, @sairavuri-sudo)
• [Gateway] Add per-image/video/audio pricing to amazon.nova-2-multimodal-embeddings-v1:0 in Bedrock catalog (#23117, @copilot-swe-agent)
• [Evaluation] Skip re-alignment of unchanged traces in MemAlignOptimizer (#23008, @veronicalyu320)
• [Tracing] Fix trace API authorization vulnerability (#23014, @TomeHirata)
• [Models] Fix sentence_transformers pyfunc predict for v5.4+ (#23108, @harupy)
• [Tracing / UI] Fix grouped trace session counts in the UI (#23012, @lavaFreak)
• [Tracing] Fix Azure OpenAI streaming usage tracing (#23036, @Genmin)
• [Tracing] Add session_count trace metric for grouped traces (#23011, @lavaFreak)
• [Evaluation] Fix gateway_adapter not forwarding workspace header to judge endpoints (#23047, @sairavuri-sudo)
• [Scoring] Use TaskContext.artifactDir to get the correct unpacked artifacts directory (#22969, @WeichenXu123)
• [Models / Tracking] Add MLFLOW_SKIP_PIP_REQUIREMENTS_CHECK env var to bypass pip validation in air-gapped environments (#22920, @copilot-swe-agent)
• [Tracking] Aggregate role-based grants in workspace-level permission checks (#22954, @PattaraS)
• [UI] Fix unclickable "View logs for this period" link in ScrollableTooltip when many data series are shown (#22917, @copilot-swe-agent)
• [Tracking] Fix delete_user FK constraint failure when user has dependent rows (#22922, @PattaraS)
• [Tracing] Preserve cache_read tokens in @mlflow/claude-code TypeScript plugin for cache observability (#22906, @dgokeeffe)
• [Tracing] Add OpenClaw tracing plugin (#22717, @B-Step62)
• [UI] Fix uncaught rejection in CreateBudgetPolicyModal submit (#22903, @PattaraS)

Documentation updates

• [Tracing] Clarify trace archival max-traces behavior. (#23656, @HumairAK)
• [Docs] docs: fix admonition rendering broken by Docusaurus 3.10 (#23635, @B-Step62)
• [Docs / Tracing] Refresh Claude Code tracing docs and split Claude Agent SDK page (#23633, @B-Step62)
• [Tracing] Document trace archival setup and behavior. (#23371, @HumairAK)
• [Docs] docs: add Role-Based Access Control page; refresh permissions docs (#23133, @PattaraS)
• [Docs] Update codex.mdx to use Codex openai_base_url config (CLI + ~/.codex/config.toml) (#23272, @copilot-swe-agent)
• [Docs] Fix ANTHROPIC_BASE_URL example in Claude Code gateway docs (#23269, @copilot-swe-agent)
• [Docs] Add trace integrations docs for n8n and Openweb UI (#23249, @WeichenXu123)
• [Docs / Tracing] Docs: add Hermes Agent AI Gateway and tracing guides (#23216, @B-Step62)
• [Docs] Fix webhook auth endpoint placeholders in basic-http-auth.mdx (#23198, @copilot-swe-agent)

Small bug fixes and documentation updates

#23637, #23405, #23181, #23673, #23659, #23293, #23440, #23441, #23127, #23182, #23179, #23180, #22992, @B-Step62; #23557, @AayushShah-904; #23594, #23592, #23583, #23496, #23417, #23415, #23414, #23413, #23412, #23410, #23409, #23408, #23407, #23406, #23399, #23398, #23452, #22861, #22933, #22888, @PattaraS; #23531, #23282, #23281, #23280, #23279, #23278, #23277, #23276, #23275, #23274, #23173, #23189, #23174, #23171, @TomeHirata; #23495, #23447, #23448, #23422, #23360, #23322, #23316, #23313, #23085, #23304, #23268, #23084, @kriscon-db; #23494, #23493, #23489, #23473, #23470, #23468, #23467, #23463, #23461, #23459, #23462, #23457, #23454, #23450, #23449, #23427, #23428, #23424, #23411, #23395, #23391, #23390, #23388, #23387, #23386, #23385, #23383, #23380, #23381, #23373, #23372, #23361, #23357, #23354, #23351, #23348, #23343, #23342, #23331, #23321, #23320, #23318, #23315, #23307, #23297, #23288, #23286, #23283, #23262, #23264, #23256, #23260, #23255, #23240, #23228, #23234, #23233, #23230, #23227, #23207, #23203, #23206, #23197, #23187, #23185, #23177, #23166, #23157, #23156, #23154, #23155, #23153, #23149, #23148, #23143, #23142, #23141, #23140, #23135, #23134, #23132, #23131, #23129, #23126, #23123, #23122, #23118, #23112, #23110, #23107, #23105, #23093, #23090, #23010, #23088, #22999, #22998, #22988, #22989, #22987, #22986, #22981, #22975, #22960, #22958, #22602, #22937, #22923, #22912, #22907, #22908, #22898, #22894, #22893, #22892, #22889, #22887, #22886, @harupy; #23423, #23464, #23287, @aaronteo-db; #23368, @ynachiket; #23366, @mprahl; #23363, #23333, #23136, #23005, #22777, #22934, #22605, #22497, #22256, @HumairAK; #22832, @james-fletcher-db; #23214, @SomtochiUmeh; #23224, #23103, #23101, #22959, #22924, @copilot-swe-agent; #22977, @4binas; #22961, #22955, @serena-ruan; #22865, @iis-MarkKuang; #22799, @artjen

MLflow 3.13.0 is a major release for running AI observability at scale, focused on access control, the lifecycle of your trace data, and richer support for agents. Highlights include a full Role-Based Access Control system with a new Admin UI, automatic trace archival, one-click onboarding for coding agents, new engines for MLflow Assistant, span log levels, an official Helm chart for Kubernetes, and Hermes Agent support.

1. Role-Based Access Control and Admin UI

Sharing a self-hosted MLflow server across a team used to mean granting permissions one resource at a time, with no central place to manage them. A new Role-Based Access Control (RBAC) system replaces that: define roles as reusable bundles of permissions, assign them to users, and let workspace-level grants express both membership and admin authority. A user's effective access is the union of their roles, and experiments, models, prompts, scorers, and AI Gateway endpoints are all covered.

A new web Admin UI makes this manageable without touching REST endpoints, with a self-service /account page for viewing your roles and changing your password, and Platform Admin pages for managing users, roles, and grants. Just start mlflow server with authentication enabled.

2. Trace Retention and Auto Archival

On a long-running tracking server, trace span data piles up in your SQL backend and eventually slows it down. Trace archival keeps it in check: a background pass automatically moves traces older than your retention window out of SQL and into cheap object storage such as S3, while keeping every trace fully readable in the UI and through the APIs. Retention is policy-driven, resolving from server to workspace to experiment.

Enable it by pointing the server at a YAML config:

trace_archival:
  enabled: true
  location: s3://my-bucket/trace-archive
  retention: 7d
  interval_seconds: 60

Workspace managers and experiment owners can then tighten retention from the UI or CLI, and the effective cutoff shows up as an "Archive after" badge on each trace.

3. One-Click Observability and Governance for Coding Agents

Putting a coding agent like Claude Code, OpenAI Codex, or Gemini CLI under observability and governance used to require wiring up a gateway endpoint by hand. The AI Gateway QuickStart now does it in one click: pick your agent and MLflow provisions a pre-configured endpoint (no API key needed, since the agent brings its own credentials) and hands you a ready-to-paste starter snippet. From then on, every request the agent makes is captured as a trace and subject to usage tracking, budgets, and guardrails.

4. New Engines for MLflow Assistant

MLflow Assistant launched in 3.9.0 tied to Claude Code. You can now choose the engine that powers it: run the Assistant on a local Ollama model, the OpenAI Codex CLI, or any MLflow AI Gateway endpoint, all selectable from the setup wizard. That means you can keep everything on your own machine with Ollama, or reuse a provider you already route through the Gateway.

5. Helm Chart for Kubernetes Deployment

Deploying MLflow on Kubernetes used to mean writing and maintaining your own manifests. An official, production-ready Helm chart now does it for you, with TLS, persistent storage, Ingress, Prometheus metrics, a restrictive NetworkPolicy, RBAC, and optional mlflow gc garbage collection built in. Download the chart and install it (requires Kubernetes 1.23+ and Helm 3.8+):

helm install mlflow ./charts \
--namespace mlflow \
--create-namespace \
--set storage.enabled=true \
--set mlflow.backendStoreUri="sqlite:////mlflow/mlflow.db" \
--set mlflow.artifactsDestination="/mlflow/artifacts"

6. Hermes Agent Support

Agent observability now reaches beyond coding agents to long-running autonomous runtimes. Hermes Agent from Nous Research integrates on two surfaces: route its model calls through the AI Gateway for centralized usage tracking, budgets, and guardrails, and capture full end-to-end traces, including LLM calls, tool invocations, and long-running sessions, through MLflow Tracing over OpenTelemetry.

To route Hermes through the Gateway, create an endpoint and run hermes setup model; for tracing, install the community hermes-otel plugin to export OTLP traces to your MLflow server.

7. Log Levels for Trace Spans

A busy trace can bury the spans you care about under chain plumbing and parser calls. Spans now carry Python-logging-style severity levels (DEBUG through CRITICAL), assigned automatically from the span type, so LLM, tool, and retriever calls surface as INFO while internal steps stay DEBUG, and any span that raises is promoted to ERROR. In the trace explorer, a new Minimum log level slider hides everything below the threshold, with no code changes required. You can also set a level explicitly:

import mlflow
with mlflow.start_span("plumbing", log_level="DEBUG") as span:
    ...

Full Changelog

For a comprehensive list of changes, see the release change log.

What's Next

Get Started

Upgrade to try these new features:

pip install mlflow==3.13.0

Share Your Feedback

We'd love to hear about your experience with these new features:

• GitHub Issues - Report bugs or request features
• MLflow Roadmap - See what's coming next and share your ideas
• ⭐ Star us on GitHub - Show your support for the project

Learn More

Check out the MLflow documentation for detailed guides

We're excited to announce MLflow 3.13.0rc0, which deepens agent observability, tightens permissions, and broadens deployment options:

Major New Features

RBAC + Admin UI: Major overhaul of MLflow's Role-Based Access Control — legacy per-resource permission tables collapsed into role_permissions, unified per-user permission APIs under /mlflow/users/permissions/*, workspace USE permission lets users create experiments and registered models, default roles are seeded on workspace creation, prompt is promoted to a first-class RBAC resource_type, and a new 4-page Admin UI (account widget, /account page, Platform Admin pages, backend auth endpoints) opens to workspace managers scoped per their workspace. (#22855, #22857, #22859, #22928, #22929, #22941, #22973, #23086, #23247, #23248, #23337, #23379, @PattaraS)

Coding-Agent Tracing as Plugins: Claude Code, OpenClaw, Ollama, and OpenAI Codex are now wired into the AI Gateway as first-class assistant providers, plus a Claude Code TypeScript plugin with a setup wizard and settings.local.json support. The legacy Python autolog hook for mlflow autolog claude is replaced by the new official plugin, and a coding-agent endpoint creation flow is now available directly in the AI Gateway UI. (#20414, #22098, #22566, #22717, #23218, #23285, #23339, #23430, #23517, @B-Step62, @joelrobin18, @Gkrumbach07, @SuperSonnix71, @TomeHirata)

Trace Archival: End-to-end trace archival across the tracking stack. Includes archival configuration models, OTLP and artifact helpers, SQLAlchemy archival passes, archive-aware retrieval fallback, plus workspace/experiment/server-level archival settings in the UI. Read archived traces back seamlessly. (#23359, @mprahl)

Helm Charts for Kubernetes Deployment: First-class Helm chart for deploying MLflow to Kubernetes clusters — production-ready configuration, ingress, persistence, and appVersion wired to the released MLflow image. Get from helm install to a running tracking server without writing your own manifests. (#21973, @WeichenXu123)

mlflow.genai.test_agent for Automated Agent Stress-Testing: New API for stress-testing GenAI agents — generate adversarial inputs, replay them through your agent, and review the resulting traces in MLflow. Wires into the existing evaluation flow and assessment APIs. (#22990, @serena-ruan)

OpenTelemetry Span Links: Tracing now supports the OpenTelemetry Link entity via LiveSpan.add_link(), letting you connect causally related spans across traces. (#22797, @khaledsulayman)

Database Replica Routing: The SQL tracking store now supports reader/writer instance routing for database replicas, so read-heavy MLflow deployments can scale horizontally without overloading the primary. (#22910, @ravidarbha)

Stay tuned for the full release, which will include even more features and bug fixes.

To try out this release candidate, please run:

pip install mlflow==3.13.0rc0

MLflow 3.12.0 includes several major features and improvements

Major New Features

🖼️ Multimodal Tracing: Users can now store multimodal content in tracing spans as artifact attachments instead of inline binary data. We've also patched the UI to support the new mlflow-attachment:// style URI, with rich rendering available for PDFs, audio, and images.

🤖 Codex, Gemini, Qwen coding agent tracing support: Similar to our Claude Code tracing integration, we've now added support for the Codex, Gemini, and Qwen coding agent platforms as well!

🛡️ Gateway guardrails: You can now set guardrails on your gateway endpoints to prevent unsafe or non-compliant model inputs and outputs. Try it out in the MLflow UI!

⚡ Trace table pagination: The traces tab is now paginated, rather than fetching all traces up to a limit of 1000. This improves initial load time, and makes the page feel more responsive overall.

Breaking Changes

[Scoring] Deprecate enable_mlserver in pyfunc serving backend (#22994, @B-Step62)

Other Assorted Features & Improvements

[UI] Add coding agents section to AI Gateway quick start (#23006, @TomeHirata)
[Tracing] feat: record caller in gateway traces from request headers (#22926, @TomeHirata)
[] Run guardrails on passthrough endpoints; skip response_format for non-chat payloads (#22856, @TomeHirata)
[] Gateway: preserve client auth header for subscription-based CLI tools (claude-cli, Codex-Desktop, GeminiCLI) (#22915, @TomeHirata)
[Tracing] Expose Codex and Qwen Code hooks as installable CLI binaries (#22853, @kriscon-db)
[Tracking / UI] Add Portkey as a supported AI Gateway provider (#22830, @sairavuri-sudo)
[Tracking] Cache successful basic-auth credential checks to eliminate per-request PBKDF2 (#22817, @PattaraS)
[] Add last_updated_at field to model catalog entries (#22838, @copilot-swe-agent)
[Evaluation] Enable third-party scorer registration in OSS MLflow (#22634, @smoorjani)
[] Add platform-side telemetry fields to Gateway invocation and budget events (#22557, @PattaraS)
[Tracing] Auto-start SQL warehouse before V4/V5 MLflow tracing calls (#22798, @artjen)
[Tracing] Migrate Claude Code tracing to TypeScript-based plugin for simpler installation and runtime handling. (#22338, @B-Step62)
[Tracing] Add TypeScript Qwen Code tracing via Stop hook (#22411, @kriscon-db)
[] Support model_kwargs in DeepEval scorers for LLM parameter control (#22494, @debu-sinha)
[] Add Application Default Credentials auth mode for Vertex AI gateway (#22754, @harupy)
[UI] Reorganize Settings into section-based routing with sub-sidebar navigation (#22743, @serena-ruan)
[Tracing] Add TypeScript Codex CLI tracing via notify hook (#22410, @kriscon-db)
[Tracing / UI] Add Share button to trace detail view (#22608, @alkispoly-db)
[Docs / Models] Add mlflow.diffusers flavor for diffusion model LoRA adapters (#22253, @Rasaboun)
[Tracing] Add size limit for trace attachments (#22575, @kriscon-db)
[Tracing] Add GeminiCliTranslator for Gemini CLI OTLP span type mapping (#22409, @kriscon-db)
[Tracing] Add JSON OTLP encoding support for trace ingestion (#22408, @kriscon-db)
[Tracing] Extract service.name from OTLP resource attributes for usage telemetry (#22407, @kriscon-db)
[Tracing] Add MLflow tracing spans to guardrail execution in gateway (#22581, @TomeHirata)
[Tracing / UI] Add rendering size guards for large media content (#22574, @kriscon-db)
[Tracking] #21037 Add presigned upload URL endpoint for S3 artifact uploads (#21039, @henishborad)
[UI] Add Guardrails tab to endpoint editor (#22360, @TomeHirata)
[UI] Add click-to-expand modal for trace attachment images (#22461, @kriscon-db)
[UI] Enhance Gateway quick start cards with logos, multi-model options, and compact variant (#22513, @xq-yin)
[Tracing] Add @mlflow/vercel for better Vercel AI SDK tracing in Databricks UC (#22105, @dbrx-euirim)
[UI] [UI] Refactor API keys page: bulk delete, inline drawer editing, consistent list pattern (#22485, @xq-yin)
[] Add Guardrail base class and JudgeGuardrail implementation (#21964, @TomeHirata)
[Tracing] Add multimodal demo traces with synthetic image and audio data (#22465, @kriscon-db)
[] [FR] #22217 Add configurable provider allow/deny list to AI Gateway (#22291, @etirelli)
[UI] [UI] Add bulk duplicate and delete actions to AI Gateway endpoints table (#22404, @xq-yin)
[UI] Redesign endpoint details model section with unified Model card (#22376, @xq-yin)
[] Add X-MLflow-Gateway-Duration-Ms and X-MLflow-Gateway-Overhead-Duration-Ms response headers (#22229, @PattaraS)
[UI] Redesign AI Gateway endpoint details: Overview tab, starter code, and Try in Browser (#22284, @xq-yin)
[] Add guardrail proto definitions, server handlers, and REST store (#21962, @TomeHirata)
[Build] Add aiohttp as a core dependency of mlflow (#22189, @TomeHirata)
[] Add gateway guardrail DB layer: schema, store methods, and tests (#21960, @TomeHirata)
[UI] Add quick-start template cards to AI Gateway empty state (#22249, @xq-yin)
[Tracing / UI] Add freeform Notes section to trace assessments pane (#21676, @smoorjani)
[Tracing / UI] [UI] Improve traces table visual design and UX (#20424, @ridgupta26)
[UI] Improve Image Grid chart UX for multi-run image comparison (#22118, @Rasaboun)
[Models] Add base_model_path parameter to save PEFT adapter-only with local base model reference (#22052, @rpathade)
[Tracking] Add mlflow db move-resources command to move resources between workspaces (#21263, @mprahl)
[Tracking] feat(tracking): Add composite index on metrics (run_uuid, key, step) (#21727, @ravidarbha)

Bug fixes

[Tracing / Tracking] Redact presigned URL credentials in urllib3 retry logs (#22995, @B-Step62)
[Tracing] Fix assessment logging silently dropped in distributed tracing (#22963, @serena-ruan)
[] Filter _list_budget_windows results by active workspace when request is workspace-scoped (#22885, @copilot-swe-agent)
[Models / Scoring] Fix uv custom index URLs omitted from model requirements.txt (#22921, @serena-ruan)
[Tracing / UI] Set mlflow.message.format on gateway passthrough spans to enable Chat tab (#22916, @TomeHirata)
[Server-infra] Add RBAC regression tests + gateway validator fix (#22862, @PattaraS)
[Server-infra] Include role-based grants in list_accessible_workspace_names (#22864, @PattaraS)
[Tracing] Preserve cache_read tokens in claude_code tracing for cache observability (#22683, @dgokeeffe)
[Tracing] Fix InferenceTableSpanProcessor init for opentelemetry-sdk 1.41.0 (#22867, @harupy)
[UI] Fix audio artifact viewer failing in non-default workspaces (#22811, @harupy)
[Tracking] Fix O(n^2) body buffering in WSGIMiddleware for large uploads (#22729, @harupy)
[Tracking] Propagate workspace_id as X-Databricks-Org-Id header for SPOG support (#22554, @B-Step62)
[UI] Fix sessions pagination not auto-loading after virtualizer settles (#22808, @daniellok-db)
[Tracing] Fix _get_token_usage dropping zero-valued token counts (#22748, @copilot-swe-agent)
[Tracing] Fix _get_token_usage dropping cache token fields (#22818, @harupy)
[UI] Remove rendering size guards from artifact image and video views (#22816, @kriscon-db)
[UI] Disable Create Guardrail in AddGuardrailModal until a Guardrail Model endpoint is selected (#22766, @copilot-swe-agent)
[UI] Disable Guardrails tab in EditEndpointFormRenderer when endpoint.experiment_id is null, refresh i18n messages, and fix JS type-check follow-ups (#22757, @copilot-swe-agent)
[] Fix OPENAI_API_KEY requirement when guardrails use gateway:/ judge model (#22769, @TomeHirata)
[Tracking] Fix ABFSS URI double-encoding in _parse_abfss_uri (#22759, @artjen)
[UI] Persist immediate gateway usage-tracking updates and preserve dirty edits in useEditEndpointForm (#22734, @copilot-swe-agent)
[] Fix Vertex AI gateway global location handling for Gemini 3 models (#22696, @harupy)
[Tracing] Fix ValueError: Circular reference detected crash in dump_span_attribute_value (pydantic_ai autolog) (#22693, @barry3406)
[Tracing] Add Bedrock Converse models to model catalog (#22515, @ajgassner)
[Tracing] Fix incorrect cost calculation for Anthropic cached requests (#22516, @ajgassner)
[UI] Disable Create button when experiment name is empty (#22649, @ssam18)
[Tracing] Fix AsyncHttpxClientWrapper AttributeError by avoiding deepcopy in TraceJSONEncoder (#22742, @harupy)
[Evaluation] Fix JSON parsing failure for judge model responses containing newlines (#22736, @harupy)
[Evaluation] Fix non-ASCII characters being escaped in judge template variables (#22728, @harupy)
[Tracking] Fix pandas 3.x datetime64 resolution compatibility in cast_df_types_according_to_schema (#22705, @copilot-swe-agent)
[Tracing] Fix conversation simulator adding wrapper span that breaks custom scorers (#21321, @B-Step62)
[] Fix Bedrock tool-use chat response parsing (#22677, @lavaFreak)
[UI] Fix AI Gateway provider dropdown by flattening OpenAI / Azure OpenAI (#22701, @harupy)
[Evaluation / Tracing] Preserve predict_fn signature in simulation turn tracing (#22610, @rogalski)
[Tracing / Tracking] fix: Extract cached_tokens in OpenAI streaming responses to correct cost tracking (#22620, @Rishabh-git10)
[Tracing / UI] Auto-select first endpoint and API key in issue detection modal (#22633, @serena-ruan)
[Model Registry] Use SQL MAX() in create_model_version instead of loading all rows (#22635, @neolunar7)
[Tracing] Add modality/tool pricing extraction to dev/update_model_catalog.py, backfill anthropic.json / gemini.json, and skip reasoning modality pricing (#22699, @copilot-swe-agent)
[Tracing] Fix pydantic-ai run_stream_sync autologging broken by AgentSpec forward reference in _returns_sync_streamed_result (#22666, @copilot-swe-agent)
[UI] Unify execution duration cell rendering in session header rows (#22631, @daniellok-db)
[] Implement guardrail execution in gateway API handlers (#22306, @TomeHirata)
[Tracing / Tracking] Fast-path trace-id search in frontend to avoid spans.content scan (#22433, @harupy)
[UI] Fix tag cutoff in prompts table (#22507, @nananosirova)
[Scoring] Fix pandas 3.0 StringDtype mismatch in cast_df_types_according_to_schema (#22537, @copilot-swe-agent)
[Tracing] Fix exception propagation in @mlflow.trace within @trace_disabled context (#22501, @harupy)
[UI] [UI] Show header and breadcrumb on gateway usage page when no endpoints exist (#22445, @xq-yin)
[Model Registry] Fix performance degradation for single-tenant installation (#22405, @abaland)
[UI] Render attachments inline in Details & Timeline span view (#22451, @kriscon-db)
[UI] Skip markdown rendering for oversized chat content to prevent browser freezes (#22464, @kriscon-db)
[UI] Render attachment images embedded in complex JSON structures (#22462, @kriscon-db)
[UI] Handle input_file content type in Responses API chat rendering (#22466, @kriscon-db)
[UI] Fall back to OpenAI parser for LangChain traces with OpenAI-format data (#22456, @kriscon-db)
[UI] Combine multi-part Responses API input into a single chat message (#22459, @kriscon-db)
[UI] Render text content before audio parts in chat messages (#22460, @kriscon-db)
[Tracing] Handle Gemini SDK bytes repr format in inline_data extraction (#22453, @kriscon-db)
[UI] Show all output fields alongside attachment renderings in summary view (#22449, @kriscon-db)
[UI] Handle single dict contents in Gemini chat input normalization (#22455, @kriscon-db)
[UI] Fix audio player not loading on first render in attachment view (#22450, @kriscon-db)
[UI] Allow Gemini chat rendering when role field is omitted (#22454, @kriscon-db)
[Evaluation] Add server side check for registering custom scorer (#22381, @WeichenXu123)
[UI] [UI] Cache gateway provider/model queries to eliminate redundant fetches (#22440, @xq-yin)
[Tracing] Eager-load trace relationships in search_traces (#22431, @harupy)
[Model Registry] Fix cross-workspace copy_model_version failure caused by get_logged_model call (#22262, @TomeHirata)
[UI] [UI] Fix endpoint details to display all API keys for multi-model endpoints (#22406, @xq-yin)
[UI] Fix tag cutoff in experiments table (#21871, @nananosirova)
[Tracking] Fix rename_experiment in SqlAlchemyStore to enforce 500-char name limit (#22418, @copilot-swe-agent)
[Tracking] Fix download_artifacts and list_artifacts returning wrong status for missing artifacts (#22310, @Karim-siala)
[Docs / Tracing] Enable async trace logging by default for OSS MLflow (#22304, @PattaraS)
[UI] Show Save/Cancel buttons only when endpoint has unsaved changes (#22367, @xq-yin)
[UI] Remove mp4 from AUDIO_EXTENSIONS to fix video artifact preview (#22350, @copilot-swe-agent)
[Evaluation] Fix MetaPromptOptimizer failing on prompts with no template variables (#22301, @alkispoly-db)
[Prompts / UI] Fix misleading placeholder text in PromptsListFilters (#22321, @copilot-swe-agent)
[Evaluation] Fix make_judge with bool/numeric types not reporting aggregated metrics in evaluate() (#22302, @alkispoly-db)
[UI] Fix dark mode CSS not consistently applied in compare runs page (#22254, @DaoDaoNoCode)
[Tracking] Fix 500 error in start_trace when merging traces with existing metrics (#22257, @alkispoly-db)
[Model Registry / Tracing / Tracking] Fix _all_tables_exist to derive expected_tables from Base.metadata dynamically (#22128, @copilot-swe-agent)
[UI] Hide 'Show more columns' button when runs are selected (#21867, @nananosirova)
[Evaluation] Support T | None as top-level feedback_value_type in make_judge (#22201, @copilot-swe-agent)
[UI] Fix dataset details drawer: local source display, profile parsing, broken link (#22143, @Rasaboun)
[Tracking] Fix --static-prefix not applied to /api/ REST routes (#22159, @TomeHirata)
[Tracing / Tracking] Map user.id span attribute to mlflow.trace.user during OTel ingestion (#22150, @ajgassner)

Documentation updates

[Docs] Docs: Add AI Gateway CLI Tools pages (Claude Code, Codex, Gemini CLI) (#22918, @TomeHirata)
[Docs / Tracing / UI] Add documentation for Codex CLI, Gemini CLI, and Qwen Code tracing (#22412, @kriscon-db)
[Docs] Add Live Demo documentation page for demo.mlflow.org (#22840, @serena-ruan)
[Docs] Docs: Adds Middleware in the tracing section for integrated observability platforms (#22791, @luharshekhar2000-dot)
[Docs / UI] Rename guardrail stage terminology to Pre-LLM / Post-LLM across guardrail_utils.py, Gateway API, UI, docs, and guardrailValidation.ts (#22767, @copilot-swe-agent)
[Docs] Fix EvaluationDataset type references in GenAI datasets docs (#22761, @harupy)
[Docs] docs: add guardrails documentation for AI Gateway (#22577, @TomeHirata)
[] Allow different PGPORT in docker compose (#22646, @riklopfer)
[Docs] Remove docs/docs/genai/governance/ai-gateway/legacy/* and redirect legacy AI Gateway routes to ai-gateway/index (#22579, @copilot-swe-agent)
[Docs] Remove unused parameter from invocation() function example in manual tracing docs (#22524, @prithvipal)
[Docs] Document uv run --frozen flag for offline/no-network usage in CLAUDE.md (#22505, @copilot-swe-agent)
[Docs] Add documentation for multimodal trace attachments (#21783, @kriscon-db)
[Docs] Add AI Gateway Performance & Benchmarks docs page (#22390, @copilot-swe-agent)
[Docs] Update changelog for 3.11.0 release (#22394, @WeichenXu123)

Small bug fixes and documentation updates

#22993, #22978, #21482, #21321, #22559, #21319, #22483, #22346, #22091, @B-Step62; #22919, #22925, #22854, #22821, #22786, #22820, #22615, #22819, #22781, #22703, #22565, #22200, #22193, @serena-ruan; #22869, #22863, #22843, #22839, #22837, #22815, #22765, #22762, #22749, #22708, #22486, #22481, #22471, #22401, #22366, #22278, #22281, @harupy; #22848, #22775, #22764, #22763, #22772, #22527, #22435, #22358, #22357, #22356, #22355, #22261, #22259, #22202, #22234, #22243, @TomeHirata; #22824, @vinh412; #22805, #22804, #22803, #22802, #22801, #22800, #22447, #22632, #22735, #22697, #22691, #22508, #22628, #22567, #22482, #22441, #22273, #22272, #22190, #22434, #22154, #22147, #22144, #22268, #22241, #22187, #22074, @daniellok-db; #22557, #22722, #22807, #22721, #22558, #22589, #22319, #22145, #21789, @PattaraS; #22825, #22783, #22789, #22787, #22784, #22782, #22757, #22771, #22770, #22758, #22756, #22755, #22744, #22737, #22715, #22718, #22714, #22713, #22711, #22710, #22707, #22704, #22700, #22692, #22686, #22690, #22689, #22688, #22684, #22685, #22682, #22670, #22669, #22668, #22667, #22664, #22663, #22662, #22655, #22657, #22659, #22601, #22580, #22578, #22576, #22563, #22550, #22549, #22548, #22547, #22545, #22544, #22541, #22540, #22539, #22538, #22511, #22532, #22529, #22528, #22526, #22523, #22525, #22519, #22518, #22517, #22514, #22512, #22509, #22510, #22506, #22504, #22490, #22488, #22480, #22478, #22477, #22470, #22468, #22443, #22438, #22436, #21203, #22417, #22403, #22413, #22399, #22395, #22391, #22392, #22388, #22379, #22348, #22347, #22343, #22341, #22342, #22340, #22339, #22337, #22330, #22329, #22328, #22316, #22309, #22305, #22250, #22207, #22204, #22198, #22177, #22174, @copilot-swe-agent; #22795, @rollyjoel; #22629, #22730, #22614, #22573, #22334, #22502, #22448, #22196, #22263, #22186, #22185, #22184, #21956, #22183, #22246, #21955, @kriscon-db; #22627, #22238, @xsh310; #22295, #22212, @smoorjani; #22463, #22370, #22365, #22240, #22226, @xq-yin; #22473, #22439, #22437, @WeichenXu123; #22387, #21419, @mprahl; #22382, #22373, @SeldonAi; #21848, @alkispoly-db; #22160, @amotl

MLflow 3.12.0 is a release focused on improving our LLM observability workflows, making tracing more accessible, feature-rich, and performant.

🖼️ Multimodal Tracing

Users can now store multimodal content in tracing spans as artifact attachments instead of inline binary data. We've also patched the UI to support the new mlflow-attachment:// style URI, with rich rendering available for PDFs, audio, and images.

This feature works out of the box with autologging, but manual attachment management is also possible. Visit the documentation page to learn more.

🤖 Codex, Gemini, Qwen coding agent tracing support

Similar to our Claude Code tracing integration, we've now added support for the Codex, Gemini, and Qwen coding agent platforms as well! For intructions on how to get started, check out the doc pages at:

• Codex
• Gemini CLI
• Qwen Code

🛡️ Gateway guardrails

You can now set guardrails on your gateway endpoints to prevent unsafe or non-compliant model inputs and outputs. Try it out in the MLflow UI, and visit the documentation page to learn more!

⚡ Trace table pagination

The traces tab is now paginated, rather than fetching all traces up to a limit of 1000. This improves initial load time, and makes the page feel more responsive overall.

Full Changelog

For a comprehensive list of changes, see the release change log.

What's Next

Get Started

Install MLflow 3.12.0 to try these new features:

pip install mlflow==3.12.0

Share Your Feedback

We'd love to hear about your experience with these new features:

• GitHub Issues - Report bugs or request features
• MLflow Roadmap - See what's coming next and share your ideas
• ⭐ Star us on GitHub - Show your support for the project

Learn More

• Join our upcoming webinar to see these features in action
• Check out the MLflow documentation for detailed guides