How Makers Build
Check my stackPlan my stack
Menu

MLflow

Open-source platform for the ML and GenAI lifecycle — experiment tracking, a model registry, and for LLM apps OpenTelemetry-based tracing, evaluation with LLM judges and prompt versioning.

Visit mlflow.org ↗Pricing & calculatorAlternatives
Works with AI agents:llms.txt
Ask your AI about this, with this page as the source:ChatGPT ↗Claude ↗Perplexity ↗

Where it fits

LLM Observability & Evals · Open-source platformTracing, evaluating and versioning prompts for LLM apps in the same open-source platform many teams already use for ML experiments.Trade-off: Grew out of classic ML tooling, so the UI and concepts are broader than an LLM-only tool; you run the tracking server yourself unless you use a managed version.

Who uses it

No maker's live product on record yet, and 15 open-source projects that declare it in their code.

Declared in code 15How evidence is collected →

We haven't found a maker's live product that uses MLflow yet — only the open-source projects below, which declare it in their code.

Open source: a project that declares MLflow as a dependency in its public code — verifiable, but not necessarily a live product.

Reliability and open issues

Most wanted on GitHubOpen on 2026-10-04 in mlflow/mlflow, with activity in the last year — issues and feature requests by 👍.

Alternatives to MLflow

All alternatives by situation →
LangfuseTracing, prompt management and evals in one tool you can run on your own server for free.Open sourceFree tier33 makers · LLM observability & evalsCompare with MLflow →
LangSmithApps built on LangChain or LangGraph, where tracing works with almost no setup.Free tier11 makers · LLM observability & evalsCompare with MLflow →
Arize PhoenixOpenTelemetry-based tracing and evals you can start locally in a notebook, then self-host or move to its cloud.Self-hostableFree tier
HeliconeGetting request logs, costs and latency by changing one base URL, with no SDK instrumentation.Open sourceFree tier13 makers · LLM observability & evals
BraintrustEval-driven work — scoring outputs and comparing prompts and models side by side in experiments.Free tier5 makers · LLM observability & evals
OpikTracing, evaluations and prompt optimization in an Apache-licensed platform you self-host with Docker or Kubernetes, or use on Comet's cloud.Open sourceFree tier
PromptfooRunning prompts and models against test cases from the command line or CI, including red-team tests for prompt injection and data leaks.Open sourceFree tier
DeepEvalWriting LLM evals as pytest-style tests in Python, with ready-made metrics for hallucination, faithfulness and answer relevancy.Open sourceFree tier

Questions makers ask about MLflow

Is MLflow free?

Yes — it is free, open-source software.

Is MLflow open source or self-hostable?

Open source, and you can self-host it. source ↗

Can AI coding agents work with MLflow?

It serves an llms.txt docs index.

Who uses MLflow?

No maker's live product we track yet; 15 open-source projects declare it in their code. source ↗