SkillMaxx / Monitoring / Mlflow

Mlflow logo

Mlflow

Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.

PluginMonitoringSource ↗Claude marketplace ↗

Stars
★ 81
Last updated
Hands-on tests
Tested ✓ in 1 of 5

Install

✕ Failed✓ Verified from docsOfficial docs ↗
/plugin install mlflow@claude-plugins-official

Failed on 2026-10-16: the install or load check didn't pass in our sandbox. It may need an account, API key or extra setup.

Log excerpt
Installing plugin "mlflow@claude-plugins-official"...✔ Successfully installed plugin: mlflow@claude-plugins-official (scope: user)
$ verify:
  ❯ mlflow@claude-plugins-official
    Status: ✘ failed to load
    Error: Hook load failed: Duplicate hooks file detected: ./hooks/hooks.json resolves to already-loaded file /home/sbx/.claude/plugins/cache/claude-plugins-official/mlflow/1.0.0/hooks/hooks.json. The standard hooks/hooks.json is loaded automatically, so manifest.hooks should only reference additional hook files.
1 run, latest 2026-10-16

MLflow Skills for Coding Agents

Turn your favorite coding agent into an LLMOps expert with MLflow skills.

Build, debug, and evaluate GenAI applications with confidence. These skills give your AI coding assistant deep knowledge of MLflow's tracing, evaluation, and observability features.

Works with any coding agent that support Skills, including Claude Code, Cursor, Codex CLI, Gemini CLI, and OpenCode.

Why MLflow Skills?

Building production-ready AI agents is hard. You need observability to understand what your agent is doing, evaluation to measure quality, and debugging tools when things go wrong. MLflow provides SDKs and best practices for all of these operations, and with skills we bring them directly into the environment where LLM agent development happens. Now you can go to your favorite coding agent and just ask:

  • "Add tracing to my LangChain app" → Instruments your code automatically
  • "Why did this trace fail?" → Analyzes spans, finds root causes, suggests fixes
  • "Evaluate my agent's accuracy" → Sets up datasets, scorers, and runs evaluation
  • "Improve my agent and verify your work" → Gives the coding agent reproducible and verifiable mechanism with MLflow eval to hill climb on quality
  • "Show me token usage trends" → Queries metrics and analyze trends

Available Skills

Observability & Debugging
Skill Description
instrumenting-with-mlflow-tracing Instruments Python and TypeScript code with MLflow Tracing. Supports OpenAI, Anthropic, LangChain, LangGraph, LiteLLM, and more.
analyze-mlflow-trace Debugs issues by examining spans, assessments, and correlating with your codebase.
analyze-mlflow-chat-session Debugs multi-turn chat conversations by reconstructing session history and finding where things went wrong.
retrieving-mlflow-traces Powerful trace search and filtering by status, session, user, time range, or custom metadata.
debug-agent Root-causes agent failures from existing MLflow traces without requiring a code change or evaluation suite.
Read the full README on GitHub →

Preview from the source repo. Images are removed.

Similar alternatives

Langfuse

Plugin · Monitoring

Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and...

★ 306Tested ✓ in 2

Sentry CLI

Plugin · Monitoring

Skills for using the Sentry CLI to interact with Sentry from the command line

★ 124Tested ✓ in 2

Honeycomb

Plugin · Monitoring

Skills, agents, and workflows for Honeycomb observability — query patterns, production investigations, SLOs,...

★ 27Tested ✓ in 2

Dynatrace

Plugin · Monitoring

Dynatrace observability skills: DQL query patterns, application and infrastructure monitoring, log analysis,...

★ 164Tested ✓ in 2

↑↓ to move · Enter to open · Esc to close