AI Fundamentals · Intermediate

    Mastering LLM Observability with Arize Phoenix

    This course addresses the critical need for LLM observability using Arize Phoenix, an open-source platform built for monitoring and diagnostics. Participants will learn to identify issues like bias, hallucination, and drift, giving them ma…

    11+
    enrolled
    4 hrs
    of instruction
    18
    lectures
    5
    modules
    Mastering LLM Observability with Arize Phoenix

    What's inside

    Live sessions
    6 · 133 min
    Readings
    11

    01 · What you'll be able to do

    Five things you can ship afterwards.

    This course addresses the critical need for LLM observability using Arize Phoenix, an open-source platform built for monitoring and diagnostics. Participants will learn to identify issues like bias, hallucination, and drift, giving them mastery over the tool, empowering them to build trustworthy, cost-effective AI systems.

    Understand the critical need

    Understand the critical need for observability in large language model (LLM) applications and the challenges associated with unmonitored LLM behavior.

    Gain hands-on experience

    Gain hands-on experience using Arize Phoenix for real-time monitoring, traceability, and evaluation of LLM outputs.

    Learn to identify

    Learn to identify and measure key performance indicators (KPIs) like coherence, hallucination rate, and drift in LLM-based systems.

    Master the ingestion

    Master the ingestion and structuring of LLM trace data (spans, traces, and events) to facilitate transparent and meaningful analysis.

    Explore advanced LLMOps workflows

    Explore advanced LLMOps workflows and observability techniques using Arize Phoenix’s architecture, integrations, and MCP Server.

    02 · Curriculum

    What's in the course.

    5 modules · 18 lectures · 133 min of sessions

    01 · 49m02 · 38m03 · 22m04 · 24m

    Each block is one module, sized by session length.

    • LLM Observability and its ImportanceReading
    • Identifying KPIs relevant to LLMs49m
    • Key Performance Indicators for Measuring LLM PerformanceReading

    04 · Is it for you?

    Who it's for, and what to bring.

    Built for

    • Beginners to Intermediate

    Bring with you

    • This course addresses the critical need for LLM observability using Arize Phoenix, an open-source platform built for monitoring and diagnostics. Participants will learn to identify issues like bias, hallucination, and drift, giving them mastery over the tool, empowering them to build trustworthy, cost-effective AI systems.

    05 · FAQ

    Before you enrol.

    Each of the 5 modules is a recorded live session, with readings from that session. Watch at your own pace.

    $49.99

    Ready to start?

    $49.99, or free with Premium membership.

    Get Premium