Arize AI

What is Arize AI?

Arize AI provides an observability and evaluation platform for AI agents and generative applications. It helps AI engineers trace, evaluate, and improve agent performance using production signals. Access is available through a managed platform (Arize AX) or a self-hosted open-source tool (Phoenix).

What are the features of Arize AI?

• Agent tracing

  Records end-to-end execution spans for AI agents based on the OpenInference standard built on OpenTelemetry.
• Evaluation framework

  Runs span, trace, and session evaluations at scale to measure whether agent quality improves or degrades.
• Automated issue resolution (Alyx)

  An in-app AI engineering agent that runs evaluations, debugs issues, and generates review-ready fixes.
• Trace datastore (ADB)

  Stores traces in open formats with native connections to BigQuery, Databricks, or Snowflake via DataFabric.
• Prompt testing

  Tests prompts and harnesses before deploying changes to production environments.
• Open-source observability (Phoenix)

  Traces LLM calls and runs evaluations locally or self-hosted while retaining data control.

What are the use cases of Arize AI?

• Pre-launch development

  Teams use the platform during development to run real-time online evaluations before shipping agents.
• Post-launch debugging

  Engineers investigate failures and monitor production performance for chatbots, RAG systems, copilots, and agents.
• Local evaluation

  Developers host Phoenix locally to trace applications and run evaluations without sending data externally.

How to use Arize AI?

1. Connect application

   Link your agent or application to Arize and send your first trace to record what happened inside each request.
2. Review traces

   Examine the generated trace data to debug, evaluate, and improve agent behavior.
3. Request automated help

   Ask Alyx, the in-app AI engineering agent, for assistance once initial tracing is configured.

Arize AI Pricing Information:

• Free access

  A "Start free" option is available; specific feature limits or quotas are not stated in the source.
• Managed platform (Arize AX)

  Requires booking a demo; pricing details are not provided in the source.
• Phoenix OSS

  Open-source tool available to run locally or self-host.