Menu
Documentationbreadcrumb arrow Grafana Cloudbreadcrumb arrow Monitor infrastructurebreadcrumb arrow Grafana integrationsbreadcrumb arrow Integrations referencebreadcrumb arrow AI Observability
Grafana Cloud

AI Observability integration for Grafana Cloud

AI Observability Integration for Grafana Cloud provides a comprehensive solution for monitoring and analyzing the performance of AI models. This integration allows users to collect and visualize key metrics related to AI and LLM operations, ensuring optimal performance and reliability.

This integration includes 1 pre-built dashboard to help monitor and visualize AI Observability metrics.

Dashboards

The AI Observability integration installs the following dashboards in your Grafana Cloud instance to help monitor your system.

  • GenAI Observability

Metrics

The most important metrics provided by the AI Observability integration, which are used on the pre-built dashboard, are as follows:

  • db_requests_total
  • gen_ai_requests_total
  • gen_ai_usage_completion_tokens_total
  • gen_ai_usage_cost_USD_bucket
  • gen_ai_usage_cost_USD_sum
  • gen_ai_usage_input_tokens_total
  • gen_ai_usage_tokens_total
  • up

Changelog

md 
# 0.0.1 - September 2024

* Initial release

Cost

By connecting your AI Observability instance to Grafana Cloud, you might incur charges. To view information on the number of active series that your Grafana Cloud account uses for metrics included in each Cloud tier, see Active series and dpm usage and Cloud tier pricing.