AI-based tools for better observability

Easily identify if metrics are unused or partially used and aggregate them into lower cardinality versions with Adaptive Metrics. On average, companies have been able to reduce metrics costs by 35%.

• Receive daily updated recommendations that adapt to your usage patterns
• Apply or skip aggregations as needed with rule management directly in the UI
• Identify and isolate critical metrics that can be excluded from aggregations

AI Observability in Grafana Cloud helps teams monitor and optimize generative AI applications with insights into LLMs, vector databases, and GPUs.

• Monitor user interactions with LLMs, such as prompts and completions, to better understand user intent and model performance.
• Track and visualize token usage for LLM interactions to optimize resource allocation.
• Monitor and analyze costs associated with LLMs in real time for effective budget management, forecasting, and cost-saving.
• Capture metadata for each LLM request, including request parameters, response times, model versions, and other details.
• Track the latency of each request to identify bottlenecks and enable prompt issue resolution.
• Monitor the performance of your vector database query response times and throughput to ensure efficient processing and retrieval of vector data queries.

Replace tedious tasks with GenAI features that reduce toil.

• Collect important post-incident review details in one click with Grafana Incident auto-summary
• Speed up troubleshooting with Flame graph AI, which interprets flame graph data via an LLM
• Create PromQL queries faster using generative AI
• Get AI-generated titles and descriptions for your Grafana dashboards