Monitor OpenAI easily with Grafana
Easily monitor your OpenAI API usage with Grafana Cloud’s out-of-the-box monitoring solution. The Grafana Cloud forever-free tier includes 3 users and up to 10k metrics series to support your monitoring needs.
OpenAI API usage stat panels and Total Tokens, Request Duration panels
Token Usage by Model and Completition Token panels and OpenAI Prompts and Response Table
Key metrics included
openai_completionTokens
openai_promptTokens
openai_requestDuration
openai_totalTokens
openai_usageCost
up
Key alerting rules included
HighCompletionTokensUsage (Critical)
HighPromptTokensUsage (Warning)
HighTotalTokensUsage (Critical)
LongRequestDuration (Warning)
HighUsageCost (Critical)