LLMonitor
LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.
Installation and Setup
Create an account on llmonitor.com, then copy your new app's tracking id.
Once you have it, set it as an environment variable by running:
export LLMONITOR_APP_ID="..."
Callbacks
See a usage example.
from langchain.callbacks import LLMonitorCallbackHandler