Show HN: All you need is Prometheus and Jaeger for LLM Observability https://ift.tt/olkrbuj

Show HN: All you need is Prometheus and Jaeger for LLM Observability Hey folks! I'm thrilled to let you all know about something my friend and I have been working on at [OpenLIT]( https://ift.tt/TMLOhD9 )! For those of you working with LLMs, we’ve got some pretty cool updates. We’ve successfully integrated Prometheus and Jaeger—yes, the go-to observability tools to fully support your LLM application observability. This means you can stick with the tools you already know and trust! Here's how it works: Imagine spending less time on setup and more on what truly matters: enhancing features and functionality. OpenLIT simplifies the process of adding observability to your LLM applications through OpenTelemetry (OTel). Just a single line of code and you can start monitoring key attributes like costs, token usage, user interactions, and performance metrics. And it doesn't stop at Prometheus and Jaeger! OpenLIT is also compatible with other backends like Grafana Tempo, or any OTel-compatible system, giving you the flexibility to store and visualize data just the way you like it. Head over to our guide to get started. Oh, and we've set you up with a Grafana dashboard that's pretty much plug-and-play. You're going to love the visibility it offers. We're super keen to see how OpenLIT integrates into what you’re doing! Give it a go and share your thoughts. Your feedback is super valuable and will help us make OpenLIT even better. Swing by and star our project on GitHub here -> https://ift.tt/TMLOhD9 Can’t wait to see OpenLIT in action in your LLM applications! Cheers! Patcher https://ift.tt/ZsKfN0c May 28, 2024 at 01:56AM