We've used LangWatch for output monitoring and evaluation of our RAG application. I can't recommend it enough. We find value in iterative evaluation with tools like DSPy and RAGAS, to production optimization features like jailbreak detection + document & topic tracking, all with a great dashboard and UI. The team has built a great product. Plus the team is very responsive and helpful.
Helped me personally with my AI project. No More AI blackbox - powering decisions with insights. Helps to mitigate safety risks as well as to know where exactly the bot is hallucinating, therefore increases quality. Makes safe guarding it against malicious practices like jailbreaking possible. All in all, wonderful tool for anyone working with LLMs
Awesome to see more products launch in this field. One of the biggest challenges for companies to create AI solutions is having the right platform in place as a starting point. Can't wait to explore this product even more for my own team!