Athina - Build, test and monitor AI apps and agents

Hey PH, I'm Shiv, a co-founder of Athina AI. Building GenAI applications is a lot of hard work. Most teams are able to build prototypes quickly, but end up spending months getting their AI to work well in production. A big part of the problem is a lack of good tooling. We've seen countless teams using scripts, python notebooks, spreadsheets, and even google docs to work with their prompts and datasets. But these tools are not designed for building production-ready AI. 😥 Which is why many teams including unicorns like Perplexity, Meesho, and Doximity are choosing to use Athina... 🙌 We've spent the last 1.5 years building a comprehensive platform for teams building production-grade AI features. Athina is an end-to-end LLM development platform that teams can use across the AI development lifecycle: ✅ Prompt Management: Manage, iterate, test and version control prompts ✅ Flows: Build powerful multi-step AI workflows in a notebook ✅ Datasets: Work with your datasets in a powerful spreadsheet-like UI ✅ Evaluation: Run evals on uploaded datasets, in CI / CD, or automatically on traces ✅ Experiments: Run experiments to compare outputs from different prompts / models ✅ Annotation: Have humans annotate your datasets for RLHF or human evaluation. ✅ Observability: Log traces, run evals continuously in production and monitor for regressions And here's the best part – Athina is designed for both non-technical AND technical users to collaborate. So your entire team can work together to build AI features without being bottlenecked on engineers to build flows or run experiments. No-code + SDK! 🔥 ----- 🟠 We're backed by Y Combinator and have been working with some of the best AI teams in the world over the last year. We're really excited to finally bring this platform to Product Hunt for everyone! 🌐 Website: https://athina.ai 🗓️ If you're interested in learning more, or seeing a demo, please feel free to get in touch with us: https://cal.com/shiv-athina/30min

The LLM platform every product team needs - congratulations guys!!!

Looks insanely cool, might even be able to use this for a current project we're running - I have to say, big fan of the name too - That was what initially caught my eye.

Athina has a broad set of powerful tools. We use it from prototyping a new idea, to refining it, to monitoring it production.

Awesome team! Highly recommend getting a demo with @shivsak

Great job guys! We've been using Athina and it's a MUST have tool in your AI team!

Congratulations on the launch! We've been using Athina AI and it's been saving us so much time with our annotations. Previously, we'd have to curate our datasets amongst different annotators on Google Sheets and it's a massively painful process. With Athina, we're able to curate our datasets (with inter-annotator agreements) much more easily and create much higher quality Evals.

This is a game-changer! Great job, guys!

It's a great product: comprehensive and user-friendly. We initially used Athina primarily for logging, but it has become increasingly integrated into our model development and evaluation process.

Very exciting! Highly recommend, Shiv and team are great.