Choosing LLMs for Your Products: What’s Most Important to You?
Natalia Demianenko
5 replies
If you’re incorporating LLMs into your products, how do you decide which one to use? Which of these factors is most crucial for you, and are there any other considerations you take into account?
Replies
Nancy Wright@nancywright
Accuracy is definitely the top factor for me too. If the responses aren't reliable, it defeats the whole purpose of using an LLM. Customization options are nice to have for tailoring the outputs to your specific use case. And of course price matters, but I'd prioritize quality over saving a few bucks. Curious what LLM providers people have had the best experience with on those fronts?
Share
@nancywright I agree - accuracy is paramount when choosing an LLM. Customization and quality definitely come first, even if it means spending a bit more. I'm also curious about which providers others have had the best experience with
Customization is key for me. Being able to fine-tune the LLM on my specific domain and use case is critical to getting high quality, relevant outputs tailored to my product's needs. Of course accuracy and reliability matter too, but without customization, even a high quality generic model may not be the best fit.
For sure latency and reliability matter a ton. Like if the LLM is super high quality but takes forever to respond or goes down all the time, that's a no-go. Customization is key too - being able to fine-tune the model on your specific use case and data. Price matters but I'd pay more for better performance. Support and ease of integration are important considerations too.
Why do some businesses hesitate to embrace open-source AI solutions fully? Who do you think will win the battle?