Is anyone using any models other than GPT to power their products?
David Steen
4 replies
We're building a free AI-powered news app but are quickly seeing how much even GPT3.5 is adding up cost-wise. Wondering if anyone has used something cheaper like Amazon Bedrock to use Claude or any open-source models?
If so, what were your results?
Replies
Dexter Awoyemi@dextersjab
Nack AI
IMO GPT still outperforms the others. That's why we use it to power Nack, the app we just launched!
Share
NewsParrot
@dextersjab Yeah at the model layer the prices will compress a ton.
NewsParrot
@dextersjab Definitely outperforms, but the cost is also higher. For some use-cases, a lighter/smaller model makes more sense.
Nack AI
@david_steen yeah, this is only a snapshot in time. I can't stop thinking about Google's words "we have no moat".. as well as the rise of on-device models!