Is anyone using any models other than GPT to power their products?

David Steen
4 replies
We're building a free AI-powered news app but are quickly seeing how much even GPT3.5 is adding up cost-wise. Wondering if anyone has used something cheaper like Amazon Bedrock to use Claude or any open-source models? If so, what were your results?

Replies

Dexter Awoyemi
IMO GPT still outperforms the others. That's why we use it to power Nack, the app we just launched!
David Steen
@dextersjab Definitely outperforms, but the cost is also higher. For some use-cases, a lighter/smaller model makes more sense.
Dexter Awoyemi
@david_steen yeah, this is only a snapshot in time. I can't stop thinking about Google's words "we have no moat".. as well as the rise of on-device models!
David Steen
@dextersjab Yeah at the model layer the prices will compress a ton.