AI Cost Optimization

Veeresh Devireddy
1 reply
What strategies do you use to reduce the cost of AI in production, distribution, and maintenance? How are you optimizing it?

Replies

Wiktor Wysocki
Mostly via rethinking the way of prompting, but not the length of the prompts - as it could decrease quality. I do it by lowering the number of prompts. If example my program used 12*n*n prompts and now it uses 12*n it is a greater improvement in most cases than just shortening the prompt.