AI Cost Optimization
Veeresh Devireddy
1 reply
What strategies do you use to reduce the cost of AI in production, distribution, and maintenance? How are you optimizing it?
Replies
Wiktor Wysocki@wiktor_wysocki
Mostly via rethinking the way of prompting, but not the length of the prompts - as it could decrease quality. I do it by lowering the number of prompts. If example my program used 12*n*n prompts and now it uses 12*n it is a greater improvement in most cases than just shortening the prompt.
Share