What are your biggest learnings when building with GPT?

Here are mine! #1 You can't just feed everything to GPT and expect an answer. Whatever your use case, these models are craaaazy expensive, and have all a limit of input. An average team on our platform has 5000 docs, 1.5M words, 3M tokens. The limit is 4,000 tokens... 😅 -> You need a way to cut your input 🤫 #2 Keep cost low with other models 💸 Even if you restrict your GPT usage - and you should - it is crazy costly. GPT is not great for everything. You have much better models for classifications, embedding and so on. 👉Be smart, and as much as possible keep GPT for the last mile of your interface. #3 Generate *accurate* results. In our case the result is an answer. Now, let's say you write in a doc "Van Gogh painted Mona Lisa". If you ask Slite who did.., it will answer VanGogh 😅 Your docs, your answers 🤷 It's our secret sauce but we manage to give the sources the answer went from, and while its just a UX tweak - we'll still say Van Gogh ^^ - it changes everything for your user. -- That's it, here are my learnings! Share yours and if you're curious about what we build, support and check it out 🙌 https://www.producthunt.com/post...

Really true and we have faced similar issues.

What did you do to cut the cost? Specifically in fine tunning model?