Very helpful writeup on LLMs in production: What We’ve Learned From A Year of Building with LLMs