As our use of LLMs has changed from conversational chatbots and into integral decision-making components of complex systems, our inference approach must also evolve.