Large Language Models¶
- Transformers
- Stateless
- Non deterministic, the same prompt can lead to different responses
Key to successful llm applications¶
- Deterministic software with strategic LLM calls placed exactly where tey add value.
- You don't want your LLM making every decision. You want it handling the one thing it's good at, which is reasoning with context while your code handles everything else.