Tag: llm
The LLM writes, the model decides
Pair a writing LLM like Claude with a cheap decision model that only returns numbers, such as TypeSafe Jev. Three ways to split the work, why a probability Claude writes down is a self-report and not a measurement, and why a reason written after the fact for a bare number is worse than no reason.
Good-enough AI will eat the premium-model business
Good-enough AI is driving commoditization from below. Stanford HAI clocked a 280-fold drop in the cost of running a GPT-3.5-level model. Once a cheaper model clears the bar for a job, the frontier model stops earning its premium for that job.
How to prompt engineer like a pro
Great prompts are discovered through iteration, not designed upfront. After testing hundreds of prompts across multiple models at Tallyfy, here is what actually works for professional prompt engineering.