Engineering approach: Startup Mode v/s Big Tech Mode

Engineering approach: Startup Mode v/s Big Tech Mode Last week, I delivered a talk at PyDelhi discussing strategies that leverage how large language models work to improve the performance of your LLM applications. Here is the talk as a PDF. Some techniques I discussed were: Strategies for faster token throughput. Strategies for quick time to first token. Effective context window management and Model routing strategies. But here's the uncomfortable truth for founders: if you're just starti...