Parallelizing LLM Calls: Sectioning and Voting
·6 min·AI
Parallelizing LLM calls is not a single pattern. Sectioning runs different subtasks on the same input; voting runs the same task several times and aggregates. Choosing the wrong shape produces the wrong kind of improvement.