Ultra 2024 Splitwise

Ultra 2024 Splitwise. March 26th, 2024 ultra music festival 2024: Splitwise is a technique that splits the two phases of llm inference requests on separate machines to optimize throughput, cost, and power.

See the number of runners, finishers, dns, dnf and dsq for each distance. The paper presents the design.