AI Engineering / Signal to Build In-House Measurement
How Do You Test Agent Inference Acceleration? Tool Waits, Time to First Token, and Failures Across 32 Real Tasks
32 real website verification tasks, paired comparison of serial and parallel reads, preserving network failures, first-token wait, correctness, and token usage; distinguish tool orchestration from model prefill, and do not promise universal speedup.