Evaluating performance and efficiency of the GitHub Copilot agentic harness across models and tasks

While the model provides the raw intelligence, the harness shapes how effectively that intelligence is applied. The GitHub Copilot agentic harness is a single shared component of the GitHub Copilot SDK , which powers the GitHub Copilot CLI , GitHub Copilot app , and Copilot code review , along with a wide variety of experiences across GitHub and Microsoft. Improve the harness, and every surface benefits. The GitHub Copilot agentic harness powers GitHub Copilot experiences. The tools, context, and workflow are orchestrated by the harness. A harness should be fast, token-efficient, and predictable for developers. That’s what we designed GitHub Copilot’s agentic harness to do. In this post, we’ll present data showing the efficiency and performance of the GitHub Copilot agentic harness across a wide range of agentic software engineering tasks. More optimizations we are making Read more about our latest optimizations on context handling and model routing to get the most out of each token . We have also shared more about experiments and optimizations around delegation , and how it benefits developers today. How we iterate with benchmarks We continuously evaluate the capability and efficiency of the GitHub Copilot agentic harness through a combination of public and internally developed benchmarks. Our public benchmarks include industry standards, while several internal benchmarks are derived from large codebases inside GitHub and Microsoft. We complement this with real-world metrics and online experiments to ensure we understand the harness’s performance in controlled environments and its practical impact on agentic problem solving and task completion. We control as many variables as possible to evaluate the performance of GitHub Copilot’s harness compared to the model provider’s harness: use the same model , the same benchmark task , normalized on context window, reasoning efforts, tool selection, and MCP servers. Below we report our latest results for a subset of the ben