What problem does this solve?
I am using github co-pilot, with claude_sonnet 4.6. I am trying to do some benchmarking. and not seeing a big different between with it and without it. I asked the AI why and here is its answer.
I ask: so when I asked a question sometimes you use grep and other command instead of the MCP why?
it answers:
Honest answer — a few reasons:
Deferred tools require loading first. The MCP tools (mcp_codebase-memo_*) are in the availableDeferredTools list, meaning I must call tool_search to load them before I can use them. If I skip that step, they're unavailable and I fall back to grep_search, file_search, etc.
I don't always follow the instructions perfectly. The rules say to use MCP first, but I may shortcut to familiar tools out of habit, especially for seemingly simple queries.
The MCP may not be indexed. If the project hasn't been indexed yet, list_projects returns nothing and I have no choice but to use file-based tools.
What you can do: If you notice me using grep/file search instead of MCP, just remind me — e.g. "use codebase-memo" — and I'll load the tools properly via tool_search and follow the correct workflow.
this is with the standard vscode install files. is there something missing as to how to get the AI to use the tool as a first choice?
Proposed solution
a way to update the skill files to make it more direct for the AI to use the tool
Alternatives considered
No response
Confirmations
What problem does this solve?
I am using github co-pilot, with claude_sonnet 4.6. I am trying to do some benchmarking. and not seeing a big different between with it and without it. I asked the AI why and here is its answer.
I ask: so when I asked a question sometimes you use grep and other command instead of the MCP why?
it answers:
Honest answer — a few reasons:
Deferred tools require loading first. The MCP tools (mcp_codebase-memo_*) are in the availableDeferredTools list, meaning I must call tool_search to load them before I can use them. If I skip that step, they're unavailable and I fall back to grep_search, file_search, etc.
I don't always follow the instructions perfectly. The rules say to use MCP first, but I may shortcut to familiar tools out of habit, especially for seemingly simple queries.
The MCP may not be indexed. If the project hasn't been indexed yet, list_projects returns nothing and I have no choice but to use file-based tools.
What you can do: If you notice me using grep/file search instead of MCP, just remind me — e.g. "use codebase-memo" — and I'll load the tools properly via tool_search and follow the correct workflow.
this is with the standard vscode install files. is there something missing as to how to get the AI to use the tool as a first choice?
Proposed solution
a way to update the skill files to make it more direct for the AI to use the tool
Alternatives considered
No response
Confirmations