docs/content/copilot/reference/ai-models/model-hosting.md at main · github/docs · GitHub
Skip to content

Latest commit

 

History

History
98 lines (66 loc) · 7.43 KB

File metadata and controls

98 lines (66 loc) · 7.43 KB
title Hosting of models for GitHub Copilot
shortTitle Model hosting
allowTitleToDifferFromFilename true
intro Learn how different AI models are hosted for {% data variables.product.prodname_copilot %}.
versions
feature
copilot
category
Learn about Copilot
redirect_from
/copilot/reference/ai-models/how-copilot-serves-ai-models
contentType reference

{% data variables.product.prodname_copilot %} can use a variety of AI models. This article explains how these models are hosted and served.

OpenAI models

{% data reusables.copilot.gpt-55-promo-period %}

Used for:

  • {% data variables.copilot.copilot_gpt_5_mini %}
  • {% data variables.copilot.copilot_gpt_53_codex %}
  • {% data variables.copilot.copilot_gpt_54 %}
  • {% data variables.copilot.copilot_gpt_54_mini %}
  • {% data variables.copilot.copilot_gpt_54_nano %}
  • {% data variables.copilot.copilot_gpt_55 %}

These models are hosted by OpenAI and {% data variables.product.github %}'s Azure infrastructure.

OpenAI makes the following data commitment: We [OpenAI] do not train models on customer business data. Data processing follows OpenAI's enterprise privacy comments.

{% data variables.product.github %} maintains a zero data retention agreement with OpenAI.

All input requests and output responses processed by {% data variables.product.prodname_copilot %}'s models continue to pass through GitHub Copilot's, content filtering systems. These filters include checks for public code matches (when applied) as well as mechanisms to detect and block harmful or offensive content.

OpenAI models fine-tuned by Microsoft

Used for:

  • {% data variables.copilot.copilot_raptor_mini %}

These models are deployed on {% data variables.product.github %} managed Azure OpenAI tenant.

Anthropic models

Used for:

  • {% data variables.copilot.copilot_claude_haiku_45 %}
  • {% data variables.copilot.copilot_claude_sonnet_45 %}
  • {% data variables.copilot.copilot_claude_sonnet_46 %}
  • {% data variables.copilot.copilot_claude_opus_45 %}
  • {% data variables.copilot.copilot_claude_opus_46 %}
  • {% data variables.copilot.copilot_claude_opus_46_fast %}
  • {% data variables.copilot.copilot_claude_opus_47 %}
  • {% data variables.copilot.copilot_claude_opus_48 %}
  • {% data variables.copilot.copilot_claude_fable_5 %}

Warning

When {% data variables.copilot.copilot_claude_fable_5 %} is used, Anthropic retains data, including prompts and outputs, to operate safety classifiers that detect harmful use. Other Claude models in {% data variables.product.prodname_copilot %} remain covered by {% data variables.product.github %}'s existing data retention agreements, as documented below. Enterprise and business users need to enable the {% data variables.copilot.copilot_claude_fable_5 %} model to make it available for your organization. You can read more about Anthropic's data handling practices for this model under section F of their Service Specific Terms.

{% data reusables.copilot.model-fable-disabled %}

These models are hosted by Amazon Web Services, Anthropic PBC, and Google Cloud Platform. {% data variables.product.github %} has provider agreements in place to ensure data is not used for training. Additional details for each provider are included below:

  • Amazon Bedrock: Amazon makes the following data commitments: Amazon Bedrock doesn't store or log your prompts and completions. Amazon Bedrock doesn't use your prompts and completions to train any AWS models and doesn't distribute them to third parties.
  • Anthropic PBC: {% data variables.product.github %} maintains a zero data retention agreement with Anthropic for generally available Anthropic features in {% data variables.product.prodname_copilot %}. Some Anthropic features in beta or {% data variables.release-phases.public_preview %}—including tool search via the Messages API—are not covered by this agreement. For these features, data may be retained by Anthropic in accordance with Anthropic's ZDR documentation. {% data variables.product.github %} will update this page as ZDR coverage changes.

To provide better service quality and reduce latency, {% data variables.product.github %} uses prompt caching. You can read more about prompt caching on Anthropic PBC, Amazon Bedrock, and Google Cloud.

When using {% data variables.copilot.copilot_claude %}, input prompts and output completions continue to run through {% data variables.product.prodname_copilot %}'s content filters for public code matching, when applied, along with those for harmful or offensive content.

Google models

Used for:

  • {% data variables.copilot.copilot_gemini_25_pro %}
  • {% data variables.copilot.copilot_gemini_3_flash %}
  • {% data variables.copilot.copilot_gemini_31_pro %}
  • {% data variables.copilot.copilot_gemini_35_flash %}

{% data variables.product.prodname_copilot %} uses {% data variables.copilot.copilot_gemini_31_pro %}, {% data variables.copilot.copilot_gemini_3_flash %}, and {% data variables.copilot.copilot_gemini_25_pro %} hosted on Google Cloud Platform (GCP). When using {% data variables.copilot.copilot_gemini %} models, prompts and metadata are sent to GCP, which makes the following data commitment: {% data variables.copilot.copilot_gemini %} doesn't use your prompts, or its responses, as data to train its models.

To provide better service quality and reduce latency, {% data variables.product.github %} uses prompt caching.

When using {% data variables.copilot.copilot_gemini %} models, input prompts and output completions continue to run through {% data variables.product.prodname_copilot %}'s content filters for public code matching, when applied, along with those for harmful or offensive content.

Microsoft models

{% data variables.copilot.copilot_mai_code_1_flash %} is a first-party Microsoft model hosted on Azure in {% data variables.product.github %}'s tenant.

Inline suggestions

Inline suggestions, including ghost text and next edit suggestions, are powered by models hosted on Azure for {% data variables.copilot.copilot_business_short %} and {% data variables.copilot.copilot_enterprise_short %} plans. {% data variables.copilot.copilot_free_short %} and {% data variables.copilot.copilot_student_short %} user models are hosted on Fireworks AI.