
GitHub Copilot: Bing Web Search and Site Access
GitHub Copilot Chat uses Bing or model web search. GitHub documents no Copilot crawler or user agent. What site owners can control.
3 min read
LATEST

GitHub Copilot Chat uses Bing or model web search. GitHub documents no Copilot crawler or user agent. What site owners can control.

How Gemini uses web pages: grounding from the Google Search index, the Google-Extended robots.txt token, user-triggered fetchers and sources.

GPT-NeoX is the EleutherAI training library and 20B open model. It has no web access or crawler. Its training data, the Pile, includes Common Crawl text.