wiseseo:~/news/week-in-technical-seo-2026-11-16-22 $

date
category
[AI]
impact
MED
status
CONFIRMED
read
7 min

Week in technical SEO: Nov 16–22, 2026

Agents, AI answers, and new Search Analytics API filters from the twelve technical SEO briefs published 16–22 November 2026.

TL;DR

  • Google published a Google-Agent allow guide and began rolling Gemini Tasks out free in six countries. ChatGPT in-answer links hit 58%.
  • On 16 November the Search Analytics API added branded, multimodal and multi-country filters while the November core update was still rolling out.
  • Mueller warned a 200 outage page can fold URLs into duplicates, and shrinking a site will not fix a mass not-indexed share.
  • Allow verified Google-Agent if agents should act, return 503 in an outage, and read the core update in Search Console a week after it finishes.

This week, agents and AI answers changed how pages are found and used. Google published a guide for letting Google-Agent through CDNs, WAFs, and bot tools, started rolling Tasks in Gemini out free in six countries, and a Searchable analysis found that 58% of ChatGPT answers link a page inside the text, with 25% of answers linking at least one page that is not in the sources list. On 16 November the Search Analytics API added branded classification, a multimodal search type, and filters for several countries or devices in one request, while the November 2026 core update was still rolling out.

Crawling & Indexing

  • On 17 November 2026, Google added a guide for letting Google-Agent through CDNs, firewalls, and bot tools. Recognise it by a Google-Agent user agent, an IP in user-triggered-agents.json, and optionally a Web Bot Auth signature, then skip challenges on the whole journey, including search, cart, booking, and API endpoints. It is a user-triggered fetcher, so robots.txt does not control it, and a category "AI agent" block or a cloud-IP challenge will catch it. Google does not say that allowing or blocking it affects Search rankings. Google publishes a guide to stop your WAF blocking Google-Agent.
  • John Mueller restated that a maintenance page returning 200 with "back soon" text can get that text indexed, and can be folded together with other URLs showing the same text. The indexed text clears once the real content returns. The duplicate problem is slower to undo, because duplicates tend not to get crawled as often. Google's docs say a short outage should return 503, which keeps already indexed URLs for a while and ignores the error content. A 200 is passed to indexing, and Search Console reports a soft 404 when that content looks like an error or an empty page. Mueller: a 200 "back soon" page during an outage can cost you indexed URLs.
  • Asked about a large, persistent "Crawled - currently not indexed" or "Discovered - currently not indexed" share, Mueller said this usually means Google's quality systems are unconvinced, and that "Just making the site smaller doesn't significantly raise the overall quality of the site." Noindexing or redirecting the rejected URLs to make the site smaller does not, by itself, change that judgement. A tiny indexed share can still be a severe technical issue, and the help page still calls a non-zero not-indexed count common. Mueller: shrinking a site will not fix a mass not-indexed problem.

Search Console

  • The Search Analytics API accepts brandedClassification (BRANDED or NON_BRANDED, equals only), the same split as the branded queries filter in the Performance report. The field reached the API on 16 November 2026. Grouping by it keeps clicks from anonymised queries that a query regex drops. Jan Caerels reports that, in his experience, some sites lose 30-80% of clicks when a query filter is applied. That range is his, not a figure Google has published. The filter cannot be combined with a query filter, data starts on 21 February 2026, and any other property gets a response with no rows. Grouping by brandedClassification keeps clicks a brand regex drops.
  • On 16 November 2026, Daniel Waisberg, Nati Yosephian, and Karin Gadasi added three cuts that already existed in the Performance report: brandedClassification, a webMultimodal type for Google Lens, Circle to Search, and image uploads, and filterLists for several countries or devices in one request. The November 2026 core update started at 10:06 US/Pacific on 10 November and was still active as of 17 November. Google says to wait until the rollout finishes, wait at least another week, and analyze search types separately. A dashboard that only requests web can look stable while Lens or Circle to Search traffic moves, and these fields do not say why a page moved. New Search Analytics API filters arrived in the middle of a core update.
  • On 17 November 2026, Search Engine Roundtable reported that some people are asked to sign in to Google Search after the first query. Brodie Clark of SerpAlerts said he was forced to sign in before he could view results, including in a Chrome Incognito window. Rajan Patel of Google said he would look into it, that he did not believe it was meant to happen on the first page of results, and that Google may be testing something. An unattended tracker can record a login page or a gap as a ranking change, which is easy to misread while the core update is still rolling out. Nobody has published a rate, a country list, or a statement that rank-tracking tools are the target. Google is testing a sign-in wall after the first search.

AI Search

  • Emilia Möller of Searchable writes that in-answer links in ChatGPT changed once GPT-6 reached free users in early October 2026. Through September, fewer than 1 in 10 answers had an in-answer website link. That share is now 58%. In 33% of answers every link is also in the sources list, and in 25% at least one link points to a page that is not, so a citation report misses URLs ChatGPT is already sending people to. More links do not automatically mean more clicks. The figures are Searchable's, and the post did not publish the sample size or the query mix. ChatGPT now links pages it never cites.
  • Rand Fishkin's SparkToro study of 118,163 ChatGPT prompts from 12,321 US users, collected 1 January through 29 October 2026, found that 6.9% show any purchase intent. ChatGPT named a brand, product, or company in 12.1% of responses. His conclusion is that AI visibility still matters because of Google AI Overviews and AI Mode, not because of ChatGPT. In earlier SparkToro work on 332 million Google queries, 15% or more matched a similar purchase-intent definition, and he estimates that people ask Google purchase-journey queries at 16 times or more the rate they ask ChatGPT. The panel is opt-in and US, weighted toward lighter users after 131 heavy users were removed. ChatGPT rarely sees a buyer. Google still does..
  • On 11 November 2026, Google published the Gemini Decisions API, powered by gemini-decision-1. One request scores yes/no, multiple-choice, and rubric questions in a single pass, at $0.10 per million input tokens and $0 for output tokens. It is a developer tool for closed questions, such as labeling a keyword export by intent or grading a URL against a checklist you write. It does not change crawling, indexing, or ranking. Google says Search uses the Decision API to detect adversarial behavior and content, as a safety layer for MCP tools. Google's Decisions API: classify keywords and audit pages for pennies.
  • On 17 November 2026, Josh Woodward announced that Tasks in Gemini is rolling out free for hundreds of millions of people in the U.S., Japan, Korea, Canada, Australia, and India, on Gemini 4 Hydrogen. Tasks run in the background and can go through a site. Calls, Google Pay, email, and text start in the U.S., and nothing is bought without an explicit tap and device approval. Geektime reports that Gemini Spark is now Tasks, after being limited to Google AI Pro and Ultra. Google's post does not use the name Spark. Pricing, stock, checkout, login, and booking have to work for an automated browser, in clear HTML, because a blocker is where that run stops. Gemini Spark is now Tasks, and it's free. Your site needs to work for agents..
  • On 17 November 2026, OpenAI published GPT-6.2 Astra, for the hardest projects, and GPT-6.2 Sol, for everyday work. Both are available to Plus, Pro, Enterprise, and Edu users in ChatGPT Work and Codex, and to developers in the API. The ChatGPT docs also list Business for Work. The announcement does not mention ChatGPT search, a sources list, or links inside an answer. After GPT-6 reached free ChatGPT users, Searchable measured in-answer links moving from under 10% of answers to 58%, so prompts on the plans that show Astra or Sol are worth rechecking. OpenAI did not announce a search change, so this is not a reason to rewrite titles or indexation. GPT-6.2 Astra and Sol are live in ChatGPT. Recheck your AI visibility..

Links & content

  • Cyrus Shepard's Zyppy study, published 18 November 2026, used Ahrefs data on 535 sites with healthy Google traffic and nearly 4,000 top link-earning URLs. Data-tracking pages came in at 1,491 linking root domains per URL, tools and calculators at 1,466, and generic articles and guides finished last at 28. Shepard says writers and journalists link to the same kinds of pages AI answers like to cite: original data, reference material, and unique facts. The counts are observational, from sites that already earn traffic, not a controlled test. Cyrus Shepard: blog posts earn the fewest natural links.

Top 3 things to do this week

  1. If agents should complete actions on your site, allow verified Google-Agent — user agent plus the published IP list, above "AI agent" and cloud blocks, skipping CAPTCHAs — across search, cart, booking, and APIs. Put price, stock, checkout, login, and booking in clear HTML.
  2. Treat mid-November rank-tracker charts as provisional. Read the November core update in Search Console after the rollout is marked finished, then wait the extra week Google recommends. Keep branded and non-branded, and web and webMultimodal, as separate series.
  3. Return 503 from an outage page, and improve the pages you want indexed instead of noindexing or shrinking the site to clear a not-indexed list. Turn one recurring question into a maintained data page, tool, or reference, with the method and the last-updated date on the page.

refs

  1. [1] Allow Google-Agent traffic (Google Crawling infrastructure docs)https://developers.google.com/crawling/docs/crawlers-fetchers/allow-google-agent
  2. [2] Google On Why Serving A 200 Status Code When Your Site Is Down Is Bad (Search Engine Roundtable)https://www.seroundtable.com/google-200-status-code-site-down-42542.html
  3. [3] John Mueller on Bluesky: making a site smaller does not raise overall qualityhttps://bsky.app/profile/johnmu.com/post/3mzycywr5vs26
  4. [4] New filtering and reporting capabilities in the Search Analytics APIhttps://developers.google.com/search/blog/2026/11/search-analytics-api-update
  5. [5] Search Analytics: query (Search Console API reference)https://developers.google.com/webmaster-tools/v1/searchanalytics/query
  6. [6] Google Testing Sign In Protections After First Search (Search Engine Roundtable)https://www.seroundtable.com/google-sign-in-protections-after-first-search-42557.html
  7. [7] Emilia Möller (Searchable) on LinkedIn: ChatGPT in-answer links versus cited sourceshttps://lnkd.in/p/eZ3gVU4N
  8. [8] We Analyzed 118,000 ChatGPT Prompts from 12,000+ Users (SparkToro)https://sparktoro.com/blog/we-analyzed-11800-chatgpt-prompts-from-12000-users-to-answer-how-do-americans-use-ai-tools-in-2026/
  9. [9] Gemini Decisions API: Fast, calibrated multimodal decisionshttps://blog.google/innovation-and-ai/technology/developers-tools/gemini-decisions-api/
  10. [10] Put Gemini to work for youhttps://blog.google/innovation-and-ai/products/gemini-app/tasks-in-gemini-free-new-features/
  11. [11] Introducing GPT-6.2 Astra and Solhttps://openai.com/index/introducing-gpt-6-2-astra-sol
  12. [12] How to Build Backlinks on Autopilot: 535-Site Study (Zyppy)https://signal.zyppy.com/p/seo-backlinks