Provide A Detailed Summary
This might be nothing. It also might be something but if it is I don't really know what, all I know is that I have dug as deep as I can into this and asked some people who are smarter than me about it, and none of us have been able to shape this into anything.
So, here I am opening it up to everyone in the hope that if it is something, we can work it out together.
Are we all sitting comfortably?
Back in the summer I got a message from a client asking me if I knew why they were seeing a ton of impressions in search console for phrases that all ended "provide a detailed summary", or if I could shed some light on whether or not other sites were seeing this same issue - so, off I went to search console to have a look at data for for other publishers I work with, and the results were pretty interesting:

What we're looking at here is Search Console clicks for keywords containing "provide a detailed summary" (Or at least, all the Search Consoles I had access to that had them), and as you can see there were two sites in particular (my client in blue, and a national news website in red) that had seen a LOT of traffic from these keywords on certain days, while the other sites had very little. Weird.
But what's weirder is the keywords themselves:

This is an example from the GSC of the gaming news website I looked at, and let's just address the elephant in the room here immediately: It's obviously something to do with AI. There's no other explanation for the very similar but different phrases, all followed by "- provide a detailed summary". I quote-searched every single one of these keywords (minus the request to provide a detailed summary) and found that not one of them were a perfect match for the title of a page on a website anywhere, but in almost every instance the examined sites always ranked first or second if you did the same search without the quote marks, and my client sites always had titles that were very close to the KWs, as if the page had been used as a starter when spinning the new KWs.
But here's the next weird bit: These searches were driving traffic, and not an insignicant amount of it:

So, if your brain is the same as mine, you're now thinking "okay this is an LLM" - but here's the problems with that:
One, how is an LLM generating this volume of impressions without getting slapped? I guess they'll have a huge IP pool to use, but still that's pretty heavy.
Two, I'm not aware of an LLM that searches like that - it feels like an instruction given TO an LLM, rather than something an LLM would ask Google for. For all their faults, LLMs are good summarisers, and for all its abilities as a data retrieval service, Google absolutely sucks at summarising it.
Except, check the date on the graph above and then read this:
“On July 9, 2025, xAI released Grok 4 and 4 Heavy, along with other updates to Grok. xAI claimed these new flagship models outperform rival models in benchmark tests”
So is Grok manually using Google?
Well here's the issue - Grok (to the best of my knowledge) uses iPhone user agents and does not list the IP ranges it uses, so it's often hard to look at logs and say with confidence that any one specific server transaction was instigated by Grok.
So, in order to test the theory that Grok will Google things, I did the old "only allow Google to index a url" trick (the page is robotsed to everyone except Googlebot, is unlinked to, and is only referenced in an unlinked sitemap that has been submitted only to Google in GSC) - you can see the page here - then asked Gemini and Grok about it.
As you can see, Gemini answered the question "What is Enterostic Complution" with no issues whatsoever, while Grok initially insists it doesn't exist until it's asked to "Think Harder", at which point it finds it, but when pressed further then insists it made it up - so I guess Grok can use Google (Or SERP AI) if it really wants to but WILL lie about it? (We'll overlook the ignorance of robots.txt because hey, it's not like any LLM cares about it)
But what is this proving, exactly? All we know is that a ruck of keywords started appearing in multiple GSCs on the day that Grok got an update, and that Grok will seemingly Google stuff if you really push it. It doesn't explain all the very similar search terms, or why some sites seem affected by this way more than others (Although I will say the majority of the search terms that I saw when looking this up were quite X-coded, ie video games and Trump), or why on the whole the queries have a CTR that looks about right for a page in the top few organic results in the SERP, wile occasionally generating a >100% CTR. I could see it maybe coming from the version of Grok that lives inside X, but again, if that's the case X are doing a great job avoiding Google's wrath, and I can see absolutely no indication that Grok searches in that way. A Grok powered Bot, maybe? I dunno.
What does it mean?? Am I barking up totally the wrong tree? I don't know.
UPDATE:
Tom Pool has cracked it.