X, successfully, Twitter.com, is now blocking off Bing Search, particularly Bingbot, from crawling and having access to content posted on Twitter.com, on the X platform. Twitter particularly added to its robots.txt file a directive to disallow Bingbot from crawling the content on its platform.
Right here is a screenshot of its robots.txt file:
This was noticed first, I reflect, by Mike Ginley who posted this on X, “Twitter blocking off Bing is an intriguing circulation…” Glenn Gabe dug into the timeline, noticing this was a beautiful latest trade by Bing:
As of July 1, Bing was no longer being blocked from crawling. By September 1, ALL bots no longer integrated particularly in the file comprise been being blocked. And as of Oct 17, Bing was particularly being blocked. A bellow question unearths some very extra special issues for Twitter in Bing, for evident reasons. https://t.co/hWjKgxM9q7
— Glenn Gabe (@glenngabe) October 18, 2023
In actuality, a bellow expose on Bing best exhibits 180,000 Twitter URLs showing up:
But with Google, a bellow expose exhibits 422 million URLs.
Assist in July Twitter blocked Google main to an mountainous tumble in visibility for Twitter in Google Search. Just a few days later, Twitter reversed that trade.
I declare Twitter / X doesn’t need net page visitors from Bing Search? I indicate, in the occasion that they wish more efficient indexing, correct use IndexNow?
Forum dialogue at X.
