X, well, Twitter.com, is now blocking Bing Search, specifically Bingbot, from crawling and accessing content posted on Twitter.com, on the X platform. Twitter specifically added to its robots.txt file a directive to disallow Bingbot from crawling the content on its platform.
Here is a screenshot of its robots.txt file:
This was spotted first, I believe, by Mike Ginley who posted this on X, “Twitter blocking Bing is an interesting move…” Glenn Gabe dug into the timeline, noticing this was a fairly recent change by Bing:
As of July 1, Bing was not being blocked from crawling. By September 1, ALL bots not included specifically in the file were being blocked. And as of Oct 17, Bing was specifically being blocked. A site query reveals some very weird things for Twitter in Bing, for obvious reasons. https://t.co/hWjKgxM9q7
— Glenn Gabe (@glenngabe) October 18, 2023
In fact, a site command on Bing only shows 180,000 Twitter URLs showing up:
But with Google, a site command shows 422 million URLs.
I guess Twitter / X does not want traffic from Bing Search? I mean, if they want more efficient indexing, just use IndexNow?
Forum discussion at X.
Balancing the cuteness of puppies with hard-hitting advocacy to shine a light on animal suffering and inspire people to drive meaningful change takes real content expertise. Emily Hamlin Smith, senior editorial director of the Humane Society of the United States, and her team have done that with their quarterly print magazine All Animals and other...
With the phrase business performance, project management tools naturally come to mind. But, it is not that simple to understand how a PM tool drives productivity and performance. Project management tools have vast implementation. They are not limited to just project management but cater to diverse business needs. Some tools emphasize collaboration, some issue tracking,...