In honor of Bing turning 5 years old this week, I wanted to take some time and talk about Bing Webmaster Tools and this awesome feature called Bing crawl control. We are going to learn how to use the crawl control in Bing Webmaster Tools and how it has an effect on bandwidth.
Before we take a dive into this feature, let me address the obvious questions that I am sure you are already asking yourself.
These are the common questions that I get:
- “What is Bing Webmaster Tools and how is it different from Google Webmaster Tools”?
- “If the majority of my traffic comes from Google, then why do I need to care about Bing and Yahoo data”?
- “Haven’t you heard that Com Score says that the traffic from Bing and Yahoo is combined around 30%”?
- “Didn’t you see the recent Conductor report actually saying it is closer to 15 % and Google 85%”?
- “Does anyone even use Bing or Yahoo anymore these days”?
- “Another tool”?
Bing Webmaster Tools has many great features. Many of them are similar to Google Webmaster Tools and there are some different features. I would like to shed some light on the crawl control section that many people don’t take advantage of.
Bing has this section that allows you (the webmaster) to let Bingbot know when you receive the most traffic to your website. You can then specify a time during a 24 hour time window for Bing to crawl your site. You can essentially have Bingbot crawl your site faster during your off peak hours and slower during your peak hours.
Why is this important?
The answer is bandwidth!
You can limit Bingbot activity on your site during your peak hours, which means your site will actually load faster for your audience. If I am able to deliver a better user experience for my audience then yes, please sign me up.
This is really easy to change. You can click on the blue bars with your mouse to change how high or how low the bars are presented. More blue bars mean you want Bingbot to crawl your site faster. Less blue bars and you are asking Bingbot to crawl the site slower.
This is the chart for Wakefly. I noticed in Google Analytics that the majority of our audience does not show up until 11 AM. There are a few peaks in the afternoon until about 7:00 PM eastern time, so I am going to make sure from 11 Am – 7 PM I have the minimum amount of Bingbot activity on my site to give my audience a better experience with loading the content.
Standard (this is the default)
This is after changing the crawl rate
This is pretty easy to do and is one of the reasons why we have the blogs released in the late morning / afternoon.