Marketing Miner will help you in situations where you need to identify the status codes of URLs or redirects in bulk.
Miner Status Code will simply download the status code of URL and in the case of redirection, it follows it and tells you about the status code of the URL where redirects lead (including redirect chain).
Before we dive into a practical guide, let’s have a look at basic status codes that can occur and a brief explanation of why you should know about them:
- 200 = OK. Everything is fine, there is available content on this page and the page doesn’t return any error.
- 301 = Permanent redirect. Page A is redirected to page B. You should use this redirection if you don’t plan to recover page A and you want your visitors to visit page B instead. In terms of SEO, it is the right thing to redirect pages with this status code.
- 302 = Temporary redirect. Page A is temporarily redirected to page B. You should use this redirection if you plan to recover page A, but you don’t want your visitors to visit it for now. In terms of SEO, it is not recommended to redirect pages with this status code (except the case we just described).
- 404 = Not found. The page was not found. If the URL doesn’t exist on the web, we recommend redirecting these pages to the relevant page using the status code 301.
- 410 = Gone. This status code is similar to status code 404, but it is more “permanent”. However, in terms of SEO, these are very similar situations. We recommend finding internal links referring to pages 410 and remove this link or edit them, so they refer to an available page with content.
- 500 = Internal server error. As the name says, it is an internal mistake, so it is necessary to check and see where the problem has occurred.
- 503 = Service Unavailable. It is good to check the page manually as it probably doesn’t allow bots to crawl the content.
Get started by clicking on Create report button and specifying URLs at the input. Then write or copy the dataset of the URLs for which you want to get status codes.
However, the more common case is that you want to verify the status codes for the entire site. In this case, it’s better to insert your sitemap URL into Marketing Miner. To do so, click on the Import From URL section in the left sidebar.
For a report to be easily identifiable, it is good to name it. Simply click into Your Report Name field.
Then click on the flag to select the country for which you want to get the data and finish by clicking on Next Step.
Selection of the Miner
In the URL Analysis section, click on Miner Status Code.
After clicking, you will get to the settings, where you can set up how you want to crawl your site. This is how Marketing Miner will look like when crawling the site you entered at the input.
The tool can be seen as a Marketing Miner bot, Googlebot or another bot. In general, we recommend choosing the default option – Marketing Miner Bot. However, sometimes it is necessary to verify if Googlebot (for example) will get to your content as well.
If you have selected a bot, just click on Get Data to start processing your inputs. Once the report is complete, the processed data will be sent to you by email.
- Input: The URL from which Miner received the status code.
- First Status Code: the first status code of the URL. We already talked about status codes in the previous section ‘In practice’.
- Last Status Code: the last returned status code of the link.
- Status Code chain: the sequence of returned status codes.Last available URL: if the last returned status code is 40x or 50x, the web.archive.org will be displayed in this column to show what pages looked like in the past (if data available).
- When analyzing the status codes, focus on the internal server errors (status code 500), identify the problem and make it right.
- Then, check the pages with 404 and 410 status codes. If possible, redirect these URLs to the relevant pages and remove the internal links referring to those error pages.
- Check for redirects with status code 302 and verify that this is actually a temporary redirect. If not, use the 301 status code instead.