Today is the sixth episode of the series 'Learn SEO'. How to determine the URL through Google Search Console? Does the crawler find all your important content? What are some reasons why search engines can't find important content? About 4xx code and 5xx code.
Defining URLs through the Google Search Console
Some sites (in most cases e-commerce sites) show the same content in different categories using different URL parameters. If you are shopping on an e-commerce site, you will find that they use parameters like price, brand, color, size, etc. to filter, and the URL will change every time you change a parameter.
- https://www.example.com/products/women/dresses/green.html
- https://www.example.com/products/women?category=dresses&color=green
- https://example.com/shopindex.php?product_id=32&highlight=green+dress&cat_id=1&sessionid=123$affid=43
Now think about it, which URLs will Google crawl and which URLs will be indexed and shown in search? Google decides which URL to show in the search. But here you can tell which URL will appear in the search with the URL parameter feature in the Google search console.
Does the crawler find all your important content?
Search engines need to refrain from unimportant content, knowing some of its methods. Now learn how Google Bot will easily find the important page if optimized.
Occasionally search engines automatically find some content on the site by crawling. But the remaining pages or a specific part may not be found for some reason. You need to make sure that your website is not just a homepage index so that all the pages you want are indexed.
Here are some possible reasons why your content may not be found by search engines:
- If your content is inside a login form.
- If you use a search form or box for content.
- If the text content is hidden in non-text content.
- If search engines can't follow up on your site.
- If you do not have a clear information structure.
- If you do not use the site map.
- If the crawler encounters any errors or omissions when it tries to access your URL.
4xx and 5xx codes are some of the most popular error codes when doing SEO.
4xx code
When a search engine crawler cannot access your website content due to an internal problem with your website, it is called 4xx errors.
The most common 4xx errors are ‘404 - Page not found. This could be due to a URL typing error, deleting a webpage, redirecting, etc.
5xx code
When a search engine cannot access a website's content due to a problem with the crawler server, it is called a 5xx error.
A 5xx error is identified as a server problem, which means when a user or search engine crawler does not have access to a content page.
Read More
- Lesson - I (Introduction to SEO)
- Lesson-II (About SEO)
- Lesson-III (Search Engine Guidelines)
- Lesson-IV (About Search Engine)
- Lesson-V (Website Indexing and Crawl Information)
- Next and All Post