How do we check if our blog or website has duplicate content?

Kaushal Thakkar is the Founder and MD of Infidigit. He has developed award-winning search strategies for various organizations, ranging from large enterprise and e-commerce websites to small and medium-sized businesses. Before Infidigit, he was leading digital marketing, product, and eCommerce initiatives at Myntra (a Walmart Company), Times Group, ICICI Group, Tata Group. Being an engineer and product manager in his earlier days, he loves to hack growth for websites via technical SEO strategies. He is a speaker at various forums and a Pro bono guest lecturer on Organic Search, Digital Marketing, Analytics & eCommerce. In X @

How do we check if our blog or website has duplicate content?

Witness an Increase in your ROI

Unlock higher rankings, quality traffic, and amplified conversions through tailored award-winning SEO strategies.

    0
    (0)

    As mentioned in the previous posts duplicate content or thin content (Content that adds very little value for the user) should be avoided on the website. Removing such contents helps you in enhancing the search rankings of your website.

    Duplicated content may not have been created intentionally, so it is good if you cross check the URLs of your site that have been indexed in Google.

    Please find below some examples of duplicated content that could have been created unintentionally.

    1. You are using a WordPress theme that lists the entire blog post on the home page. The same content is listed on the blog post URL.
    2. You are tracking traffic on the site via URL Parameters which do not change the content of your site. E.g. www.infidigit.com?UTM_Source=Google.

    Since the parameter is a part of URL, Google considers this as a different URL. So www.infidigit.com and www.infidigit.com?UTM_Source=Google are considered as two different pages with same content

    Let’s now explore the ways to identify if there is duplicate content on your website.

    1. Use Google search

    Site:YourSiteName.com

    google-search-site-basic1

    If you have a site with less than 100 pages this simple solution should help.

    This will list all the pages of your site that Google has indexed. Check the URLs and see if there is more than one URL listing the same content.

    In case you find some content that is repeating you can deep dive by using additional search parameters

    Site:YourSiteName.com duplicate content

    google-search-site1

    OR

    Site:YourSiteName.com inURL:duplicate-URL

    Google Search InURL

    2. Get Google search result in spreadsheet

    In case you prefer working with a spreadsheet you can extract the search results on a Google spreadsheet. Copy this file from below URL to your drive and modify the input fields in it to get all your search results in a spreadsheet.

    https://docs.google.com/spreadsheet/ccc?key=0AsV1OgdAVTTJdF9WRTJUS1lwN1hOMEhxWVFiUzFINFE&usp=sharing

    3. Record the URLs that are visited by users and bots

    In case you are a large organisation and have thousands/ millions of pages indexed in Google the above options may not be able to provide you with a complete view. Most of the organisation’s record data of URLs visited. This could be separated based on real users and bots. You could use the URLs crawled by bots and find the URLs that are duplicates.

    If you are a victim of a duplication because of the theme you can easily migrate to a theme that just lists the snippet of the text on the home page and provides the entire blog post content on the internal page.

    I will write on the other solutions available to handle duplicate content in my next post. In case you have any questions on the current post please feel free to post your comments below or you can contact us.

    Popular Searches

    SEO Company | SEO Services | ECommerce SEO Services | SEO Audit Company | Google Penalty Recovery Services | Local SEO Service | Backlinks | Black Hat SEO | Digital Marketing | Cloaking | HTTP Status CodesTechnical SEO Checklist | On-Page SEO Techniques | Evolution of SEO | What is SEO | Top SEO Tools | What is Ecommerce SEO | Digital Marketing Strategy | Schema for Movie Carousel | Sitelink Search Box 

    How useful was this post?

    0 / 5. 0

    22 thoughts on “How do we check if our blog or website has duplicate content?”

    1. Nice article..this has really helped me clear my doubts on how to remove duplicate contents of my website..thanks Kaushal

    2. Hurrah, that’s what I was exploring for, what a material!
      present here at this web site, thanks admin of this website.

    3. This paragraph presents clear idea in support of the new visitors of blogging, that really how
      to do blogging and site-building.

    4. Hey just wanted to give you a quick heads up. The text in your post seem
      to be running off the screen in Opera. I’m not sure if this is a format issue or something to
      do with web browser compatibility but I thought I’d post to let you know.
      The style and design look great though! Hope you get the issue fixed
      soon. Cheers

    5. Good post however I was wondering if you could write a litte
      more on this subject? I’d be very grateful if you could elaborate a little
      bit further. Many thanks!

    Leave a Comment


    Secrets to be the first on search, right in your inbox.

    Subscribe to our newsletter and get carefully curated SEO news, articles, resources and inspiration on-the-go.

    Share this article

    Duplicate Content

    How do we check if our blog or website has duplicate content?