Semrush uses its own machine learning algorithms and trusted data providers to present the data in our databases. There are different methods for gathering different types of information but the high standard of quality across our databases remains the same.
We only use the most up-to-date data sources and we always clean the data through our proprietary methods in order to present the most trusted solution on the market.
Search Engine Data: Domain Rankings and Keywords
Semrush reports provide our customers with a wealth of information about domains, subdomains, and URLs. The more domains available to research, the more you can learn about what works and what doesn’t in a particular industry.
In addition to being able to pull large reports, Semrush also offers Gap Analysis tools to cross-examine and compare the strengths of multiple domains at once.
The more keywords available for your keyword research, the more ideas you can get to enrich your SEO and PPC campaigns. The total number of keywords in our software suite now exceeds 22,3 billion—making it the largest keyword database on the market.
Semrush users can segment their keyword research by using the Keyword Magic Tool and perform a detailed analysis of large keyword lists to pick the best ones for their campaigns.
Data Collection
For search engine rankings and keyword analytics, we use third party data providers to collect Google’s actual search results pages for the 500 million most popular keywords. Then, we collect information about the websites that are listed in the top 100 positions. We study both organic search results as well as paid search results to give you a complete picture of any website’s visibility on Google.
Analysis & Presentation
From these keywords and domains, we examine live data and historical data about position changes and domains ranking in organic and paid search positions to create our suite of reports that show a website’s changes in positions, every keyword’s search volume, cost-per-click, and more insights that are useful to marketers.
Update Cycle
The exact method in which Semrush collects and analyzes search engine results pages (SERPs) information uses our proprietary algorithm that has been developed and optimized over the years. The keywords in each of our global databases are all scheduled for a refresh on its rankings data every month.
This way, you know that the information you take from Semrush is based on the actual standings of Google’s most recent results pages.
Website Traffic Analytics
Semrush also has the power to estimate monthly traffic and on-site behavior of any website on the Internet.
Our website traffic database powers two of our most valuable assets available to our customers: Semrush Traffic Analytics and Semrush Market Explorer. The data in these tools comes from our unique panel of over 200 million real Internet users in over 190 countries and regions.
Data Collection
The Semrush Traffic Analytics panel is the result of our hundreds of partnerships with clickstream data providers. This panel is responsible for over 2 million events each minute (billions of events per month) on the Internet which are recorded and anonymized to preserve user privacy. From this clickstream data, we run our Neural Network algorithm to come up with a realistic estimation based on statistical sampling and error testing.
Neural Network Algorithm
To ensure the highest level of accuracy, Semrush uses its Neural Network—a combined algorithm that references various sources of data and recognizes patterns in the same way the human brain understands patterns.
The data sources in our network include clickstream data in addition to our own database of backlinks and organic search engine positions. After all sources are collected we run everything through thorough error testing and cleaning.
This method allows Semrush to understand the audience’s behavior in the most balanced and accurate way possible.
Backlinks Data
Semrush provides a clear picture of any website’s backlink profile, perfect for analyzing your own site or a competitor. We use our own database containing trillions of backlinks to spot any and all domains that are referring to a website. The amount and depth of information offered in this database makes it easy to identify new SEO opportunities for a website in any niche.
Semrush Backlink Crawler
To collect backlinks, our backlink crawler combs over 25 billion pages of the web on a daily basis and adds the new links that it finds to our database.
Online Advertising Data
Semrush has extensive databases to show everything about advertisers that use Google Ads and Google Shopping.
By the Numbers
-
Over 1B Google Ads
-
Historical data dating back to January 2012
Advertising Data Collection
Google Ads (PPC ads in search results) and Google Shopping ads (also known as Product Listing Ads) are taken into account when we collect search engine results pages for our main search engine databases.
With this research, marketers can create strategic advertising campaigns, outperform competitors, raise awareness of their brand and know that their money is being spent wisely.
Social Media Data
Semrush offers tools for you to track the performance and engagement of social media profiles on Facebook, Twitter, Instagram, YouTube and Pinterest.
To attain this information, Semrush uses the public APIs of these social media networks and never collects or uses any personal data without consent. The only time we’ll collect personal data is if you connect a personal account to automate your content calendar and view your page’s internal analytics with our Social Media Poster. This information will only be available to you, and never made available to the public.
Analysis & Presentation
We collect public information such as likes, number of followers, retweets, hashtags, video views, number of comments and more from the pages that you choose to track. Then, we collect and organize the data to present dashboards and reports about each social profile’s audience, engagement, and growth rates.
Everything presented in Semrush’s Social Media Tracker is a collection of public information.