Comscore: What They Do And How Their Rankings (Actually) Work

What does Comscore do?

Comscore is a global media measurement and analytics company. They offer 3rd-party measurement of audience demographics and performance for media across multiple mediums. From their own definition;

Comscore is a trusted partner for planning, transacting and evaluating media across platforms. With transformative data science and vast audience insights across digital, linear TV, over-the-top (OTT) and theatrical viewership, we are a powerful third-party source for reliable measurement of cross-platform audiences.

The idea behind 3rd-party audience tracking is to bring transparency to media and marketing, so businesses can use data to drive growth.

Comscore provides analytics and measurement data related to digital media, advertising, and e-commerce. It offers a variety of services that help businesses and organizations understand how people use the internet, including how they interact with websites, mobile apps, and advertising.

Comscore works by collecting data from a variety of sources, including its own panel of internet users and partnerships with third-party data providers. The company then uses this data to create insights and reports that help its clients make informed decisions about their online strategy.

One of Comscore’s primary products is its Media Metrix service, which provides information on website and app usage. This service uses a combination of panel data and site tags to track internet traffic and provide detailed information on user demographics, engagement, and behavior. Comscore also offers a range of other measurement services, including ad verification, audience targeting, and cross-platform measurement.

Overall, Comscore provides valuable insights into how people use the internet and how businesses can optimize their digital strategy to reach and engage with their target audience.

What are Comscore rankings and how do they work?

Comscore rankings refer to the system used by Comscore, a leading provider of digital media analytics, to rank websites based on their traffic and engagement metrics. Comscore rankings are used by businesses and marketers to evaluate the performance of their own website and that of their competitors.

Comscore rankings work by collecting data on website and app usage from a variety of sources, including its own panel of internet users and third-party data providers. This data is then aggregated to produce rankings based on metrics such as unique visitors, page views, time spent on site, and engagement metrics. Comscore’s rankings are updated on a monthly basis and are considered to be a reliable source of information for industry professionals.

Comscore’s rankings are based on a variety of factors, including the size and engagement of a website’s audience, the quality of its content, and the effectiveness of its marketing and advertising strategies. A high Comscore ranking indicates a website with strong traffic and engagement metrics, which can be an important indicator of success in the digital marketplace.

Overall, Comscore rankings provide businesses and marketers with a valuable tool for evaluating website performance and benchmarking against competitors in the industry. By monitoring their Comscore ranking, businesses can gain insights into how they can optimize their website and digital marketing strategies to better engage their audience and drive growth.

Comscore’s rankings are founded on the audience measurement services they sell/provide to publishers. The Comscore Media Matrix, which in 2016 accredited by the Media Rating Council (MRC) uses a series of “panels” to measure audiences.

These audience measurement services are often observed by advertisers and agencies. The main differentiator between Comscore and other web analytics solutions (like Google Analytics) is that their primary goal is to measure exactly who an audience is and their consumption behavior. It takes a slightly more traditional way of looking at human visitors since many mechanisms for tracking audiences across television and other legacy mediums are less objective than digital has become. Additionally, their panel method defines pageviews across all sites.

That said, the panels and measurement techniques used by ComScore, and competitor Neilson, both rely greatly on voluntary participation from all ecosystem parties to provide their composite scoring. This means audiences, publishers, and agencies/advertisers must all bend to the will of these 3rd parties if they want to participate in these systems.

Traditionally, the tracking of audiences has been wrought with criticism. But, recent acquisitions by large tech companies, like Moat, have demonstrated the value of tracking across the ecosystem; as both publishers and advertisers have long relied on an arbiter for campaign delivery.

Are Comscore rankings something that advertisers and publishers care about?

Comscore is a leading provider of digital media analytics and its rankings are considered to be a reliable source of information on website traffic and engagement metrics. Advertisers and publishers use Comscore rankings to evaluate the performance of websites and digital properties, including their own and those of their competitors.

For advertisers, Comscore rankings provide valuable insights into the reach and engagement of potential advertising platforms. By reviewing Comscore rankings, advertisers can identify websites with high traffic and engagement metrics that may be a good fit for their advertising campaigns. Comscore rankings can also be used to benchmark the performance of advertising campaigns against competitors in the industry.

Publishers, on the other hand, use Comscore rankings to evaluate the performance of their own websites and to identify areas for improvement. By monitoring their Comscore ranking, publishers can gain insights into how they can optimize their website and digital marketing strategies to better engage their audience and drive growth. Comscore rankings can also be used by publishers to attract advertisers and demonstrate the value of their advertising inventory.

Overall, Comscore rankings provide a valuable benchmark for advertisers and publishers to evaluate website performance and make informed decisions about their digital strategy.

Advertisers and publishers do often care about Comscore rankings but not in the way that many might assume. The gross majority of advertisers likely have no idea what they are and pay little attention to these services. Agencies and top 50 brand publishers often pay much more attention to these metrics; as they are typically a point of contention in negotiating ad contracts. Comscore and their competitors live as a middle man in-between.

If a publisher doesn’t include Comscore pixels on their pages (often because they slow down sites and can cause errors), they’ll not be counted in Comscore’s rankings. But that actually doesn’t mean an advertiser won’t target an audience on their site…

... So, advertisers that DO use Comscore when buying through an agency will still target audiences on publisher sites that don’t use Comscore or their competitors.

So, what’s the point if you’re a digital publisher? It depends on the goals of a publisher. There’s little monetary incentive or advantage for just about anyone of the or digital publisher side, depending on which industry expert you ask. However, it is a competitive point of contention among some of the long-running media brands that used to depend on these scores or rankings for TV buying campaigns.

What does the Comscore Panel measure?

The panel measurements comprise the Comscore rankings—a monthly list of the top 50 digital properties across the web ranked by the number of unique visitors from highest to lowest.

The Comscore Panel is a panel of internet users that Comscore uses to collect data on website and app usage. The panel is made up of a diverse group of internet users who have agreed to have their online activity tracked and monitored by Comscore in exchange for various incentives.

The Comscore Panel measures a wide range of digital behaviors and metrics, including website and app usage, search queries, online purchases, and social media engagement. By collecting data from the panel, Comscore is able to provide valuable insights and analytics to businesses and marketers looking to optimize their digital strategy.

Some of the specific metrics that the Comscore Panel measures include unique visitors, page views, time spent on site, bounce rates, click-through rates, and conversion rates. Comscore also provides demographic and psychographic data on the panel members, such as age, gender, income, education level, and interests.

The Comscore Panel is an important source of data for businesses and marketers looking to gain insights into how people use the internet and how they can optimize their digital strategy to reach and engage with their target audience. By leveraging the data collected from the panel, Comscore is able to provide valuable insights and analytics that help its clients make informed decisions about their online presence and marketing efforts.

Who or what makes up Comscore panels?

The “panelists” are identified by Comscore as either home or work-based machines. These have to be personally owned by the panelist (or household) to qualify them as home panelists. Computers owned by an employer qualify as work computers.

The Comscore panel is made up of a diverse group of internet users who have agreed to have their online activity tracked and monitored by Comscore in exchange for various incentives. The panel is designed to be representative of the internet population and is made up of a cross-section of demographics, including age, gender, income, education level, and geographic location.

Comscore uses a variety of methods to recruit panelists, including online advertisements, direct mail, email campaigns, and partnerships with third-party websites and apps. Panelists are selected based on their online behavior and the demographic information they provide during the recruitment process.

Once a panelist is selected, Comscore installs tracking software on their devices, including desktop computers, laptops, smartphones, and tablets. The tracking software collects data on the panelist’s online behavior, including websites visited, apps used, and search queries entered. The data is then aggregated and used to produce insights and analytics on digital behavior and trends.

Panelists receive various incentives for participating in the Comscore panel, including cash rewards, gift cards, and sweepstakes entries. Panelists are also able to view their own online activity data through a personalized dashboard provided by Comscore.

Overall, the Comscore panel is a critical component of Comscore’s measurement and analytics offerings, providing valuable insights into how people use the internet and how businesses can optimize their digital strategy to reach and engage with their target audience.

Some of the things the panel methodology can register unique visits across:

• Internet activity from all web entities, regardless of browser type
• Private browsing sessions / Secure sessions
• Content elements / streaming / instant messaging
• Web-based technologies and protocols

The panel is then weighted and projected to the home and work Internet universes in the United States, which allows the behavior of panelists to be projected to the U.S. Home and Work Internet user populations at large.

How effective is Comscore’s panel measurement system?

Comscore’s panel measurement system is considered to be an effective and reliable method for measuring website and app usage, as well as other digital behaviors and metrics. Comscore’s panel is made up of a diverse group of internet users who have agreed to have their online activity tracked and monitored by Comscore in exchange for various incentives.

One of the key strengths of Comscore’s panel measurement system is its ability to provide a representative sample of the internet population. The panel is designed to be representative of internet users across demographics, including age, gender, income, education level, and geographic location. This helps to ensure that the data collected from the panel is accurate and reflective of the broader online population.

Comscore’s panel measurement system is also able to provide granular insights into digital behaviors and metrics, including website and app usage, search queries, online purchases, and social media engagement. By collecting data from the panel, Comscore is able to provide valuable insights and analytics to businesses and marketers looking to optimize their digital strategy.

While there are some limitations to panel-based measurement systems, such as the potential for sample bias and the challenge of maintaining panelist engagement, Comscore has implemented a number of measures to address these concerns. For example, Comscore uses a variety of methods to recruit and retain panelists, and it continually updates its tracking software to ensure that it is both accurate and secure.

Overall, Comscore’s panel measurement system is considered to be a reliable and effective method for measuring website and app usage, and it provides valuable insights and analytics to businesses and marketers looking to optimize their digital strategy.

Comscore’s panel measurement system appears to be accurate and effective. Out of curiosity, I tested Comscore’s numbers for a digital property in the Comscore Top 50 (Facebook.com) to see if the recorded number of monthly unique visitors was comparable.

To do this, I went to one of Comscore’s competitors, Similarweb. Comscore’s tally for Facebook.com’s June 2020 unique monthly U.S. visitors on desktop was 90.42 million. After crunching the numbers, Similarweb’s was 90.64 million.

They were both nearly equal. The fact Similarweb’s attribution was slightly higher is most likely due to the fact the numbers I used to calculate were rounded up to the hundredth decimal place and not exact.

Why are Comscore traffic numbers lower than those in Google Analytics?

Comscore and Google Analytics use different methodologies for measuring website and app usage, which can result in differences in the traffic numbers reported by each platform.

Comscore uses a panel-based measurement system, which involves tracking the online behavior of a sample of internet users who have agreed to be monitored by Comscore. This method provides a representative sample of the internet population, but it may not capture all website and app usage, especially among smaller websites or niche audiences.

On the other hand, Google Analytics uses a code-based measurement system that tracks website and app usage by installing a tracking code on each page. This method provides a more comprehensive view of website and app usage, as it captures activity from all users who visit the website or app, regardless of whether or not they are part of a panel.

Another factor that can contribute to differences between Comscore and Google Analytics traffic numbers is the way that each platform handles bots and other non-human traffic. Comscore filters out non-human traffic to provide a more accurate picture of human website and app usage, while Google Analytics reports all traffic, including bots and other non-human traffic.

In some cases, the differences in traffic numbers reported by Comscore and Google Analytics may be due to measurement errors or discrepancies in the data collection process. It’s important to keep in mind that both platforms have their own strengths and limitations, and the most accurate picture of website and app usage is likely to come from a combination of both measurement systems.

Comscore traffic numbers are lower than those in Google Analytics mainly because of differences in tracking methodologies. Here are some of the reasons why:

Attribution: Google Analytics defines a session timeout as 30 minutes of inactivity. Plus, they have additive rules of attribution. This means 30 mins of inactivity adds up to a new session. Comscore, on the other hand, has a 3-second window to qualify as a visit. Anything less than 3 seconds leads to disqualification.

Multiple browsers: Comscore eliminates visits from multiple browsers and multiple screens (mobile, desktop, etc.)

Non-human traffic: Comscore ignores (or eliminates) bot traffic, and Google Analytics counts all visits regardless if it’s a bot or a real user. This difference is the main factor behind Comscore’s lower traffic numbers. Note: Google now offers a bot-filtering setting to help eliminate invalid traffic.

Data projection: For analytics, Google uses the “real-time” data, and then records and stores the anonymous data. Comscore makes estimations based on the pool of panelists that are tracked via plugins or cookies.

A Comscore whitepaper revealed that cookie deletion might lead to overestimates in servers’ measurement of the size of online audiences. Without adjustments, site server audience reports can be inflated up to 2.5 times the actual number of unique visitors.

Why do ad networks partner with Comscore?

Most ad networks in the Comscore top 50 require publishers to assign their traffic through a Traffic Assignment Letter.  What this does is it adds your traffic to their “total unique visits” count and ultimately increases their Comscore property size.

Simply put, ad networks and ad management platforms partner with Comscore because they can leverage your traffic to look “bigger.” Let’s break this down a bit.

This way, when they are trying to attract agencies, direct advertisers, etc., the audience is large. This benefits you as a partner, assuming they are able to deliver on their promises of attracting those types of big advertisers.

From the ad network’s perspective, you’ll probably not ever be able to negotiate the same way a network would be for you. Most networks are into the billions of ad impressions per month, and so that’s what they say advertisers are “looking for” when they want to negotiate.

For those who are more skeptical, some have speculated that the ad networks who pay the hefty yearly price tag it costs to have Comscore measure your audience purely want to make themselves look as large as possible to attract the next publisher in their business pipeline. 

What is a Traffic Assignment Letter, and why do some ad networks ask you to sign one?

A Traffic Assignment Letter (TAL) is used to assign a publisher’s traffic to the network they are working with. Once this traffic is assigned, the ad network can negotiate advertising deals for the network at large and for your individual website. The bigger that the network becomes (in the eyes of Comscore / Quantcast / etc), the better the deals they’re able to negotiate. This is what’s intended, at least.

Publishers sometimes forget that they can only assign traffic to one place. Most ad networks typically make you sign a contract to confirm you’ve formally signed over your traffic to live under their network’s umbrella. Additionally,  you cannot sign  any other deals where you sign over your traffic to a ComScore etc. to other third parties.

Below is an example of a Nielsen Traffic Assignment Letter.

Are there disadvantages to signing over your traffic to a Comscore entity?

Not on the surface, at least. And the ad networks who get to include your monthly traffic numbers into their Comscore total unique visitors count wouldn’t like you to think so. The whole purpose of that is to make themselves look bigger to attract bigger advertisers. But because it seems so simple and innocent, they fail to mention the potential downsides.

The disadvantage is that you are eliminating your ability to diversify certain revenue streams

You’re (most likely) giving a larger portion of your revenue onto the partner.

And the fact that you signed an exclusivity contract? This blocks you from forming other network deals. This is one of the reasons why Ezoic’s Ad Tester, and our whole platform for that matter, were built on the pillars of transparency, the value of split-testing, and no contracts.  So, what exactly do I mean by all of this?

Remember: Most TAL agreements state that the new digital property (or ad network is now the sole representative of your site, and what vendors they are using to fill all other inventory (outside of direct sales) you can’t use.  If the ad network is well-versed in the industry, they most likely use premium vendors and will not allow you to run traffic by yourself, and instead will run that ad inventory through your site at a specific revenue share.

Note: This may not be true for all ad networks, as every deal is different. But generally speaking, these aspects of Traffic Assignment Letters are true.

What can publishers do to protect the value of their audience?

The best thing publishers can do to protect the value of their audience is to always remain skeptical.

Read the fine print. Don’t sign contracts if you have the option to avoid them. Ask your ad network if you can split test their ad management against another provider.

Because in reality, an apples-to-apples comparison is the only way you’re ever going to know who earns you more revenue. Due to the seasonality of ad rates, fluctuations in ad demand, and frequent Google Core updates, if you test one ad network in one month, and then another in the next month, that’s not a fair comparison. Therefore, you won’t know for certain who was better.

In reality, there’s a lot of scammy players in the ad industry who are draining money from the pot. Yet, those same players don’t add any value back in. One quick look at the Display Lumascape will show you how overwhelmingly bloated ad tech is.

According to research by Technology Business Research, of every dollar spent on programmatic advertising only 40 cents reaches actual consumers. So as unbelievable as that may seem, a whopping 60 cents (or more) of every dollar is being gobbled up by one of the hundreds of entities in the chart you see below.

So it goes without saying, be careful. Recognize the value you have as a publisher, and protect your audience by questioning things and staying skeptical.

Will Comscore be as important to advertisers in the future?

A lot of people don’t think so. Over the years, Comscore has received mixed (praise and negative) sentiment from online publications, and also in forums like Reddit and Quora. The most vocal complaint? Is that Comscore’s whole business model is only beneficial to those digital properties in the Comscore top 50.

Certain incidents in Comscore’s history give enough weight to those negative sentiments.

In 2010, after years of complaints against Comscore undercounting their audience (due to using purely a panel-based measurement without using tracking pixels) came to a head. Quantcast and Google put them under pressure because they offer free tracking pixels via which sites could have their traffic counted. Comscore then evolved to use a “hybrid” model of both panels and site-side tracking pixels.

Afterward, Comscore gave the tracking pixel away for free to paying clients.  Everyone else was angry because they had to pay Comscore $10,000 or keep having their traffic counted the previous way. In 2020, the minimum payment to use Comscore’s services comes out to $9,600 per year.

Since then, their stock is near its all-time low. One of the reasons behind the decrease can point back to Q3 of 2019, when The Securities and Exchange Commission charged Comscore’s former CEO with engaging in a fraudulent scheme to overstate revenue by approximately $50 million and making false and misleading statements about key performance metrics.

Objectively speaking, Comscore’s track record doesn’t help its cause. That isn’t to say its measurement tools aren’t valuable, but it makes you wonder;

Are the ad networks in the Comscore Top 50 purely flaunting the “Bigger is better” status to attract the largest advertisers? Or is it more of a selling point to potential publishers to join their network? It perhaps could be a mix of both.

Conclusion

Ten years ago,  Comscore was a sign of assurance that a lot of publishers and advertisers were happy to rally behind. But some argue that those on the advertiser-side have always known that Comscore rankings and campaign effectiveness aren’t so stringently tied together.

In today’s day and age, digital publishing and the ad industry at large is more performance-driven. These rankings just aren’t as important as they once were. What’s more important nowadays it’s the audience itself and how valuable that is (directly) to advertisers. There are very few scenarios where you need a large ad network to sit as a middleman. Especially when that ad network makes you sign a contract.

So you see how the puzzle pieces fall together here.

While the biggest publishers might find their audience measurement services valuable (even at their expensive price tag), the Comscore rankings themselves don’t objectively hold the same weight they did ten years ago.

That being said, Comscore is still a big name and well-respected by many in the ad space. So if you’re a successful publisher with a large audience, you be the judge. It’s your audience at the end of the day, and never let anyone (person or ad network) try to convince you for a moment that you need them to succeed.

Because that’s so far from the truth. They need you.

Because without you, they can’t keep getting bigger and bigger…