DIGITAL MEDIA GHOST
  • Publication
  • #GhostsWriteIt Spotlight
    • Writer Spotlight Submission
  • Services
    • Digital Strategy
      • Content Marketing
      • Law Firm Marketing
      • Social Media Management
    • Ghostwriting
    • Public Relations
      • Social Sabotage & Online Privacy
        • Social Media Policy Template
  • About
  • Publication
  • #GhostsWriteIt Spotlight
    • Writer Spotlight Submission
  • Services
    • Digital Strategy
      • Content Marketing
      • Law Firm Marketing
      • Social Media Management
    • Ghostwriting
    • Public Relations
      • Social Sabotage & Online Privacy
        • Social Media Policy Template
  • About
Search

How to Measure the True Effect of Advertising

3/20/2019

0 Comments

 
Picture
So, let’s say you’re trying to sell a red sports car via digital advertising.  There are enough algorithms out there to very efficiently make sure that consumers with the right profiles are targeted. There is very little waste. You can find the right demographics, you can find people who’ve already used search terms like “red sports car,” and you can find people who have clicked on other posts that featured red sports cars.  So, when they see your ad, much of the work has been done. Maybe they buy.  But the question is, would they have bought even without the ad? How do you know?







A group of researchers might look at that story above and say, a better way to evaluate the effectiveness of the ad is to be more random in your sampling. Don’t just look at where and how the ad was effective based on those indicators above, which are technically considered “observables.” 

How Measurable is Online Advertising?

New Research Study Identifies Challenges for Current Measurement Practices,
Calls for Better Ways to Address “Unobservable” Factors

Key Takeaway:
  • Current “observational” approaches to digital advertising measurement may not be as effective as large-scale randomized control trials.

CATONSVILLE, MD, March 5, 2019 – Researchers from Northwestern University and Facebook in March published new research in the INFORMS journal Marketing Science that sheds light on whether common approaches for online advertising measurement are as reliable and accurate as the “gold standard” of large-scale, randomized experiments.

The study which will be published in the March edition of the INFORMS journal Marketing Science is titled “A Comparison of Approaches to Advertising Measurement: Evidence from Big Field Experiments at Facebook,” and is authored by researchers from Northwestern University and Facebook.

“Our findings suggest that commonly used observational approaches that rely on data usually available to advertisers often fail to accurately measure the true effect of advertising,” said the researchers.

Observational approaches are those that encompass a broad class of statistical models that rely on the data “as they are,” generated without explicit manipulation through a randomized experiment.

“We found a significant difference in the ad effectiveness obtained from randomized control trials and those observational methods that are frequently used by advertisers to evaluate their campaigns,” they added.  “Generally, the current and more common methods overestimate ad effectiveness relative to what we found in our randomized tests. Though in some cases, they significantly underestimate effectiveness.”

Measuring the effectiveness of advertising remains an important problem for many firms. A key question is whether an advertising campaign produced incremental outcomes: did more consumers purchase because they saw an ad, or would many of those consumers have purchased even in the absence of the ad? Obtaining an accurate measure of incremental outcomes (“conversions”) helps an advertiser calculate the return on investment (ROI) of the campaign. 

“Digital platforms that carry advertising, such as Facebook, have created comprehensive means to assess ad effectiveness, using granular data that link ad exposures, clicks, page visit, online purchases and even offline purchases,” said the researchers. “Still, even with these data, measuring the causal effect of advertising requires the proper experimentation platform.”

The study authors used data from 15 U.S. advertising experiments at Facebook comprising 500 million user-experiment observations and 1.6 billion ad impressions.

Facebook’s “conversion lift” experimentation platform provides advertisers with the ability to run randomized controlled experiments to measure the causal effect of an ad campaign on consumer outcomes.

These experiments randomly allocate users to a control group, who are never exposed to the ad, and to a test group, who are eligible to see the ad. Comparing outcomes between the groups provides the causal effect of the ad because randomization ensures the two groups are, on average, equivalent except for advertising exposures in the test group. The experimental results from each ad campaign served as a baseline with which to evaluate common observational methods.

Observational methods compare outcomes between users who were exposed to the ad to users who were unexposed. These two groups of users tend to differ systematically in many ways, such as age and gender. These differences in characteristics may be observable because the advertiser (or its advertising platform) often has access data on these characteristics and others, e.g., in addition to knowing the gender and age of an online user, it is possible to observe the type of device being used, the location of the user, how long it’s been since the user last visited, etc.

However, the tricky part is that the exposed and unexposed groups may also differ in ways that are very difficult to measure, such as the users underlying affinity for the brand. To say that the ad “caused” an effect requires the research to be able to account for both observed and unobserved differences between the two groups. Observational methods use data on the characteristics of the users that are observed in attempt to adjust for both the observable and unobservable differences.

“We set out to determine whether, as commonly believed, current observational methods using comprehensive individual-level data are ‘good enough’ for ad measurement,” said the researchers.  “What we found was that even fairly comprehensive data prove inadequate to yield reliable estimates of advertising effects.”

“In principle, we believe that using large-scale randomized controlled trials to evaluate advertising effectiveness should be the preferred method for advertisers whenever possible.”
​

0 Comments

Your comment will be posted after it is approved.


Leave a Reply.

    Picture
    Become a Ghostwriter!
    Picture
    Contribute to DMG
    Picture
    BECOME A GUEST CONTRIBUTOR
    Picture
    PROMOTE YOUR BUSINESS BY GUEST POSTING
    Picture
    ARE YOU A GHOSTWRITER? WE WANT TO KNOW!
    Picture
    DO YOU HAVE A GHOSTWRITING BUSINESS?

    RSS Feed

    Categories

    All
    Agency Spotlight
    Business
    Digital Marketing
    Ghost In A Flash
    Ghostwriting
    Media Relations
    Privacy Concerns
    Social Sabotage
    Technology
    Writer Spotlight
    Writing

    Advertising Disclaimer

    Archives

    February 2023
    January 2023
    December 2022
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    May 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012

Find your domain and create your site at Weebly.com!
Digital Media Strategy
Content Marketing
Law Firm Marketing
Search Engine Optimization
Social Media Marketing
eBooks
Writing
Becoming a Ghostwriter
Blogging
Content Marketing
Ghostwriting Services
Guest Post Guidelines
Media Relations
Online Crisis Management
Personal Brand
Public Relations
Reputation Management
About
Our Team
Our Results
Testimonials
Contact Us
Locations:
New Orleans, LA
Nashville, TN

DMG University
Privacy Policy | Terms & Conditions | Cookie Policy
Digital Media Ghost  @2020
  • Publication
  • #GhostsWriteIt Spotlight
    • Writer Spotlight Submission
  • Services
    • Digital Strategy
      • Content Marketing
      • Law Firm Marketing
      • Social Media Management
    • Ghostwriting
    • Public Relations
      • Social Sabotage & Online Privacy
        • Social Media Policy Template
  • About