Next Step in Ongoing Effort to Provide Marketplace Guidance Across a Range of Methodologies
NEW YORK – With the online advertising industry in need of more rigorous tools and systems for understanding campaign performance, the Interactive Advertising Bureau (IAB) has unveiled “Best Practices for Conducting Online Ad Effectiveness Research.” Written by Marissa Gluck of Radar Research (www.radarresearch.com) and prepared in collaboration with the IAB Research Advisory Board, it provides online ad market stakeholders with a practical set of recommendations for standard operating procedures with respect to the use of ad effectiveness studies.
This new document is a follow-up to the groundbreaking 2010 IAB report “An Evaluation of Methods Used to Assess the Effectiveness of Advertising on the Internet” by Dr. Paul J. Lavrakas. That study examined the strengths and weaknesses of online ad effectiveness research methodologies.
The new report looks across the widely available methodologies to assess best practices in each phase of online ad effectiveness research and examines the challenges the industry faces within each phase, as originally outlined by Dr. Lavrakas, and proposes prescriptive remedies to each.
“Marketers are always looking to understand how their campaigns perform, and ad effectiveness research is one of the key tools in doing so,” said Sherrill Mane, Senior Vice President, Industry Services, IAB. “But there are still so many questions about the methodology itself that hamstring the validity of this research and undermine the industry as a whole. For our industry to continue to grow and realize its full potential, it is essential that we invest in the necessary advancements described by Dr. Lavrakas. In the interim, the ‘Best Practices’ document illuminates the planning, thresholds and decision parameters for working the existing tools.”
Some of the recommended IAB Best Practices for agencies and advertisers, as well as publishers, include:
Planning:
– To use online ad effectiveness surveys appropriately to make optimization decisions on an individual site, a study will optimally include at least 200 respondents.
– A 15-million impressions campaign should be the minimum before a site should consider running a study on behalf of advertisers, while a suggested “rule of thumb” is that the cost of an effectiveness study should be less than 10 percent of the overall buy.
– Agencies should include training and education for their media staffers not just on the mechanics and math of planning and buying, but also on the basics of research methodologies and implementation.
Recruitment:
– While the use of panels to recruit respondents may be an attractive alternative to live intercept recruitment, provided that the panels are validated, there are certain types of campaigns and circumstances that lend themselves more easily to the use of panels: high volume campaigns, multi-platform campaigns and customized ad placements.
– Publishers need to take some responsibility for declining response rates, and publishers should try to limit the frequency of survey invitations to protect the user experience and reduce clutter.
– Agencies and publishers should pressure vendors to undergo independent, third-party evaluations of their statistical methods and recruitment methodologies.
– Vendors should weigh results to actual campaign delivery, using third-party audience verification companies as a benchmark.
Deployment:
– All survey questions should be asked in an environment where the measured brand ads are not visible.
– Surveys aimed at business professionals should take less than 10 minutes to complete; four minutes or less is ideal and will improve completion rates.
– For consumer-targeted products, a longer survey may be possible, though advertisers should be wary of exceeding seven minutes; the “sweet spot” for survey length seems to be five to seven minutes, or approximately 20 to 25 questions.
Optimization & Analysis:
– When feasible, marketers should marry their campaign effectiveness research to salient online and offline metrics to get a more comprehensive view of their advertising efficacy.
– Even as optimization has been trending towards real time, brand marketers should be wary of making optimization decisions based on real-time ad effectiveness data.
“Online ad effectiveness research is challenged by serious methodological limitations and irresponsible study management,” said Marissa Gluck, Founder and Managing Partner, Radar Research. “By examining each phase in the delivery of online ad effectiveness research, we hope to not only understand the complexities and challenges inherent in this research but also remedy the industry’s most vexing problems.”
Origins of IAB Evaluation Study
Multiple interviews with key stakeholders were conducted in February and March 2011. Executives on both the publisher and agency side were interviewed, as well as vendor executives. Both larger and smaller agencies were interviewed, and both research and analytics executives were represented to get a more comprehensive view of the landscape as well as how data from these studies is incorporated into the overall value chain.
To view the Best Practices for Conducting Online Ad Effectiveness Research please visit: www.iab.net/ad_effectiveness_best_practices.
To view the 2010 “An Evaluation of Methods Used to Assess the Effectiveness of Advertising on the Internet” please go to: www.iab.net/media/file/Evaluation_of_Internet_Ad_Effectiveness_Research_Methods.pdf
About the IAB’s Research Council
The Research Council provides a forum for interactive research practitioners to share findings that support the growth of the industry; it encourages strong methodologies and best practices for research and measurement, and it works with the IAB to design and field important industry research projects and share these findings with key stakeholders.
A complete list of Research Council member companies can be found at
http://www.iab.net/member_center/councils_committees_working_groups/councils/research_council
About the IAB
The Interactive Advertising Bureau (IAB) is comprised of more than 500 leading media and technology companies who are responsible for selling 86% of online advertising in the United States. On behalf of its members, the IAB is dedicated to the growth of the interactive advertising marketplace, of interactive’s share of total marketing spend, and of its members’ share of total marketing spend. The IAB educates marketers, agencies, media companies and the wider business community about the value of interactive advertising. Working with its member companies, the IAB evaluates and recommends standards and practices and fields critical research on interactive advertising. Founded in 1996, the IAB is headquartered in New York City with a Public Policy office in Washington, D.C. For more information, please visit www.iab.net.
