Share this
Steve Mossop on political polling accuracy and best practices
by Infotools on 25 Jul 2023
Steve Mossop, executive vice president of Leger, recently joined our market research podcast. He leads a team of 25 plus researchers serving public and private sector clients with full-service market research solutions. Leger is Canada's largest and best known public opinion polling firm. Steve has impressively correctly predicted the outcomes of 25 elections over his career. During the podcast, Steve shared with us the importance of election polling, why we do it and what the pitfalls and upsides are in the polling world.
He starts out by sharing a little bit of history - back to telephone and door to door interviews - as well as how he became interested in public opinion polling from working on the “Coke vs. Pepsi” blind taste test wars. He said, “Coca Cola made the biggest mistake ever by changing their formulation without any other consideration than the blind taste testing. And that inspired me over the years as a story to repeat because they didn't ask the right question.” He said people aren’t just influenced by “taste” but also by the marketing and packaging around it. He transferred this knowledge to political polling by examining politics with “brand” in mind.
Steve says companies that do election polling accurately can use this as a litmus test for the other work that they do. “If you can predict, predict elections accurately, then certainly you can predict things like market share, product selection and public opinion on other things - all those variables that we stand behind as a market research industry.” He also shares that secondary research has shown that election polls are extremely accurate. He speaks with us about some examples of research he is working on now, past case studies, plus important questions and methods to set up for political polling, to illustrate his point.
Steve shares a story about some polls that were conducted in Canada, during which every pollster got the election results wrong. Leger found during an exit poll that most people decided on how they would cast their vote only 24 hours before they voted. While this is unusual, Steve likens it back to the Coca Cola story and re-emphasizes the importance of asking the right questions. He then talks about some examples in the United States and how a smaller segment of underrepresented voters can sway the vote and panels need to account for that reality.
Some of the biggest lessons Steve has learned is that last minute changes in voter sentiment and fringe voter segments can overturn mainstream election results. He gives some tips on how to fill in the gaps here to create more accurate outcomes, including panel quality - something behind the recent failure of pollsters to accurately predict recent elections. While there is no single solution to this problem, employing a mix of methodologies and knowing where panel members are coming from can help. Quality control is at the top of Steve’s list when it comes to improving polling outcomes, plus having experts internally who understand political nuances.
Also during our conversation, Steve emphasized the importance of monitoring competitors and staying updated on industry changes, as this allows companies to learn from each other and collectively improve the polling industry's standards. The presence of peer pressure is identified as a powerful motivator for bettering the industry, as all polling companies are under the watchful eye of their peers, striving to maintain credibility and accuracy in their predictions. He speaks about Leger’s strengths in the space, and some best practices.
No discussion would be complete these days without touching on the impact of artificial intelligence. We explore the positive impact of AI in polling operations as it can aid in various aspects of the business, such as coding, questionnaire design, and data analysis, leading to significant advancements in recent months. However, Steve acknowledges that the rise of AI also brings challenges, particularly in maintaining panel quality. The growing sophistication of AI-powered bots poses a risk, making it increasingly difficult to detect fraudulent responses manually. This raises concerns about the industry's ability to stay ahead of such challenges and maintain the representativeness and accuracy of their panels, plus the potential loss of human control over the decision-making process.
We conclude by going over all the variables that feed into accurate polling processes (there are a lot!) and some of Leger’s successes.
Share this
- October 2024 (1)
- September 2024 (4)
- August 2024 (6)
- July 2024 (7)
- June 2024 (4)
- May 2024 (7)
- April 2024 (6)
- March 2024 (3)
- February 2024 (8)
- January 2024 (3)
- December 2023 (6)
- November 2023 (5)
- October 2023 (3)
- September 2023 (8)
- August 2023 (4)
- July 2023 (6)
- June 2023 (6)
- May 2023 (3)
- April 2023 (6)
- March 2023 (6)
- February 2023 (4)
- January 2023 (2)
- December 2022 (2)
- November 2022 (8)
- October 2022 (6)
- September 2022 (6)
- August 2022 (7)
- July 2022 (5)
- June 2022 (6)
- May 2022 (5)
- April 2022 (4)
- March 2022 (8)
- February 2022 (7)
- January 2022 (1)
- December 2021 (2)
- November 2021 (2)
- July 2021 (4)
- June 2021 (2)
- May 2021 (4)
- April 2021 (2)
- March 2021 (5)
- February 2021 (3)
- January 2021 (3)
- December 2020 (1)
- November 2020 (5)
- October 2020 (2)
- September 2020 (5)
- August 2020 (4)
- July 2020 (4)
- June 2020 (1)
- May 2020 (3)
- April 2020 (6)
- March 2020 (3)
- February 2020 (4)
- January 2020 (2)
- December 2019 (4)
- November 2019 (4)
- October 2019 (3)
- September 2019 (2)
- August 2019 (4)
- July 2019 (5)
- June 2019 (2)
- May 2019 (4)
- April 2019 (4)
- March 2019 (2)
- February 2019 (4)
- January 2019 (3)
- December 2018 (5)
- November 2018 (2)
- October 2018 (1)
- September 2018 (3)
- August 2018 (5)
- June 2018 (4)
- May 2018 (4)
- April 2018 (3)
- December 2017 (1)
- November 2017 (2)
- October 2017 (1)
- September 2017 (3)
- August 2017 (2)
- June 2017 (2)
- February 2017 (2)
- January 2017 (2)
- December 2016 (2)
- September 2016 (1)
No Comments Yet
Let us know what you think