REGISTRATION CLOSED

Tuesday, February 5, 2008

1 p.m. – Registration Opens; Break with Exhibitors

1:30 p.m. - Welcome Remarks

Diane Bowers, CASRO President
Frank Kelly, Managing Director, TNS EAP; Conference Co-Chair
Efrain Ribeiro, Chief Operating Officer, Ipsos Interactive Services; Conference Co-Chair

1:45 p.m. - Characteristics of Hyperactive Survey Takers:  A Continuing Investigation

Renée Smith, Vice President, Panel Quality, Harris Interactive, Inc.

Can bias from hyperactive respondents be mitigated with specific corrective measures? Continuing on previous work and theories developed, this research utilizes a propensity score based on attitudes and behaviors of likely panel joiners and survey completers to minimize potential biases created by “cheaters”.

2:25 p.m. - Online Interview Interventions: Can “Bad” Panelists be Rehabilitated?

Andrew Jeavons, Managing Director, Nebu USA LLC
Jeff Miller, Chief Operating Officer, Burke Inc.

The authors present an experiment which aims to show how the problem of satisficing and respondent “fraud” can be ameliorated, and completion rates in web surveys can be increased, through the use of survey “intervention” of covert or overt means.  

3:05 p.m. - Data Quality: What are the Top Response Sets and How Widespread are They?

Joe Giacobbe, Senior Vice President, New Product Development, Ipsos Interactive Services
Annie Pettit, Director of Online Panel Analytics, Ipsos Interactive Services

Segmenting respondents into groups based on such survey taking behaviors as speeding, taking the easy way out, random clicking and qualifying, this research will explore what types of errors fall into which response set, how many people fall into each response set, and do these response sets have a negative effect on survey results. Suggestions will be provided for creating high quality data quality checks in surveys.

3:45 p.m. - Break with Exhibitors

4:15 p.m. - How Do We Create “Cheat Free” Surveys?

Keith Price, Executive Vice President, Greenfield Online Inc.

Enticed by a large incentive, how many non-qualified respondents will fudge their answers to get the prize? This test survey provides insight on the correlation of incentives and cheating.  What are the 10 things you can do to structure your questionnaire to eliminate cheaters? How do you arrive at the optimal incentive?

4:55 p.m. - Open Discussion: Panel Integrity

Kevin Nuffer, Senior Marketing Consultant, McKinsey & Company
Jim Nyce, Senior Vice President, Global CIS, Kraft Foods, Inc.
Steve Coffey, Chief Research Officer, The NPD Group, Inc.
Frank Kelly, Managing Director, TNS EAP
Session Moderator: Efrain Ribeiro, Chief Operating Officer, Ipsos Interactive Services

A discussion regarding data quality.

5:45 p.m.-7:15 p.m. - Cocktail Reception with Exhibitors

7:30 p.m. – Dinner (provided) Sponsored by:

Wednesday, February 6, 2008

7:45 a.m. – Breakfast with Exhibitors

8:15 a.m. – Introduction, Day Two
Frank Kelly, Managing Director, TNS EAP; Conference Co-Chair
Efrain Ribeiro, Chief Operating Officer, Ipsos Interactive Services; Conference Co-Chair

8:25 a.m. - Evidence for Recruitment Method Effects: Response Rates, Distributions, and Quality

Bob Fawson, Director, Client Services, Western Wats

Do self-recruited panelists behave or respond differently from panelists selected by researchers for recruitment? Can these observed differences tell us anything useful about coverage concerns in unobserved characteristics? This session will answer these questions.

9:05 a.m. - An Empirical Approach to Correct Self-Selection Bias of Online Panel Research

Lisa Luth-Pickard, Chief Knowledge Officer, Luth Research

This session explores the development of a new propensity score system to normalize the potential self-selection bias in panel sampling. To uncover and balance the differences between online panel members and the rest of the population, factors regarding psychological and attitudinal contrasts beyond Internet usage are employed. 

9:45 a.m. – Networking Break with Exhibitors

10:15 a.m. - What’s the Catch?  Comparing River Respondents to Panelists

Marjette Stark, Senior Vice President, DMS Research
Melanie Courtright, Vice President of Marketing, DMS Research

Through a comprehensive study, the researcher seeks to provide a clear understanding of the differences and similarities between river respondents and panelists and then clarify how these might influence the research design and conclusions resulting from the use of a particular sample for an online study. 

10:55 a.m. Panelist Conditioning and Using Exclusion Periods and Category Lock-outs to Improve Data Reliability

Michael Gazala, CEO, North America, Lightspeed Research

Through two studies, the presenter seeks to: Determine the shortest acceptable exclusion period that can be used without affecting data reliability and determine if conditioning which impacts research results exists when respondents take subsequent surveys in the same category. An analysis of the results will help attendees understand the impacts of panel usage – specifically the role of exclusion periods and category controls - on research quality; Gain insight into best practices for utilizing exclusion periods and category lock-outs with online respondents; and Develop panel management strategies to increase the efficiency of panelist participation in surveys.

11:35 a.m. - Communities in Online Data Collection – Basics, New Trends and Panelists Point of View

Frederic-Charles Petit, CEO Toluna plc.

An in-depth look at the ever-changing online habits of potential respondents will help online sample providers add quality respondents to their ranks and secure the lasting loyalty of their panel members.  Analysis will also help panel companies tap the potential offered by online communities and provide insight on where the online-research industry is headed.

12:05 p.m. – Lunch (Provided)

1:15 p.m. - Maximizing Respondent Engagement Through Survey Design

Yola Zdanowicz,  Senior Vice President, Angus Reid Strategies
Su Ning Strube, Vice President, Fusion Services, Vision Critical

This research explores the impact of visual and interactive (user interface behavioural) design factors on respondent fatigue and overall satisfaction with the survey process. The incorporation of advanced user interface design into online surveys is the next frontier in online research, according to the presenter. These surveys are designed to maximize online data collection in an efficient and engaging manner. Not only is better data collected but respondents are more engaged in the research process and are emancipated from the tedium of traditional surveys. Advanced interaction design is a key element to the winning formula for retaining respondents trust and continued participation.

1:55 p.m. - Panelist Behavior and Survey Design: Key Drivers in Research Quality
Trixie Cartwright, Global Research on Research Director, TNS Global Interactive, London

The impact of different question layouts and designs will be investigated, particularly in relation to the quality and quantity of responses obtained. The study will also aim to identify the inattentive (or fraudulent) respondents based on their responses to certain ‘trap’ questions and their speed and pattern of response for other questions (particularly on grid questions).  In addition, the study will look at panellists self confessed reliability, by asking panellists directly to assess their motivations, commitment and pattern of responding to surveys.

2:35 p.m. - Web Survey Design: The Emerging Research Record
Reginald Baker, Chief Operating Officer, Market Strategies International

Dissecting the results from ongoing methodological experiments funded by the NSF, NIH the ISR at the University of Michigan and elsewhere, the presenter seeks to provide a set of best practices to ensure that respondents find survey questionnaires easy and comfortable to use, where design focuses all of the respondent’s cognitive energy on processing the question rather than struggling with a difficult, distracting, or biasing user interface. Specific design features to be addressed include: Survey Length, Progress Indicators, Screen Design, Images, Special Web Gadgets, Matrix Questions and Grids, Hyperlinked Help Features.

3:05 p.m. - Wrap-Up and Q&A: A Discussion of Key Issues Raised During the Conference
Frank Kelly, Managing Director, TNS EAP; Conference Co-Chair
Efrain Ribeiro, Chief Operating Officer, Ipsos Interactive Services; Conference Co-Chair

3:45 p.m. – Conference Adjournment

REGISTRATION CLOSED