ESOMAR has developed 28 questions to "provide a standard set of questions a buyer can ask to determine whether a sample provider’s practices and samples fit with their research objectives."
Our answers are provided below or you can download them as a file here.
esomar 28 answers
COMPANY PROFILE
1. What experience does your company have in providing online samples for market research?
IranPoll is an independent full-service opinion research and consultancy company in Toronto, Canada, focusing on Iran. With two centralized call centers employing interviewers with all ten local languages/dialects, IranPoll has a vast survey capacity to conduct and collect polling data from Iran using various modes of data collection. Building on the in-depth local knowledge of its team of experts, IranPoll solely relies on methods that could be objectively verified and independently replicated.
IranPoll’s online panel of Iranians is paralleled by none. With over 50,000 active panelists from across Iran, IranPoll is the largest online panel provider for the Iranian. In various capacities, we have been providing our clients with online panel services since 2009.
SAMPLE SOURCES AND RECRUITMENT
2. Please describe and explain the type(s) of online sample sources from which you get respondents. Are these databases? Actively managed research panels? Direct marketing lists? Social networks? Web intercept (also known as river) samples?
IranPoll’s online panel is an actively managed and maintained proprietary panel. Considering that IranPoll regularly conducts national probability sample CATI surveys, we have used this unique opportunity for recruitment purposes. Consequently, our panel members are composed of individuals with whom we have conducted a telephone survey in the past. This recruitment exercise has kept our panel fresh, relevant, and diverse.
All recruited individuals are validated and profiled through a telephone interview. The mobile phone numbers associated with each panel member is kept on a secured file for quality control purposes.
3. If you provide samples from more than one source: How are the different sample sources blended together to ensure validity? How can this be replicated over time to provide reliability? How do you deal with the possibility of duplication of respondents across sources?
Since all of our panel members are validated and profiled through a telephone interview and since each panel member is identified by his/her individual mobile phone number, IranPoll has kept the likelihood of duplication of respondents across sources to a minimum.
Since diversity and representativeness of our panel is of utmost importance to us, we have solely relied on our routine probability sample CATI surveys for recruitment purposes. Considering that all of our panel members have been extensively profiled and have been assigned a unique ID to track participation, for each project we ensure that the characteristics of the respondents closely match those of the target population. Once a survey is completed, we compare the characteristics of the survey sample with those of the target population and, if requested and when necessary, use post-survey weights to balance the sample.
4. Are your sample source(s) used solely for market research? If not, what other purposes are they used for?
IranPoll uses its panel solely for research purposes. Under no circumstances do we send or allow our clients to send advertisements to our panel members or use our sample for direct marketing.
5. How do you source groups that may be hard to reach on the internet?
Iran’s multi-ethnic and multilingual society requires us to pay particular attention to groups that may be hard to reach on the internet. For this reason, we have solely relied on offline methods and use our ongoing probability sample CATI survey projects for recruitment purposes. At the end of each probability sample interview, particularly those conducted in hard-to-reach areas and/or populations, we invite the respondent to join our panel. This recruitment method along with the size of our panel has allowed us to be able to drill down to incidence rates of less than 3%.
6. If, on a particular project, you need to supplement your sample(s) with sample(s) from other providers, how do you select those partners? Is it your policy to notify a client in advance when using a third party provider?
As the largest online panel provider for the Iranian population, IranPoll has never needed to subcontract or use third parties. In the unlikely event of such need arising, IranPoll will inform the client that we cannot fulfill his/her research needs on our own and will transparently provide all options that may be available to the client.
SAMPLING AND PROJECT MANAGEMENT
7. What steps do you take to achieve a representative sample of the target population?
Our sampling process begins with having a solid understanding of the target population. Considering that IranPoll regularly conducts probability sample CATI surveys, our understanding of the target population goes much deeper than available census data. We use official census data as well as our proprietary data on various populations to closely match our panel sample with those of the target population. Considering that all of our panel members have been extensively profiled, using our proprietary access to dependable information on various target populations, for each project we draw our panel sample such that the characteristics of the panel sample closely resembles those of the target population.
8. Do you employ a survey router?
No. IranPoll does not use a survey router. Each panelist is selected and specifically invited to take a particular survey based on the study’s requirements and his/her personal profile and characteristics.
9. If you use a router: Please describe the allocation process within your router. How do you decide which surveys might be considered for a respondent? On what priority basis are respondents allocated to surveys?
IranPoll does not use a survey router.
10. If you use a router: What measures do you take to guard against, or mitigate, any bias arising from employing a router? How do you measure and report any bias?
IranPoll does not use a survey router.
11. If you use a router: Who in your company sets the parameters of the router? Is it a dedicated team or individual project managers?
IranPoll does not use a survey router.
12. What profiling data is held on respondents? How is it done? How does this differ across sample sources? How is it kept up to date? If no relevant profiling data is held, how are low incidence projects dealt with?
All of our panel members have been individually validated and profiled through a telephone interview prior to becoming member. The initial survey profiles respondents across more than eighty variables. These profiles are both updated and augmented with every survey the respondents complete. The profiling data we collect provides IranPoll with an unparalleled targeting capability. Whether a client needs a panel matching national population proportions or one that includes members from a particular ethnic group, region, province, or even a city, IranPoll can deliver. In fact, our probability-based recruitment method, the size of our panel, as well as our extensive profiling efforts allow us to be able to drill down to incidence rates of less than 3%. Some of our most popular panel profiling attributes are detailed here: http://www.IranPoll.com/panel-targeting/
13. Please describe your survey invitation process. What is the proposition that people are offered to take part in individual surveys? What information about the project itself is given in the process? Apart from direct invitations to specific surveys (or to a router), what other means of invitation to surveys are respondents exposed to? You should note that not all invitations to participate take the form of emails.
All of our surveys are by direct invitation only. Through the sampling process, individual panel members are selected to participate in a survey. Then an invitation is sent to the respondent both via e-mail and SMS. SMS invitations are important for us since a proportion of our panel members access the internet only through their mobile devices. Each invitation is sent using IranPoll’s company e-mail and telephone. The invitation generally includes basic information regarding the survey, the survey’s unique URL, and information on how to contact our support center should they have any questions regarding the invitation and/or the survey.
14. Please describe the incentives that respondents are offered for taking part in your surveys. How does this differ by sample source, by interview length, by respondent characteristics?
Every panel member is informed about the incentive structure immediately after becoming validated and prior to being invited to partake in their first survey. IranPoll provides its panel members with three types of incentives depending on the projects:
For every survey, a single respondent is selected by lottery from amongst all of the respondents of that survey to win a large monetary incentive.
All respondents receive a monetary incentive based on their individual characteristics as well as the number and length of the surveys they complete.
IranPoll also uses a point system to incentivize panelists to remain active. In this system, panelists receive points based on the number and length of surveys they complete. The points can be redeemed for a variety of rewards based on panelists’ preference.
15. What information about a project do you need in order to give an accurate estimate of feasibility using your own resources?
We need the following information to be able to provide a client with an accurate feasibility and cost estimate:
Profile of the target population
Respondent qualification criteria
Any over-quotas required
Time in the field
Length of interview
Number of completed
Survey topic
Any special programming, stimuli, or tasks required
With this information we will be able to tell a client whether the study is within our capabilities. If there is a feasibility issue, we will work with the client to decide on the best course of action. If there is no feasibility issue, we will also provide the client with the cost and length of the project.
16. Do you measure respondent satisfaction? Is this information made available to clients?
We primarily gauge respondent satisfaction in two ways:
1) Every four months, we send a short survey to all of our panel members that measures their satisfaction with being a member of IranPoll’s panel and the main reasons behind possible dissatisfactions.
2) Our panel members are regularly informed that should they have any questions or concerns regarding any issues pertaining to their membership, they should contact our member support center. The support center, in turn, not only resolves issues but systematically provides the management with reports on the issues raised by panel members.
These two methods provide us with timely evaluation of how IranPoll and its online panel is perceived by its panelists and allow us to resolve issues that has a direct effect on the satisfaction level of our panelists as quickly as possible.
17. What information do you provide to debrief your client after the project has finished?
IranPoll believes in transparency. We, therefore, actively keep our clients informed about various aspects of the project before, during, and after the fieldwork. During the fieldwork we actively communicate to our clients any feedback we get from our panel members. Also, if requested, we provide our clients with a daily progress report. Once the project is completed – for surveys that we have hosted - we provide our clients with all participation history they may have asked prior to the fieldwork. The requested information would be submitted to the client immediately after the completion of the fieldwork. It is needless to say that the privacy of our panel members will be strictly protected during the entire process.
DATA QUALITY AND VALIDATION
18. Who is responsible for data quality checks? If it is you, do you have in place procedures to reduce or eliminate undesired within survey behaviours, such as (a) random responding, (b) Illogical or inconsistent responding, (c) overuse of item non-response (e.g., “Don’t Know”) or (d) speeding (too rapid survey completion)? Please describe these procedures.
Quality Control is central to everything IranPoll does. When we host a survey, we check for random responding, inconsistent responding, over-use of item non-response, speed responding, and straight-lining and do not regard affected surveys as complete and blacklist respondents who engage in such practices. We also regularly eliminate from our panel fraudulent, inactive, unresponsive, and inattentive respondents. We also compare demographic information provided in surveys with those in each respondent’s panel profile to ensure that no inconsistencies exist.
19. How often can the same individual be contacted to take part in a survey within a specified period whether they respond to the contact or not? How does this vary across your sample sources?
IranPoll’s objective is to keep its panel members engaged without overburdening them. To achieve this objective, we ask our panel members what rate of contact they think is appropriate and what they regard as being too excessive. We then use this information to ensure that we keep our contact with each panelist within what they and what we (for methodological purposes) regard as appropriate. Panelists may contact our support center anytime to increase or decrease the rate at which they are contacted, or they can simply unsubscribe from the panel all together if they choose to. Regardless of what the respondent suggests being his tolerance level, however, we maintain a cap on invitation for methodological reasons.
20. How often can the same individual take part in a survey within a specified period? How does this vary across your sample sources? How do you manage this within categories and/or time periods?
All of our surveys are by invitation only and each selected panel member only receive one invitation. While the cap we maintain for each respondent is one invitation every two weeks, due to the size of our panel each panelist receives about one invitation every five weeks.
21. Do you maintain individual level data such as recent participation history, date of entry, source, etc., on your survey respondents? Are you able to supply your client with a project analysis of such individual level data?
While IranPoll does collect and hold complete individual level history of every panelist for quality control purposes, it strictly safeguards any personally identifiable information of its panel members and does not disclose them to anyone, including our clients. Besides personally identifiable information, however, the client may request and will be provided with a per-job analysis of the respondents.
22. Do you have a confirmation of respondent identity procedure? Do you have procedures to detect fraudulent respondents? Please describe these procedures as they are implemented at sample source registration and/or at the point of entry to a survey or router. If you offer B2B samples what are the procedures there, if any?
At IranPoll we have zero tolerance for fraudulent respondents and our identity validation process begins before an individual joins our panel. Before joining our panel, each of our panelists are interviewed, validated, and profiled over the phone. We also obtain and validate each of our panel members’ personal e-mail and mobile phone numbers. Each individual is only allowed to register once, and we do not register two profiles with identical e-mails and mobile phone numbers. We also routinely check the profiles of our panel members and investigate profiles that do not pass our similarity standards. Since all of our surveys are by invitation only, each selected panel member receives a unique URL that can only be completed once. We also apply survey level quality controls to catch and blacklist respondents who engage in random responding, inconsistent responding, speed responding, and straight-lining. We rigorously investigate cases where the demographic information provided by a panel member on a survey is different from the information on his/her profile. In addition, we utilize Two-factor authentication at the time of reward redemption. This procedure removes the incentive for the majority of fraudulent behaviors as receiving the rewards is only possible after pre-payment re-authentication.
POLICIES AND COMPLIANCE
23. Please describe the ‘opt-in for market research’ processes for all your online sample sources.
IranPoll’s recruitment process ensures that all of our panel members are fully aware of our terms and conditions and are willingly becoming a member of our panel. No one can become a member of our panel without being validated and profiled through a telephone interview (the registration interview). During the registration interview, all validated individuals are informed of our terms and conditions and permission is obtained to enlist them in our panel.
24. Please provide a link to your Privacy Policy. How is your Privacy Policy provided to your respondents?
Here is a link to IranPoll’s Privacy Policy: http://www.IranPoll.com/privacy
During the registration interview all validated individuals are informed about the general terms of our Privacy Policy and are explicitly informed that we will hold all personal information provided to us strictly confidential. During that interview, we also request our panel members to read our full Privacy Policy, which is located on our website as well as in all of our e-mail communications with the panel member. The very first e-mail that registered individuals receive from IranPoll is an e-mail that clearly communicates and obtains their agreement with our terms and conditions and our privacy policy.
25. Please describe the measures you take to ensure data protection and data security.
Considering the environment in which we are operating, we take our responsibility to protect the privacy and personal information of our panel members very seriously. In line with Article 4.3 of ESOMAR/WAPOR guidelines, IranPoll has adopted a series of measures to give confidence to its Iranian panel members that their personal identity will never be disclosed. These measures extend from standard privacy protocols, to providing respondents with high-quality VPN services. In addition, all our staff must sign a confidentiality agreement outlining the employee’s obligations to protect all private and confidential information. Staff must adhere to strict guidelines to prevent sharing of any sensitive information across clients, projects, or even departments.
26. What practices do you follow to decide whether online research should be used to present commercially sensitive client data or materials to survey respondents?
Before starting fieldwork, we always obtain our clients’ explicit approval of the survey instrument, the online program that will administer it, and the manner in which commercially sensitive materials are presented or discussed. Also, our terms and conditions explicitly indicate to panel members that they should regard all information presented in an online survey as confidential.
None of these measures, however, guarantee that a leak will not happen and ultimately it is the client who will have to decide what information he/she is comfortable sharing with our panel members and whether our online panel practices suit their material protection needs.
In cases where the material is very sensitive, we often suggest other more secure modes of data collection. As a full-service opinion research and consultancy company, we offer a wide range of data collection services that are significantly more suitable for presentation of sensitive material.
27. Are you certified to any specific quality system? If so, which one(s)?
We are compliant with the ESOMAR Guidelines, covering all legal, ethical, and practical aspects of doing research.
28. Do you conduct online surveys with children and young people? If so, do you adhere to the standards that ESOMAR provides? What other rules or standards, for example COPPA in the United States, do you comply with?
While we do not have any panel member who is under the age of eighteen, we conduct online surveys that require child respondents by asking panel members with children to present the survey to their children. For all such surveys, legal guardians are provided with the full survey instrument and their explicit consent is acquired ahead of time.
As a standard practice, IranPoll verifies the integrity of any data it collects through its partners by conducting a portion of the research using its own capabilities in Toronto.