Many researchers struggle with a frustrating dilemma: they want participants who genuinely fit their target criteria and will provide thoughtful responses, but they worry that offering fair compensation will attract people who are “just there for the money.”

This thinking leads to a common mistake, under-paying participants and using basic demographic screeners, hoping to filter for “authentically interested” people. The result? You often end up with rushed, low-quality responses from participants who don’t actually match your needs.

Here’s the counter-intuitive truth: fair compensation combined with smart screening strategies actually helps you find and retain the exact participants you need for better research.

 Why Fair Compensation Attracts Better Participants

When you compensate participants appropriately, you’re not just being ethical, you’re being strategic. Fair payment signals that you value quality responses, and participants respond accordingly.

Fair compensation helps you attract participants who:

  • Take time to read instructions carefully
  • Provide detailed, thoughtful responses to open-ended questions
  • Are willing to engage with complex or sensitive topics
  • Complete multi-part studies and follow-up surveys
  • Feel respected and invested in contributing to meaningful research

Under-compensation often attracts participants who:

  • Rush through surveys to maximize earnings across multiple studies
  • May not actually fit your criteria but game the screener to qualify
  • Provide minimal effort responses like “good,” “okay,” or “fine”
  • Drop out of longitudinal studies when better-paying opportunities arise

The Secret to Effective Screening: Don’t Give Away Your Study Topic

Here’s where most researchers make a critical mistake: they reveal exactly what their study is about during the screening phase. This creates an incentive for participants to lie or exaggerate their qualifications just to get into your study.

Instead of This Approach:

❌ “We’re looking for people who use meditation apps. Do you use meditation apps?”

❌ “This study is about workplace stress. Are you currently employed and experiencing workplace stress?”

Try This Approach:

✅ Ask about the behavior or experience without revealing why you’re asking

✅ Use multiple angles to verify the same qualification

✅ Include questions that would be difficult to fake without real experience

Smart Screening Strategies That Actually Work

Use experience-based questions that would be difficult to fake without genuine familiarity. Instead of asking “Do you use fitness apps?” ask “What apps do you have on your phone’s home screen?” or “Describe your typical morning routine.” Real users provide specific, detailed answers while people trying to qualify give generic responses.

Ask about specific behaviors rather than general categories. Instead of “Do you shop online frequently?” ask “How many online purchases have you made in the past month?” followed by “What was your most recent online purchase?” This approach reveals actual experience levels.

For technology studies, include knowledge-testing questions. Ask participants to explain a feature or describe how they would accomplish a specific task. Someone who genuinely uses the technology will provide confident, accurate answers, while someone pretending will struggle with specifics.

Structure your screener using progressive disclosure. Start with broad demographic questions, then move to behavior and experience questions without revealing your study topic. Add knowledge or specific experience validation, and only then reveal the study topic and ask for final consent. This prevents participants from working backwards from your research topic to game their answers.

Advanced Screening Techniques

Build consistency checks into your screener by asking similar questions in different ways. Early in the screener, ask “How often do you cook at home?” with options like Never/Rarely/Sometimes/Often/Daily. Later, ask “On average, how many meals do you prepare at home per week?” with numerical ranges. Inconsistent answers signal that participants aren’t being truthful.

Include questions where certain combinations of answers don’t make logical sense. If someone claims to be a “daily social media user” but can’t name any platforms they use, or says they “never drive” but also “commute to work by car daily,” these contradictions reveal dishonest responses.

Follow up closed-ended screener questions with “Please explain your answer” or “Can you give me an example?” Real experiences produce specific, detailed responses, while fabricated answers tend to be vague or generic.

Quality Control During the Study

Continue monitoring participant quality even after your screening process. Watch for completion times that are significantly faster than your pilot testing, identical responses across different question types, or generic copy-pasted answers to open-ended questions. These are warning signs that participants may not be fully engaged.

Quality participants show different patterns. Their completion times suggest careful consideration, their response patterns demonstrate engagement with different question types, and they provide specific, relevant details in open-ended responses. They also maintain consistent performance on validation questions throughout your study.

Design attention checks that actually test engagement rather than just reading ability. Ask participants to recall information from previous sections, follow specific instructions regardless of their opinion, or answer the same question in different formats to check for consistency. These checks help you identify which participants are truly paying attention to your study content.

The ROI of Quality Participants

When you invest in fair compensation and smart screening, you see returns in both data quality and research efficiency.

Immediate Benefits:

  • Cleaner data requiring less exclusion and re-collection
  • More nuanced insights from thoughtful responses
  • Higher completion rates for complex or lengthy studies
  • Reduced need for data validation and cleaning

Long-Term Benefits:

  • A reliable pool of quality participants for future research
  • Reduced recruitment costs for subsequent studies
  • Better reputation among research participants leading to word-of-mouth referrals
  • More credible and actionable research findings

Moving Forward

Finding quality research participants isn’t really about solving a paradox, it’s about building a sustainable system based on respect and smart strategies. When you compensate fairly and screen intelligently, you’re telling participants that you value both their time and their authentic contributions.

This approach doesn’t just improve data quality; it creates a sustainable research practice where participants feel valued, researchers get reliable data, and the entire research ecosystem benefits from higher standards.

The goal is to treat participants as valuable research partners, not simply people who tick boxes in your survey.

Need help setting up your next study on Positly, or have questions that were not covered here? Please don’t hesitate to reach out by contacting us here.