Skip to content

Latest US poll: 63% say gas prices are affecting their household budget a great deal or a moderate amount

See the poll

Our methodology

How we design and run research

Every client study goes through the same six stages, from the decision you need to make to the file your team reads. This page explains each one, and helps you find the method that answers your question.

Six stages

How a study runs, stage by stage

The rules below come from the methods we run. Each one links to the study it comes from.

Study design

Start from the decision, then pick the method that answers it.

  • Start from the decision

    Entering a market, defending share and changing your position each need different questions. We agree the decision first.

    From: Competitor research
  • Pick the method that fits

    For pricing: Van Westendorp when you need a range, Gabor-Granger when you have a few candidate prices and want demand at each one. Both in one survey, with the open price questions first, so no price we show sways the answers.

    From: Pricing research
  • One idea per person

    In a concept test, each person sees one idea only, so the ideas never colour each other's scores.

    From: Concept testing
  • Questions in a fixed order

    In a brand funnel, brand names come first without help, then from a list, then consideration, first choice, recent purchase and recommendation. This order stops earlier questions from leading later answers.

    From: Brand funnel & KPI snapshot
  • Fair wording

    Claims are made alike in length and style, so a claim does not win just because it is better written.

    From: Claims testing
  • Ready-made questions, edited for you

    Many questions come from our library of 309 ready-made templates, then are edited to fit your category.

    From: Usage & attitude

Sampling and quotas

Decide exactly who answers, and how many.

  • Screen for the right people

    A short screener lets in only the people the study is about, such as people who bought the category recently.

    From: Concept testing
  • Quotas that match the plan

    Targets by age, gender, region and other profile answers, so the sample matches your plan.

    From: Audience sampling
  • Enough people per idea

    For a concept test we suggest at least 200 people per idea, and 300 if you want to compare groups.

    From: Concept testing
  • Bigger samples for segments

    Each segment needs enough people to be profiled, so a segmentation sample is larger than for most studies.

    From: Segmentation
  • Feasibility before the quote

    Tell us the audience, the country and the number of completes. If the audience is too small, we say so before we quote, not after fieldwork starts.

    From: Audience sampling

Fieldwork

Run the survey the same way for everyone.

  • Our own panel

    Studies run on PocketsFull, the panel we recruit and pay ourselves. Members answer a survey's qualifying questions in the app before it opens. For audiences the panel cannot reach, we can work with partner panels and tell you when we do.

    From: PocketsFull panel
  • Every outcome recorded

    For a survey hosted elsewhere, we set up the return links for completes, screen-outs and full quotas, so each outcome is recorded on both sides.

    From: Audience sampling
  • Quotas followed until full

    Invitations go to members who match your criteria, and our team follows each quota until it is full.

    From: Audience sampling
  • Every wave the same

    In a tracker, each wave uses the same screener, the same quotas and the same weighting.

    From: Brand health tracking
  • Stimuli shown the way people meet them

    A video ad plays to the end before any questions appear, and an audio spot plays once, as it would on air.

    From: Video ad testing

Quality control

Check the people and the answers before anyone reads them.

  • Attention checks on every response

    Studies on our panel run with attention checks on every response, and checks that open answers stay on topic.

    From: Usage & attitude
  • Recordings checked as they are made

    Video and audio answers are checked for length, words and topic, and video for a live person in enough light. A recording that fails goes back with the reason.

    From: AI video interviews
  • A review before delivery

    We review the data for incomplete answers, failed trap questions, speeders, straight-liners and answers that contradict each other, and agree any removals with you before the final count.

    From: Audience sampling

Analysis and reporting

Separate real differences from noise, and say what they mean.

  • Significance before action

    Up to five audience groups side by side, with markers where differences are significant. In a tracker, changes between waves are tested before anyone acts on them.

    From: Brand health tracking
  • Weighting to your targets

    Rim weighting to the targets you set for your survey.

    From: Reports & exports
  • Stated intent, adjusted

    People say they will buy more often than they do, so in market sizing we scale stated intent down and show that adjustment as an assumption you can change.

    From: Market sizing & demand forecasting
  • Open answers, sorted

    Open, audio and video answers are grouped into themes: the main points people made, how many raised each one, and the tone.

    From: AI video interviews
  • Files your team uses

    A chart for every question type plus 36 more chart views, Ask the study for plain-English questions, a PowerPoint deck, an Excel workbook, CSV files, chart images and the AI report as a web page.

    From: Reports & exports

Standards we work to

Named standards and codes, not adjectives.

  • ISO 20252

    The international standard for market, opinion and social research. It sets requirements for how research projects are planned, run, checked and reported.

    From: Accreditations
  • ISO 9001 and ISO 27001

    Quality management, and information security management under a managed, audited system.

    From: Accreditations
  • ICC/ESOMAR International Code

    As an ESOMAR member, we work to the ICC/ESOMAR International Code.

    From: Accreditations
  • MRS Code of Conduct

    As an MRS Company Partner, we commit to the MRS Code of Conduct.

    From: Accreditations

Which method?

Pick the question closest to yours

Start from the decision you need to make. Each answer opens the method that fits it.

Which of our ideas should we take forward?

The method

Concept testing

Find the winning idea before you build it

How it runs

  1. Tell us what you are deciding
  2. Show each idea the way people will meet it
  3. Ask the same core questions about every idea
  4. Field it with buyers in your category

What we measure

  • Trial
  • Feeling
  • Appeal
  • Newness
  • Relevance
  • Clarity

We have a long list of ideas. Which few deserve a full test?

The method

Idea screening

Find the few ideas worth a full test

How it runs

  1. Write every idea the same way
  2. Split the list across people
  3. Ask people to choose, not only rate
  4. Rank the list and draw the cut

What we measure

  • Preference share
  • Appeal
  • Newness
  • Clarity

What should we charge?

The method

Pricing research

Find the price your buyers will accept

How it runs

  1. Tell us what you are pricing
  2. Pick the method
  3. Show the product, then ask
  4. Field it with category buyers

What we measure

  • Too cheap
  • Bargain
  • Getting expensive
  • Too expensive
  • Optimal price point
  • Indifference price point

Which claims, features or messages matter most?

The method

MaxDiff

Rank a long list by what matters most

How it runs

  1. Bring your list
  2. We build a balanced design
  3. People choose most and least
  4. Read the scores

What we measure

  • Preference score
  • Picked as most important
  • Picked as least important
  • Best minus worst
  • Rank

Which line-up of products reaches the most buyers?

The method

TURF

Find the line-up that reaches the most people

How it runs

  1. Collect the right answers
  2. Agree what counts as reached
  3. Test the combinations
  4. Try your own line-up

What we measure

  • Reach
  • Frequency
  • Added reach
  • Reach on its own

Will our pack get seen, read and picked?

The method

Pack testing

Check your pack gets seen, read and picked

How it runs

  1. Send the designs
  2. Split the shoppers
  3. Watch what they notice
  4. Ask what they think

What we measure

  • Stand-out
  • First noticed
  • Appeal
  • Clarity
  • Message takeaway
  • Brand recognition

Will this ad work before we spend on media?

The method

Video ad testing

Test your video ad before the media spend

How it runs

  1. Share the cuts
  2. Pick the viewers
  3. Watch to the end, then answer
  4. Hear the reasons

What we measure

  • Brand recall
  • Message
  • Appeal
  • Persuasion
  • Feeling
  • Diagnostics

Is our brand growing, wave by wave?

The method

Brand health tracking

See how your brand moves, wave by wave

How it runs

  1. Set it up once
  2. Field every wave the same way
  3. Separate real change from noise
  4. Ask why when a line moves

What we measure

  • Unprompted awareness
  • Prompted awareness
  • Consideration
  • Preference
  • Use
  • Brand image

Who are our customers, really?

The method

Segmentation

Find the groups inside your market

How it runs

  1. Start from the decisions
  2. Survey a large sample
  3. Find the groups
  4. Size, profile and name them

What we measure

  • Needs
  • Attitudes
  • Behaviour
  • Value
  • Media and channels
  • Demographics

Where does the customer journey break?

The method

Journey mapping

See where the customer journey breaks

How it runs

  1. Agree the stages
  2. Hear the stories
  3. Measure every step
  4. Rank the pain points

What we measure

  • Satisfaction
  • Effort
  • Drop-off
  • Channel
  • Moments that matter
  • The end result

How satisfied are customers, and what should we fix?

The method

Customer satisfaction & NPS

Measure satisfaction, then find what to fix

How it runs

  1. Choose who to ask
  2. Ask for the score, then the reason
  3. Rate the moments that matter
  4. Read the results by group

What we measure

  • Net Promoter Score (NPS)
  • Satisfaction (CSAT)
  • Customer effort
  • Satisfaction by touchpoint
  • Reasons for the score
  • Intent to stay

Why do people do what they do, in their own words?

The method

AI video interviews

Real people, on camera, in their own words

How it runs

  1. Write the question
  2. Brief the AI interviewer
  3. People record
  4. You watch, read and ask

What we measure

  • Accepted answers
  • Re-recordings
  • Average length
  • Average relevance
  • Average attention
  • Rejection reasons

Glossary

The terms, in plain words

The words you will meet in a proposal or a report, explained the way our method pages use them.

One idea per person
Each person sees one idea only, so the ideas never colour each other's scores.
Screener
The first questions of a survey, which let in only the people the study is about.
Quota
A target number of people of each kind, by age, gender, region or other profile answers, so the sample matches the plan.
Screen-out and over quota
A screen-out did not qualify. Over quota means the person qualified after their group was already full.
Rim weighting
Adjusting the results to the targets you set for your survey.
Significance markers
Markers that show where a difference between groups is significant, so chance differences are not mistaken for real ones.
Van Westendorp
Four price questions (too cheap, a bargain, getting expensive, too expensive) that find the range of prices people accept.
Gabor-Granger
The share who would buy at each tested price, which shows how demand falls as the price goes up.
MaxDiff
People pick the most and the least important item from small sets. Every item gets a score, and the scores add up to 100.
TURF
Finds the line-up that reaches the most people: the share who would buy at least one item in it.
Net Promoter Score
How likely people are to recommend you, from 0 to 10. Promoters answer 9 or 10, passives 7 or 8 and detractors 0 to 6.
Theme
A group of open answers that make the same point, with how many people raised it and the tone.

Public polls

Looking for how we run our public polls?

Catalyse Pulse, our public polls, is a different job from client research, and it has its own method page.

How we run polls

Not sure which method fits?

Tell us the decision you need to make, and our researchers will suggest a method and explain why.

Offices: London (head office) · Orlando, FL · Gurgaon, Haryana