Skip to main content

Qualtrics Survey Guide: Steps and Tips

use this software to create surveys

Survey Steps

  1. Establish the goals of the project
    – decide what you want to learn
    1. the goals of the project determine whom you will survey and what you will ask
    2. if your goals are unclear, the results will probably be unclear.

  2. Determine your sample – 2 main components
    1. first is deciding what kind of people to interview – “target population”
    2. how many people you need to interview
    3. careful of population bias

  3. Choose interviewing methodology
    1. How you will interview – person, phone, email, computer, etc.;
    2. How you will distribute: web page popup, email, paper and transfer results to online version

  4. Create your questionnaire
    (see Survey Construction box)
    1. KISS – keep it short and simple.
    2. Divid questions into three groups:
      1. must know,
      2. useful to know
      3. and nice to know.
    3. Then discard the last group, unless the previous two groups are very short.

  5. Start with an introduction:
    1. who you are and why you want the information
    2. it will also encourage people to complete your questionnaire

  6. Pre-test the questionnaire

  7. Distribute or conduct interviews
    (code and enter interview data)

  8. Analyze the data – Produce the reports
    1. how to handle open ended questions
    2. coding adn grouping responses    
    3. download or excel display

Note: Human Subjects Permission

Methods used to increase response rates

Methods used to increase response rates

  • brevity
  • incentives – financial or non-monetary
  • guarantee anonymity
  • acknowledge affiliation with universities, research institutions, or charities
  • emotional appeals and bids for sympathy
  • convince respondent that they can make a difference
  • preliminary notification
  • foot-in-the-door techniques – start with a small inconsequential request
  • personalization of the request – address specific individuals
  • follow-up requests – multiple requests

Use features

Online – take advantage of html and computer technologies

a. add maps
b. picture examples
c. require information to continue
d. limit choices

Survey Construction

Question and choice responses:

  • Allow a “Don’t Know” or “Not Applicable” response to all questions, except to those in which you are certain that all respondents will have a clear answer
  • Include “Other” or “None” if either of these is a logically possible answer

3 basic types of questions:

  • multiple choice,
  • numeric open end
  • text open end question and answer

Question and choice order:

  • Ideally, the early questions in a survey should be easy and pleasant to answer
  • Whenever possible leave difficult or sensitive questions until near the end of your survey
  • Leave your demographic questions (age, gender, income, education, etc.) until the end of the questionnaire
  • Always present agree-disagree choices in that order

Reduce habituation

  • Randomize the order of related questions
  • Present a series of questions in a random order
  • Change the “positive” answer (applies mainly to level-of-agreement questions)
  • People tend to pick the choices nearest the start of a list when they read the list

Do not put two questions into one.

Watch language:

  • Try to make sure the wording does not favor one answer choice over another.
  • Avoid emotionally charged words or leading questions
  • Avoid technical terms and acronyms

Leave a space at the end of a questionnaire entitled “Other Comments.