Tuesday, August 4, 2009

Top Tips to Writing Effective Surveys

Designing surveys is easy; isn’t it? The truth is that writing surveys is easy but writing surveys that will be effective is more difficult. The following tips will help you write more effective surveys.

1. What is the purpose of the survey?

There are many reasons for conducting questionnaires. By correctly phrasing the questions and structuring the answers surveys can be used in many ways and for a variety of reasons. When compiling a survey don’t lose sight of its purpose.

2. Give the survey a good title

The survey title represents an opportunity to instantly summarise a survey’s objective and encourage respondents to participate. Respondents need to invest time in completing the survey so encourage them that the investment they make will be worthwhile

3. Ensure that you do not make the survey any longer than it needs to be

Every question that is asked should be asked for a reason. Minimize the questions providing you with ‘nice to know’ information and focus instead on the ‘need to know’ questions

4. Use plain English, avoid jargon and acronyms, maintain consistency and don’t ask questions that may result in ambiguous answers

Care must be taken in wording a question. There is every chance that if respondents can interpret any question that is not clearly written differently to that intended by the survey’s publisher then any analysis of the survey results may be worthless or at the very least misleading.

5. Avoid long questions

Use concise sentences wherever possible. Long questions can cause a respondent to lose concentration and lead to them abandoning the survey

6. Ask only one question at a time

Avoid confusing the respondent with a question like ‘Do you like athletics and golf?

7. Do not influence the answer

Do not load the question. ‘Should irresponsible shop keepers who sell alcohol to children be prosecuted?’ is likely to have no value.

8. Make sure that the answer format used allows the respondent to answer the question being asked

Allow the respondent to answer how they really feel or they may be less inclined to complete the survey. As a last resort consider the benefit of including a “No comment”, “Don’t know” or similar response option.

9. While compiling your survey consider how you will want to analyse the results once the survey has been published

When asking questions that allow for a free text open ended response appreciate that such information is likely to be difficult to score and/or summarised. Consider grouping answers. For example “Indicate your length of service?” – ‘less than 2 year’, ‘between 2 and 5 years’ and ‘more than 5′.

10. Ensure that the questionnaire flows

Group the questions into clear categories as this makes the task of completing the survey easier for the participants.

11. Target your respondents carefully

In some cases you will want to target a specific group, in others a cross section. If you can’t control who responds to your survey consider including questions/answers that will allow you to filter out respondents who don’t fit your target profile.

12. Allow the respondent to expand on their answer or make comments

By allowing respondents to make additional comments you will increase their satisfaction level and the comments will also give valuable feedback on the specific questions and/or the survey as a whole. Remember that for large sample collections it may prove difficult to analyze free text open ended responses.

13. If you are conducting a confidential survey ensure that your pledge for confidentiality is honoured

If you have made guarantees to the respondents that the survey is confidential you need to ensure that the individual data is not shared with anyone or used for any other purpose. Confidentiality must be maintained and any contact information deleted after the survey is complete.

14. Consider the advantages and disadvantages of allowing respondents to be anonymous or identifiable

If your respondents are to be anonymous then you will be unable to follow up or match “pre” or “post” surveys. However in some cases allowing respondents to remain anonymous will allow respondents to respond without possible peer pressure.

15. Carefully consider the best response format

Maintaining a consistency in the format used for responses is good practice. When designing your survey keep in mind that when analysing the data single selection radio buttons are easier to analyse than multiple selection check boxes. If a radio response format can be used do not use a check box format.

16. Provide the respondent with an estimate as to how much time the survey will take to complete
Respondent drop out can increase if there is no end in sight to the survey questions. It is good practice to indicate how long the survey is likely to take so that the participants can choose the best time to complete the survey.

17. Advise the respondents of the survey end date

Encourage respondents to complete the survey as soon as possible but advise respondents as to the survey’s end date so that they have the opportunity to schedule the necessary time.

18. Trial the survey

Before publishing a live survey publish the survey as a trial to check for questions that are ambiguous or confusing and to ensure that the survey is aesthetically pleasing.

19. Before publishing the survey check the survey several times

Check more than once that the survey is grammatically correct and makes sense. If possible get someone else to proof read the survey before you publish, if no one else is available then take a break before checking again.

20. Thank the respondents

To complete surveys respondents will need to invest their time and therefore should be thanked either at the end of completing the survey or in a follow up letter. You may even want to consider an incentive such as a reward of some sort.

For more information please visit Survey Galaxy.

No comments:

Post a Comment