General #1

Why are we doing this series?

General #2

Using question numbers is just noise

General #3

Why do we call them Potholes?

General #4

Where do these surveys come from - are they real?

Basic Questions/ Structure/ Language

#11

Starting surveys with an open-ended question is a response killer.

#12

Double whammy. An open-ended question so early in the survey coupled with asking residents to imagine a future state. You’re skewing respondents to a very narrow audience group

#18

The style of question used limits the value of the insights collected.

#19

Triple-barreled questions provide unclear results

#22

Asking respondents if they have heard of something before

#26

The use of clear language is critical

#27

Poor application of a matrix question which asks respondents to oppose or support three principles in one.

#28 & #29

Double Whammy - Poor question structure and poor use of language

#31

Using a scale and then breaking out responses at the next level adds a lot of insights and value

#33

Mixing scales can lead to less than clear results.

#39

Use of a sufficient number of open-ended questions

#45

Asking “most frequent” and then letting respondents select as many responses as they want will give you false data.

#46

Estimating 5 to 10 minutes to complete the survey could be off-putting to residents.

#65

The less complex language the better the results

#73

Asking an open-ended question too early without context

#77

Wording is so critically important when you're conducting survey research

#78

Being explicit with language an item - educate respondents on what options mean

#81

Reversing the negative to positive or positive to negative scales/response options within a survey can confuse people and create response errors

#82 & #901

It would be great to gauge how often respondents use the website. Are frequent users happier or less?

#85

Using balanced scales is important

#93

Comments should be asked as a complementary option

Narrative

#101

Repeating the same introduction multiple times causes frustration and survey fatigue right up front.

#103 & #201

Badly worded introduction without a clear question or next step

#117

Not providing enough context

#118

Asking questions that you know what the answers are going to be - dig deeper - fire versus bylaw services

#121

Asking residents to commit to specific behaviour at an event seems outside the bounds of survey research

#123

Being too granular without providing enough information.

#152

Being too broad-based doesn't get you any meaningful results.

#155

Measuring awareness but skewing results by providing information some respondents may read while others will not read

#179

Single-opened question - does it speak of positive intent does it build trust

Logic

#200

Progress bars are meant to encourage you to complete surveys & give you a sense of how far you've come in the survey

#211

Use logic to only ask questions relevant to the respondent

#212

Let’s be considerate of the respondents' time.

#213

Be considerate of respondents' time

#230

Let's get as much data as possible - breaking out four specifics into a matrix

#235

Let’s get logical The second question seemed redundant when the first question announced it was the first time voting by mail was allowed.

#271

Addressing the possible NIMBY effect in the survey topic.

Images

#371

Images without legends are just pretty pictures and don’t provide any content.

Demographics

#401

Demographic questions at the beginning of the survey are never a best practice

#402

Allowing respondents to skip demographic questions

#403

Finite age categories don't serve any purpose

#410

Logical group questions especially demographic questions

#403

Finite income categories and not specifying whether it is personal pre or post-tax or household pre or post-tax

#434

Using skip logic to bypass questions that are not required

#444

Closed-ended questions are far easier to tabulate

#457

Asking for demographics at the beginning of a survey is never a best practice (unless you need the information to guide certain respondents)

#465

If you are going to ask one category - it's almost as quick to ask a full range and get deeper insights

#475

Mutually exclusive and exhaustive response options are critical for accurate data

Privacy/ Trust

#503

Asking for personal information without any reason or FOIPPA statement is

potentially damaging to the municipality's trust with residents.

#537

Beginning a survey by asking the respondent’s name will dissuade participation.

Promotion/ Invitation/ Incentives

#731

If no one knows about your prize draw, it's not an incentive for anyone to complete your survey