Hi everyone! Thanks for joining. Excited to spend an hour with you tonight 🙂

Thank you Lindsay! Look forward to your presentation

Thanks, all! I might need to leave early. In case I do…is there a place where the recording will be posted?

Yes thank you. The recordings will be posted in Canvas.

please turn video on if you can, even intermittently 🙂

The recording will be posted in Canvas and on our website tomorrow.

Is there an attendance form we should complete? Or does the registration for this session suffice?

not required, just nice for the presenter to feel like there are really people here 🙂

The attendance form will be posted here in the chat later in the session

How to convince people to take it?!

What's the best way to increase response rate (and not with incentives like $$$)?

how do I know the questions I am asking are measuring what I need?

What do you do if you want to change a question once posted?

How many questions do you usually try to limit to ensuyre compliance?

How to minimize / not introduce any bias in the questions I create?

What are the best practices/pros & cons for including or not including "neutral" in a Likert scale of answer choices?

Is it ok to ask about gender on surveys? What is politically correct now? How can we not alienate or be insensitive on the topic of gender?

ensuring it's accessible - language, time constraints

survey questions for low literacy groups?

How do we get people to answer honestly?

This may be specific to academia, but do you need to submit an IRB prior surveys?

optimal length of surveys?

Wow, these are awesome questions!!

I'd like to simply have a process for creating surveys. What do I need to be thinking about? How can I be thorough? How can I elicit honest feedback?

cyclops

No

This is a great example of reflexivity. Know thyself 🙂

no

No

Nah- do a lit review?

No

no

No

I don't think so

nope, study existing data?

Definitely!

Absolutely do a survey

sure

Yes

yes

Do you trust your friends

yes

yes

yes

IG pool 🤣

👍🏼

Yes

yes

yes - subjective info

yes

Survey, you can stratify data by age

yes - gives you a range

yes - pre and post survey!

Not happening

nope

Zero

1

0

0%

2%

0%

your mom and no one else

Trapped audience 🙂

Standing inline at disney

That's why I put the smiley 🙂! LOL

Now u r talking

Yup

Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERV

Are there non-$ incentives that have worked for others?

why avoid yes/no or agree/disagree questions

@Magi, you can get very creative with this. Figuring out priorities of your study group can give you great ideas. For example, is there a way their department can be recognized to have the highest response rate?

D

D

don't know

less than 5

how many pairs?

I wish it said how many socks

about 5 dollars

c

One pair?

more than 5

<$5

A

>5 $

I steal them from my dad, not sure

what's the fabric?

B

A

Probably more than 5 dollars

they are nice socks....

Too hard to recall all these instances

too vague and open ended

too broad

Where do you start...

too many possibilities

How much space is there for an answer...

relies on recall, high effort

Its too broad, hard to know where to start

endless reasons

might require a large time investment to answer fully

Social desirability bias

Can be a trauma dump

problems needs defining, tired needs defining

Whose seeing the response

too tired to remember lol

maybe give them the option to rank a list of problems?

Who's seeing the responses raises a really important point about psychological safety with survey design.

relies on memory

Don't feel like thinking too hard

Lots of simple answers that come to mind quickly instead of really reflecting - eg I thought about lunch, and it made me hungry.

Its similar to asking someone "how are you?”. It is more socially acceptable to say "good" than to really say the truth

Disagree

false dichotomy

both are important

You can agree but also not do it.

doesn’t tell you anything about why or underlying construct?

A lot of people might be in the middle?

Am i qualified to answer this?

there are answers in between "agree and disagree"

plus, you sort of know the surveyor wants you to agree

Sometimes it can feel dramatic to disagree!

Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval

If you use a likert scale the data will have more granularity? Like ask them 2 questions and compare flossing and brushing.

too many choices

the muddy middle!

too many options?

1-10 is too wide a scale

Does a likert scale still suffer from the acquiescence effect?

5 doesn’t feel truly neutral

how many people should you pretest with?

Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval

How about "decline to answer" option choice with forced responses?

^this may be a good way to make sure that someone actually chose not to answer and didn’t accidentally skip a question

Thanks

THank you so much!!

Thank You

👏🏼

This is amazing. Thanks so much

Thank you so much!

Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval

Thank you, Lindsay!

Thank you from Children’s National Washington D.C.

Thank you!

Thanks for a great talk!

Lindsay, I learn so much from you every time! Thank you!

thank you!!

thanks Lindsay, really enjoyed your lecture. Liked all the examples.

hank you!

Brilliant lecture. Thank you.

Thank*

Thank you Lindsay I found this very informative and engaging

Thank you, Lindsay!!!

Thank you!!!!!!!!!

Thank you

Thank you! I may have missed this, will the slides be shared?

Thank you! :)

Really great lecture, thank you!

Thank you!

Thanks