Logo

CTSS: Survey Methods - Shared screen with speaker view
Lindsay Oishi
16:04
Hi everyone! Thanks for joining. Excited to spend an hour with you tonight 🙂
Alaa Youssef (She/her)
17:28
Thank you Lindsay! Look forward to your presentation
stematt@stanford.edu
18:13
Thanks, all! I might need to leave early. In case I do…is there a place where the recording will be posted?
Adam Hain
18:49
Yes thank you. The recordings will be posted in Canvas.
Sarah Williams
19:04
please turn video on if you can, even intermittently 🙂
Claire Medina
19:14
The recording will be posted in Canvas and on our website tomorrow.
Danielle Scarano
19:17
Is there an attendance form we should complete? Or does the registration for this session suffice?
Sarah Williams
19:19
not required, just nice for the presenter to feel like there are really people here 🙂
Claire Medina
19:57
The attendance form will be posted here in the chat later in the session
Magi Gabra
21:30
How to convince people to take it?!
Gloriana Trujillo
21:44
What's the best way to increase response rate (and not with incentives like $$$)?
Alaa Youssef (She/her)
21:49
how do I know the questions I am asking are measuring what I need?
Hayley Gans
21:49
What do you do if you want to change a question once posted?
michael carver
21:49
How many questions do you usually try to limit to ensuyre compliance?
Beth West
21:50
How to minimize / not introduce any bias in the questions I create?
Amy Bugwadia
21:52
What are the best practices/pros & cons for including or not including "neutral" in a Likert scale of answer choices?
Becky Wong
21:54
Is it ok to ask about gender on surveys? What is politically correct now? How can we not alienate or be insensitive on the topic of gender?
Tia Moscarello, Genetic Counselor (she/her/hers)
21:58
ensuring it's accessible - language, time constraints
kkan
22:03
survey questions for low literacy groups?
Jonathan Barnett
22:06
How do we get people to answer honestly?
Rob Gallo
22:16
This may be specific to academia, but do you need to submit an IRB prior surveys?
Ralph Tayyar (he/him)
22:31
optimal length of surveys?
Sarah Williams
22:33
Wow, these are awesome questions!!
Alex Cours
22:35
I'd like to simply have a process for creating surveys. What do I need to be thinking about? How can I be thorough? How can I elicit honest feedback?
Andrew Liman
27:33
cyclops
Juno Obedin-Maliver (she/her)
28:13
No
Sarah Williams
28:14
This is a great example of reflexivity. Know thyself 🙂
Sarah Lee
28:15
no
Magi Gabra
28:15
No
Beth West
28:15
Nah- do a lit review?
Ashraf Harahsheh
28:18
No
Mary Smith
28:43
no
Magi Gabra
28:43
No
Alex Cours
28:45
I don't think so
Beth West
28:52
nope, study existing data?
Beth West
29:07
Definitely!
Magi Gabra
29:10
Absolutely do a survey
Mary Smith
29:10
sure
Desireé Conrad
29:12
Yes
Fariba Yegan
29:14
yes
Ashraf Harahsheh
29:15
Do you trust your friends
Cory Sejo
29:22
yes
Erika Gray
29:29
yes
Nancy Cuan
29:34
yes
Ralph Tayyar (he/him)
29:37
IG pool 🤣
Beth West
29:42
👍🏼
Desireé Conrad
30:14
Yes
Nancy Cuan
30:16
yes
Alex Zimmet
30:18
yes - subjective info
Erika Gray
30:20
yes
Magi Gabra
30:22
Survey, you can stratify data by age
Stephanie Squires
30:24
yes - gives you a range
Stephanie Squires
30:46
yes - pre and post survey!
Ashraf Harahsheh
34:53
Not happening
Erika Gray
34:59
nope
Alex Cours
35:01
Zero
Beth West
35:05
1
Jully Munoz Padam
35:05
0
Mary Smith
35:05
0%
Nancy Cuan
35:08
2%
Becky Blankenburg (she/her)
35:08
0%
Cory Sejo
35:08
your mom and no one else
Sarah Williams
37:12
Trapped audience 🙂
Ashraf Harahsheh
37:19
Standing inline at disney
Sarah Williams
37:37
That's why I put the smiley 🙂! LOL
Ashraf Harahsheh
40:05
Now u r talking
Ashraf Harahsheh
40:19
Yup
Claire Medina
41:17
Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERV
Magi Gabra
41:25
Are there non-$ incentives that have worked for others?
Erika Gray
44:35
why avoid yes/no or agree/disagree questions
Sarah Williams
44:41
@Magi, you can get very creative with this. Figuring out priorities of your study group can give you great ideas. For example, is there a way their department can be recognized to have the highest response rate?
Ashraf Harahsheh
45:29
D
Alaa Youssef (She/her)
45:32
D
Ralph Tayyar (he/him)
45:33
don't know
Erika Gray
45:34
less than 5
Nancy Cuan
45:34
how many pairs?
Alex Cours
45:36
I wish it said how many socks
Adam Hain
45:38
about 5 dollars
Jully Munoz Padam
45:38
c
Minnie Dasgupta
45:39
One pair?
Cory Sejo
45:41
more than 5
Desireé Conrad
45:41
<$5
Magi Gabra
45:42
A
Amanda Gramajo
45:43
>5 $
Andrew Liman
45:43
I steal them from my dad, not sure
Beth West
45:44
what's the fabric?
Becky Blankenburg (she/her)
45:46
B
Marissa Huang
45:48
A
Alex Cours
45:50
Probably more than 5 dollars
Leo Aliaga
46:05
they are nice socks....
Evan Lewis
48:08
Too hard to recall all these instances
Sarah Lee
48:10
too vague and open ended
Jean Lee
48:10
too broad
Andrew Liman
48:10
Where do you start...
Alex Zimmet
48:11
too many possibilities
Minnie Dasgupta
48:14
How much space is there for an answer...
Cory Sejo
48:14
relies on recall, high effort
Magi Gabra
48:15
Its too broad, hard to know where to start
Alaa Youssef (She/her)
48:16
endless reasons
Beth West
48:18
might require a large time investment to answer fully
Becky Blankenburg (she/her)
48:20
Social desirability bias
Marissa Huang
48:23
Can be a trauma dump
Leo Aliaga
48:24
problems needs defining, tired needs defining
Ashraf Harahsheh
48:26
Whose seeing the response
Alex Zimmet
48:32
too tired to remember lol
Matt Dean
48:33
maybe give them the option to rank a list of problems?
Sarah Williams
49:05
Who's seeing the responses raises a really important point about psychological safety with survey design.
Alex Zimmet
51:02
relies on memory
Adam Hain
51:05
Don't feel like thinking too hard
Minnie Dasgupta
51:10
Lots of simple answers that come to mind quickly instead of really reflecting - eg I thought about lunch, and it made me hungry.
Magi Gabra
51:11
Its similar to asking someone "how are you?”. It is more socially acceptable to say "good" than to really say the truth
Rob Gallo
53:15
Disagree
Tia Moscarello, Genetic Counselor (she/her/hers)
53:20
false dichotomy
Jully Munoz Padam
53:24
both are important
Desireé Conrad
53:27
You can agree but also not do it.
Leo Aliaga
53:32
doesn’t tell you anything about why or underlying construct?
Anamika
53:34
A lot of people might be in the middle?
Minnie Dasgupta
53:34
Am i qualified to answer this?
Mary Smith
53:37
there are answers in between "agree and disagree"
Alex Zimmet
53:56
plus, you sort of know the surveyor wants you to agree
Minnie Dasgupta
54:05
Sometimes it can feel dramatic to disagree!
Claire Medina
54:26
Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval
Adam Hain
55:30
If you use a likert scale the data will have more granularity? Like ask them 2 questions and compare flossing and brushing.
Tia Moscarello, Genetic Counselor (she/her/hers)
56:18
too many choices
Beth West
56:20
the muddy middle!
Adam Hain
56:22
too many options?
Minnie Dasgupta
56:26
1-10 is too wide a scale
Evan Lewis
56:47
Does a likert scale still suffer from the acquiescence effect?
Chris Chow-Parmer (he/him)
57:08
5 doesn’t feel truly neutral
Stephanie Squires
01:01:52
how many people should you pretest with?
Claire Medina
01:03:55
Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval
Juno Obedin-Maliver (she/her)
01:05:39
How about "decline to answer" option choice with forced responses?
Ananya Anand
01:06:34
^this may be a good way to make sure that someone actually chose not to answer and didn’t accidentally skip a question
Ashraf Harahsheh
01:10:43
Thanks
Alex Cours
01:10:55
THank you so much!!
Jully Munoz Padam
01:10:56
Thank You
Beth West
01:10:57
👏🏼
Alaa Youssef (She/her)
01:10:57
This is amazing. Thanks so much
Magi Gabra
01:10:59
Thank you so much!
Claire Medina
01:11:00
Attendance Form (Required for Honors Scholars Program)https://bit.ly/AY23CTSSAttendanceAY23 CTSS Honors Scholars Applicationhttps://bit.ly/AY23CTSSApplicationFor event announcements and information join our ListServ:https://bit.ly/TMALISTSERVEvaluation Formhttps://bit.ly/AY23CTSSEval
Aubrey Florom-Smith
01:11:04
Thank you, Lindsay!
Ashraf Harahsheh
01:14:23
Thank you from Children’s National Washington D.C.
Fariba Yegan
01:15:14
Thank you!
Minnie Dasgupta
01:15:52
Thanks for a great talk!
Becky Blankenburg (she/her)
01:16:05
Lindsay, I learn so much from you every time! Thank you!
Leo Aliaga
01:16:06
thank you!!
Hayley Gans
01:16:10
thanks Lindsay, really enjoyed your lecture. Liked all the examples.
Hanan Kashkoul
01:16:18
hank you!
Sarah Williams
01:16:19
Brilliant lecture. Thank you.
Hanan Kashkoul
01:16:22
Thank*
Evan Lewis
01:16:25
Thank you Lindsay I found this very informative and engaging
Alaa Youssef (She/her)
01:16:26
Thank you, Lindsay!!!
Andrew Liman
01:16:27
Thank you!!!!!!!!!
Erika Gray
01:16:27
Thank you
Danielle Scarano
01:16:29
Thank you! I may have missed this, will the slides be shared?
Amy Bugwadia
01:16:32
Thank you! :)
Ananya Anand
01:16:35
Really great lecture, thank you!
Beth West
01:16:37
Thank you!
Desireé Conrad
01:16:40
Thanks