User Testing Summary
Participant Information Summary Table
Participant 1 | Participant 2 | Participant 3 | Participant 4 | |
---|---|---|---|---|
Gender | Female | Female | Female | Female |
Age | 76 | 66 | 61 | 64 |
Do you work in tech or are a tech expert of some type? | No | No | No | No |
If you do work in tech/are a tech expert, in what subject or role? | N/A | N/A | N/A | N/A |
Do you currently attend a church and/or read the Bible? (This can be any church that uses the Bible.) | Yes | Yes | Yes | Yes |
Are you unaffiliated with a church, but interested in Christian resources via web and/or mobile? | No | No | No | No |
Do you sell goods that promote fair-trade, sustainability? | No | No | No | No |
Are you sometimes in need of/willing to offer spiritual guidance/a helping hand and willing to receive/offer this virtually? | Yes | Yes | Yes | Yes |
Do you have website/app admin experience? | No | No | No | No |
What would be the most convenient time for you take part in a 30 minute (approximately) user testing session? | Afternoon, Evening | Afternoon | Anytime | Afternoon |
Discovery Questions
Participant 1 | Participant 2 | Participant 3 | Participant 4 | |
---|---|---|---|---|
Some people have very negative feelings about integrating new technology and religion. How do you feel about it? | Says people have negative thoughts about anything new, but tech can be used effectively in combination with religion; But does not think people should worship alone; says people come to church for socializing/fellowship | Says tech can be used effectively as a tool for religion, but people who do not show up to worship are missing out on an essential part of the church experience that can't be replicated online (human emotion, socializing, sense of community, charitability toward neighbors); believes livestreaming, rebroadcasting are cause for worry except in special situations, though larger churches often do it; says churches are still being planted and drawing larger numbers of people, for instance in Africa, and church/live worship is an important rallying point; comments though that her ideas for community worship may not be survivable, adapatible due to people not showing up and operating expenses; comments that the brains of youth are being re-wired, tech often vital way to reach them | Thinks can be overused, for instance, says worship via tech cannot take place of feeling the spirit in person; does not think people should watch church on their phone | Says as tech advances, it allows us to do more things; if it can benefit worship, then it should be used; the church should change with the times; if that's the way that people communicate, that is also how they will become aware of what you are doing |
Under what circumstance do you use the internet as part of your worship habits? | Has mobile phone, not smartphone; has tablet, but does not use; does not like to be in front of computer; uses tech for a special reason, but not as a habit (ex. playing DVD in Sunday School) | Likes the use of email, use of presentation tech during worship to help people read words, sing hymns | Receives scripture devotions daily by email and weekly UMC and non-UMC religious newsletters by email | Does not use tech much with religion; does look at PP UMC Facebook page; sometimes sees friends/family post about religion; would use tech + religion more if there were a community/network of people |
Lightning Demos
Lightning Demo Questions
Participant 1 | Participant 2 | Participant 3 | Participant 4 | |
---|---|---|---|---|
Do you use the UMC website? | When has specific reason | When has specific reason, otherwise would not use; says hard to navigate/labrinth | When has specific reason, for example, to find list for UMC health kits | When has a specific reason for example, to find ways to enhance worship, small-membership churches, outreach/growing church resources |
Have you ever used any of the other lightning demo products (Bible App, Snapchat, Crowdfunding)? | Had not heard of any of them | Had heard of Kickstarter, but not the others | Had heard of Snapchat, LifeChurch, crowdfunding, but not used | Had heard of LifeChurch, but not used or seen any LifeChurch social media posts from others; had not heard of other products |
What types of people do you think these products seem designed for? | People who enjoy something new, experimentation; people comfortable with tech | No answer given | Wide variety, such as retirees | Anyone, just need to have an interest |
Debrief Questions
Participant 1 | Participant 2 | Participant 3 | Participant 4 | |
---|---|---|---|---|
What do you think of this? Under what circumstance would you use this? Why? | Might use, but would depend on specific situation, would need to know the benefit; for example might use marketplace/crowdfunding if believes in the cause (UMC/PP UMC program) | Says she would use/wants to use | "In love with it," would use | Might use, would want to try it and see what it's like |
Which parts of it do you like? | General: means of communication, versatility, potential to create improvement and positivity | Marketplace (when sitting someplace for five minutes, would log on and take a look); Prayer Warriors (likes that it's real time, no need to make formal request), Bible study (especially for people who are remote/homebound or no time to be face-to-face) | Prayer Warriors, Marketplace (sitting around, would want to use for 5 minutes), church geo-location, daily scripture messages, Bible study | Scripture, what the merchant's sell, opportunity to give money to projects |
Is there anything you dislike about this?/If you had 3 wishes to make this better, what would they be? | No answer given | No answer given | Would not use social media part | No answer given |
Who do you think would use something like this? Who wouldn’t? | Leaders networking, disaster relief (to find out what kinds of things the people in the affected area need), people finding one another for special projects | No answer given | Disaster relief, Bible Study, General Conference report updates | People in need of guidance/prayer due to a special situation put in contact with those who can help/lift them up |
How would you describe something like this to someone who hasn’t used it before? What advice would you give to someone trying it? | General description | "Church at your fingertips" | General description | General description |
What do you think would happen if... ? What questions does it raise? What are the pros/cons? | Con: reluctance to try it, not for everybody (mentioned older church members who do not use internet at all); otherwise, no negative | Can't think of a negative, people who don't want to use it can ignore; thinks might draw people in (example was brought up of people who meet on Twitter getting to know one another then wanting to meet in real life); thinks could be a tech segue for churches, first intro to tech for churches was websites/Facebook, this could be next step | People who don't want to use it just don't have to; people might want/need instructions; does not think would have negative effect on attendance | Con: some church people do not use computers; But says could be a way to reach people who have never had a conversation with a church before; could be a simple way for people to access and get to know the Bible, including those who don't own one; believes could raise awareness of UMC, have a positive effect on attendance |