Human Subjects Protocol For
“Usability Assessment of ReadingTree.Org, an Online Book Recommender Service for Kids”

Investigators

Amity Zeh

Kirsten Swearingen

School of Information Management & Systems

South Hall

Faculty Sponsor

Professor Ray Larson

School of Information Management & Systems

South Hall

Purpose

The objective of this project is to develop an online literary community for elementary-aged kids, focused on a book recommendation service based not only on books previously read and enjoyed, but also on non-literary activities such as sports, games and school subjects. While book recommender systems (such as that used at Amazon.com) exist for adults, and some literature-based communities (such as worldreading.org) exist for children, no service combines the two. A portion of this project requires the observation of kids interacting with the system -- what works, what doesn’t -- in order to improve the usability and value to the target audience. A prototype of the system is available at fusion.sims.berkeley.edu/Reading Tree.

Procedure

Research subjects will be recruited through initial contact with teachers at local elementary schools. The consent form (see attached) will fully describe the project for both children and parents to understand and sign. The study will consist of several interface testing sessions between two researchers (one observing, one interacting) and one child. The interacting researcher will ask the child to perform several tasks with the interface (sample tasks may include sign up, find a book, get a book recommendation and so on -- see attached questionnaire and task sheet) and the observing researcher will note any areas where the interface is confusing, misleading or where the service fails to provide the desired information. The researchers will also attempt to assess the “goodness” of the books recommended to the child -- i.e. are they interesting, have they already read and enjoyed them, etc. This testing will take place inside the school, using either a classroom or media lab computer, and will most likely take place during a free period for the child, such as recess, when the test will be less disruptive and will not detract from classroom time. These sessions will take no longer than 30 minutes and will be recorded only through notes made by the observing researcher. No other personally identifying information beyond the permission slip will be collected.

We intend to provide kids who participate with some kind of small remuneration for their participation, along the lines of a ReadingTree.org T-shirt or an inexpensive paperback book, which will not be contingent upon actually completing any specific task during the study.

Subject selection/screening

Since the system is intended for use by kids, it’s necessary that we assess its usability with minors. We intend to study 24-30 elementary-aged children, from kindergarten through fifth grade, roughly divided by gender. Since this will be a moderate disruption for classroom time, we will solicit children only from two different grades: one younger (k-2) and one older (3-5) grade. Each class will receive a very brief explanation from the researchers on the purpose of the project and what participation in the project entails, along with the preliminary consent form. We will request children who enjoy reading as a recreational activity, but will accept up to 15 volunteers in each class based solely upon receipt of the consent form (we will not ask them to “prove” they enjoy reading). We will place a clearly labeled box in the classroom for the kids to drop their signed forms (forms shall not be returned to the teacher).

Benefits and risks

Benefits: Children who participate in the study may benefit from use of the ReadingTree system by gathering accurate and personal book recommendations. The system is also designed to be engaging and fun, so children will hopefully enjoy the time spent working with the system.

Risks: There are no foreseeable risks to children who participate in the research study. Information gathered through the study will be kept confidential, as described in the following section.

Participants may experience embarrassment if they have difficulty using the system or have not read enough books to be able to complete Task C (see draft Task List ). Researchers will inform children in the beginning and reiterate that any problems they are experiencing are the fault of the system and that if they are not having fun, they can stop a task at any time.

Excessive computer use can lead to certain disorders such as RSD or carpal-tunnel syndrome, but we do not anticipate the study requiring or inspiring such excessive use.

Confidentiality

The only personally-identifiable information gathered will be a permission/consent form, which will remain confidential, stored in a locked file at the home office of one of the researchers. Any data compilation will refer to children’s individual results by a code letter, not traceable back to a specific participant.

Informed consent

The consent to participate will take place prior to any individual contact with participants. The information/consent forms will be distributed to the potential participants when the researchers initially introduce themselves and the project to the classes.

Signatures

Researchers:

Amity Zeh, 510-271-0789, ______

Kirsten Swearingen, 510-658-2920, ______

Faculty Advisor

Prof. Ray Larson, 510-642-6046, ______

PRELIMINARY CONSENT FORM [on UCB Letterhead]

Amity Zeh -- , 510-271-7899

Kirsten Swearingen -- , 510-658-2920

We are conducting a research study to design ReadingTree.org, a new website for kids who love to read. At ReadingTree you will be able to meet other kids, chat about books, and even get personalized recommendations for books that ReadingTree thinks you’ll enjoy. But since it’s for kids, we want to hear from kids about how we can make it even better -- more fun and easier to use.

ReadingTree is being developed and researched by us -- Kirsten Swearingen and Amity Zeh. We’re graduate students in the School of Information Management & Systems at the University of California at Berkeley. We need to conduct this research project to earn our Master’s Degrees. We’d like kids like you who love to read, even when it’s not for school, to help us improve Reading Tree.

If you decide to participate in our study, here’s what will happen.

  1. Bring back this permission slip with your own signature and your parent’s or guardian’s signature on it, and drop it in the box in your classroom marked “ReadingTree Project.”
  2. We’ll arrange a time with you and [teacher’s name] where you can use ReadingTree. This will probably be during some recess time.
  3. One of us will ask you some questions about your computer use and your reading activities. Then we’ll ask you to do some activities on ReadingTree. The other one of us will be taking notes on what you think about it, and how easy it is for you to use. We hope that this will be fun for you.
  4. We may ask you to do the same activities on another version of ReadingTree, and tell us which version you liked better, and why.
  5. When you’ve finished the activities, we’ll ask a few questions about what you liked and didn’t like
  6. We will give you a small Reading Tree souvenir to thank you for your help.
  7. We will redesign ReadingTree based in part on what you tell us.

The only risks of participating in the study is that you might feel embarrassed if we told anyone what you thought about ReadingTree, or if you find ReadingTree hard to use. We will keep anything you say to us private and confidential. We won’t identify you by name in any of our reporting. We also won’t report anything you say or do during the study to your parents or teacher.

You can benefit from participating in our study by helping to improve something that you and other kids may use later, and have fun with!

Taking part in this research study in completely up to you. You don’t have to take part. If you do decide to take part and you want to stop partway through for any reason, you may also do so. Whether or not you participate will have no bearing on your standing or grades at your class or school.

If you have any questions about ReadingTree, or this research study, you can call us or email us at the numbers above. If you and your parent or guardian agree that you would like to participate in this study, please drop a signed copy of this form in the Reading Tree box in your classroom by [appropriate date]. We will arrange times to meet with the participating kids between [date] and [date].

I have read this consent for and agree to take part in the research.

Student’s signature: ______Date ______

I have read this consent for and agree to have my child take part in the research.

Parent’s signature: ______Date ______

PRE-TASKQUESTIONNAIRE

Note: Some of these tasks and wording may change as the research progresses. Final copies will be provided to the CPHS when available. This will be administered verbally to children before the web activities begin.

First name: ______(attach consent form to this)

Demographic questions

-Grade

  • 1st
  • 2nd
  • 3rd
  • 4th
  • 5th
  • 6th

-Gender

  • Male
  • Female

Computer Use/Chat

  1. Do you use a computer?

Yes.

No.

If the answer to Question 1 is no, please go straight to part 2.

  1. Where do you use a computer? (check as many as you like)

home

school

library

community center

friend’s house

other place: ______

  1. What do you use the computer for?

games

chatting with friends or emailing

research

homework

educational programs

other uses: ______

  1. How much time do you spend on the Internet when you use the computer?

Never more than a few minutes

It depends—sometimes a little time, sometimes a lot

I’m always on the Internet!

  1. How do you stay in touch with friends online?

bulletin boards

chat

e-mail

games

I don’t talk to my friends on the computer

Other ______

Reading Habits

  1. Do you like to read books for fun?

No, they’re boring

Sometimes, but I’d rather do something else

Sure, I like books.

I love to read!

  1. How do you find books that you want to read? (check as many as you want)?

bookstore staff

browsing in a library or bookstore

friends

librarians

parents

reading groups

teachers

displays in stores or libraries

magazines

TV shows

websites

other ______

  1. Would you like a website that suggested books for you that you might enjoy?

No, I wouldn’t use it.

Maybe.

Yes, that sounds great!

  1. Would you be interested in reviewing and recommending books for other kids?

No.

Maybe

Definitely.

Task List

The following tasks should require no more than 30 minutes to complete.

Task A.

You are a first-time visitor to ReadingTree. Register as a new user and get a list of recommendations.

  1. Choose a nickname and password
  2. Enter your grade, gender, and zip code
  3. Answer 2 questions about what you like to do.
  4. Generate a list of recommendations and print it.

Task B.

You are already a member of ReadingTree looking for a book to read for fun.

  1. Sign in
  2. Search for a book that you would like to read.
  3. Read what other kids have to say about the book.
  4. Add the book to your bookshelf.

Task C.

You have read a book recommended to you by ReadingTree and want to say what you thought of it.

  1. Sign in
  2. Retrieve your list of recommendations
  3. Rate the book you read
  4. Write a review of the book

Post-Test Questions

  1. Have you read any of the books that were recommended to you?
  2. What did you like most about Reading Tree?
  3. What did you like the least?
  4. Was there anything that you found difficult or confusing? Please tell us about it.
  5. Would you use Reading Tree again?
  6. Would you recommend it to a friend?