Questions for Testing New Library Web Design

Web Redesign

Usability Testing Report

February 22, 2008

Charge:

The User Assessment Group (UAG) charged itself to gather user feedback on the top page of the redesign of the Libraries’ web site. The Group is looking to assess the overall design, its functionality, the clarity of terminology and users’ expectations for the web site.

Methodology:

10 / Undergraduates (2010)
0 / Graduate students
3 / Faculty/Staff

Introduction

We explained to each tester that the Library is in process of redesigning its web presence. We want feedback of all types from various students. We want to see how they like the new design, whether it functions well for them, if they can navigate the new site and if they have any suggestions for other information.

We created 13 questions to lead our testers through some of the typical uses the Library’s web site gets. The questions are listed as an Appendix to this report.

Results

As of this date, we tested 13 people, a combination of undergraduate students, staff and faculty. Several things became obvious immediately.

Everyone liked the new site for a variety of reasons
Everyone liked the new Search Box
Not everyone noticed the “Ask A Librarian” or the “Off-Campus Access” buttons
Not everyone understands that to access resources from off-campus, they need to use VPN or the proxy-server.
The MediaCenter in the “Hours” table should be changed to Jones Media Center. Everyone looked for Jones, not just MediaCenter.
Not all students know the difference between Search360, Borrow Direct and DartDoc.
The Stacks Guide needs to be more prominent in the hierarchy
The links to the various libraries needs to be more prominent on the page

Suggested Changes

Generally, named spaces should have their names in the Hours table. For example, the MediaCenter should be the JonesMediaCenter.
Consider making the “Ask A Librarian” and “Off-Campus Access” buttons more noticeable by making the text bigger or brighter for better contrast or relocating the buttons.
Put a “Stacks Guide” link under “About the Libraries.”
Change the term “Libraries@Dartmouth” under “About the Libraries.” The term made some people think it was an email link.
Move the link “Libraries@Dartmouth” above Departments in “About the Libraries.”
Move the Libraries’ links from the bottom of the page to a more prominent position on the page.
Add explanatory text to DartDoc, Borrow Direct, DCAL and RWiT for clarification.
Consider making the items under each of the categories the same number for consistency.
Add link for GreenPrint locations
Move “History of the Library” to the front page under “About the Libraries.”
Combine Departments & Staff links to one line. When you click on Staff, you also get the departments.
It is not clear to everyone that the default search in the Search Box is a keyword search.

Questions for Testing New Library Web Design

This section summarizes the answers we gathered so far for our questions.

1. What do you think of the overall design of the web page?

Everyone liked the new site. Many noticed the improvements in color scheme, clarity, comprehensiveness, easier navigation, similarity to the college’s web site, prominent search box and images of the libraries.

2. What is the first thing you notice about the new page?

The first thing noticed was different for several. Some noticed the picture first, then the banner. Others noticed the Search Box first. One person mentioned the overall layout. Another noticed its functionality and others noticed the new color scheme.

3. If you needed to ask a question, where would you go on this page?

Figuring out where to go to ask a question seems to be a problem. Few of the testers went directly to “Ask A Librarian.” Some went to Staff and others went to Libraries@Dartmouth. We asked several students why they didn’t pick the “Ask A Librarian” button. They said that is not what they would use that for. They had not noticed the button right away.

4. Do the items under each category (i.e. Find It, Resources by Subject, etc.) make sense to you?

The categories made sense to most everyone. There were some unknown or confusing acronyms and terms such as DCAL, DartDoc and Borrow Direct). Those tested wanted some type of explanatory text to make things clearer.

5. Is there something you think should be on the front page that isn’t there now?

Some testers said everything was there. Other students made suggestions such as GreenPrint, Course Reserves, Baker/Berry Stack Guide, Jones Media link, Hours and a history of the Libraries. One person liked “flurries” such as “Book or Databases of the Day.” Another person wanted a map of the libraries.

6. What do you think about the formatting of the search box?

So far, all the testers liked the Search Box. They each liked a different aspect of the Search Box. It was not clear to everyone that the default search is a keyword search.

7. You’re home for Thanksgiving and need to do research. You found an article for which Dartmouth has an online subscription. How do you get it? [If they need clarification--this is a question about access when you’re not on campus]

Some testers went directly to “Off-Campus Access.” However, not all of them were sure how to really use it. Several thought it needed to be highlighted better. Another tester thought the instructions needed to be reworded and VPN located higher on the page.

8. How would you find the hours for the JonesMediaCenter?

Almost every student went to “Hours” under “About Libraries.” However, finding the JonesMediaCenter was a little difficult. They all said the title needs to say “Jones.”

9. Can you go directly to the library’s catalog from this page?

They all found the Library Catalog either under “Find It” or the link in the Search Box.

10. Do you know the difference between Search360, Borrow Direct and DartDoc? [Does ILL mean anything to you? Does it help?]

Not all the testers knew the differences between each service. We explained the differences to them. Some of them suggested explanatory text to help distinguish between them.

11. You’ve identified a book you want from the library catalog. Its call number is BR 1725 .S735 A3 2007, located in Baker/Berry Library. Can you find help on this website for finding the physical location of the book?

Some of the testers used “Locating & Borrowing Materials” to help them answer this question. All of them said the Stacks Guide needed more prominence and perhaps be called “Stacks Map.”

12. Does Dartmouth College Library have the journal English Miscellany?

They all found the title either by using the Search Box or going to the online catalog via a link on the front page.

13. Where do you find a link to Paddock Music Library’s web page?

Some of the testers found the library links at the bottom of the page. Others used Libraries@Dartmouth to find Paddock. For many, “Libraries@Dartmouth” had no meaning. However, some of them thought the Libraries should be more prominent on the page.
Collected Answers to Test Questions for New Library Web Design

1. What do you think of the overall design of the web page?

The student liked it. The new design looks more like the College’s overall design. It looks easy to navigate, compared to the current web site, and you should be able to find things easily. He also liked the color scheme.
I like it. I’m not sure about the color scheme. It looks a million times better than the old site. The green color made it look more “Dartmouthy.” He first thought this was a new web site for the entire College. Once he realized it was a redesign for the Library he remarked that it was now more similar to the College’s. He also liked the “Ask A Librarian” and the “Off-Campus Access” buttons

The looks better than the current page. More in line with the College. With the other/old page, you had to think where to go. Trying to find something was difficult.
I like it better. It is similar to the DartmouthCollege homepage. I like the tabs above the search box.
I like it a lot. It is better than the old one. It is better organized and looks more like the DartmouthCollege web-site.
I like the color scheme. I like the spacing and the columns of topics. It's nice to have news and exhibits on the top page. I like the tabs. It looks clear. You don't have to decipher where to go. It's comfortable.

It's very eye-appealing, invites you. Categories are clear. Like black/bold/green colors, and visual differentiation. It's clean.

I like it.

I like it more than the old web page. The Search Bar is right there. It looks really simple. It is laid out and easy to use. I like the list of topics.

It is very nice. I like the web site looking like it’s a part of College’s site. I’m not a fan of the gray. It does need a grander title than the plain font already there. You can go straight to the library catalog or other searches. He did a search under “Course Reserves.”

She likes it. She said that the grey/green color scheme is a good contrast and results in a clean look. She also likes that the pages are similar to the DartmouthCollege pages. She also likes the photos of the libraries in the banner.

Looks cooler. New age and high tech. Grey sleek look. Really organized. More like Dartmouth homepage.
I like it, I like the banner similar to the Dartmouth home page. I like the search function. It is easy to approach at first glance and clean.

Like the layout; lists look good

Likes the bottom section with the Libraries@Dartmouth b/c she often goes to the Jones Media site to look for DVDs

2. What is the first thing you notice about the new page?

The picture is right there and big. The title of the site.
He said the search box and its indexes. He scrolled down to see other things on the page.
The picture is the first thing I noticed. Then I noticed the search box.
"Ask a Librarian" link.

"? Ask a Librarian" link

I would look to contact a person, for phone numbers. Search "About the Library" and then "Staff". When I am really lost I look for a phone number. Perhaps I could find contact information under "Resources"? I like that the subject specialists have an area. [Finally he notices "Ask a Librarian"} Oh, I didn't notice "Ask a Librarian right away, and I'm not sure what that means. I might have noticed it sooner had it been on the left of the page. I see things left-to-right. I tend to take the long route when it comes to technology.

[Looked at 6 categories] I'd go to "Reference & Research Services" under "Services". [Missed "Ask a Librarian"] The dark grey is difficult to read text, not seen as prominently as the text below in the white area.

The question box at the top

The “Ask A Librarian” button. As a follow-up, we asked is it easy to see there. She said yes. It doesn’t pop up at you, but you see it when you are looking for something.

I prefer to come into the Library and have personal interaction.
Ask a Librarian or she would try Help Yourself.

"Ask a librarian"- easy to find with the big question mark. Stands out well (white icons on black background).
Ask ALibrarian

Does it make sense what is presented? Yes. At first I was expecting to see an FAQ’s page, but this Ask ALibrarian page works.

The banner reminds her of the Dartmouth home page

Nice search bos

Likes the colors

3. If you needed to ask a question, where would you go on this page?

The student went to the following links in this order

“Staff Link.”

“Get Research Help”

Email link at the bottom of the page

Ask A Librarian button

He mentioned that he liked FAQ’s. He skipped over the “Ask A Librarian” button. He didn’t see where he could go to find answers. He scrolled down the page, but didn’t seem to find what he thought would help him.

His first instinct is not to ask a librarian. His first instinct is to go to Staff, then Libraries@Dartmouth, which looks like an email (it’s not what he thought it was) and then Services. He missed the “Ask A Librarian” button. That seems to blend in with the background.

"Ask a Librarian" link.

"? Ask a Librarian" link

The question box at the top

The “Ask A Librarian” button. As a follow-up, we asked is it easy to see there. She said yes. It doesn’t pop up at you, but you see it when you are looking for something.

I prefer to come into the Library and have personal interaction.
Ask a Librarian or she would try Help Yourself.

"Ask a librarian"- easy to find with the big question mark. Stands out well (white icons on black background).
Ask ALibrarian

Immediately went to Ask a Librarian; the resulting page was what she expected

4. Do the items under each category (i.e. Find It, Resources by Subject, etc.) make sense to you?

Yes, the categories are self-explanatory. There are a couple of acronyms or initials such as DCAL that you may not know. You may also not know the difference between DartDoc and Borrow Direct.

We clarified the question by saying “Do the headings make sense for what’s under them?” The student said yes. He thought the categories looked good. He was tempted to look at the more. He said you could click on “more…” if you didn’t see what you wanted on the list.

They make a lot of sense. Libraries@Dartmouth is confusing. You need links to individual libraries on each page. He then found the links at the bottom of the page. He felt these were more important than the news. Maybe put the links on the side.

Under the "Help Yourself," RWIT is sort-of a resource or service.

The items under "Help Yourself" are random.

The groupings and the titles make sense. I particularly like the subject breakdown. I can find subject-specific resources.

Yes, absolutely. Everything under "Find It" is critical to me (the things I use)

Yes

Yes. I like that they are on the top. What doesn’t make sense? DCAL? What is that? Workshops? Are those for students or other people?

Yes. I do not use the site for searching by subject. I usually use Search360 or the library catalog.
Yes, the categories are self-explanatory.

I recognize the top 3 categories better, because I don't use the bottom three as much. I notice links to Borrow Direct in two places, and that's a good thing.
Yeah. She looked at Media Services (and said--oh this is Jones) and said it works but she might expect something more detailed

Looked them over—yes they looked good

5. Is there something you think should be on the front page that isn’t there now?

The page seems to cover what’s on the current page. He couldn’t think of anything else.
Thinking about how he approaches using the library, he didn’t think so. Actually, he asked how you would search for something in JonesMediaCenter. We showed him the audio-visual search. He also asked what was searched for the Library site. We told him everything in the web site. There is also less navigating than compared to the old site.

Page about the History of the Library. He found a speech from 1957 on Rauner’s site. Make it more like the Off-Campus Access.

"Course Reserves”; "JonesMediaCenter” in the "Hours" drop-down tab.

A link to GreenPrint locations on campus. A link to a map of the Baker Berry stacks.

This is a flurry- how about "books or databases of the day"? I like to know about new resources. How about "Fact of the day". I like the news feature. I like that there is access to libraries other than Baker-Berry.

Move "Ask a Librarian" down into the blank white space where it will be noticed

Not that Ihave thought of.

I like the “Find It,” DartDoc and Borrow Direct.