Media QA Services

Content Management Services

eText Testing Guidelines
Content Management Services
Document History
Prepared by: / Tara R Cook
Revised: / 02/20/2009 / Flavia Rego
Revised: / 07/27/2009 / Flavia Rego
Revised: / 7/29/2009
6/16/2010 / Barbara Witmer
Revised: / 7/22/2010 / Barbara Witmer, Ana Jankowski
Revised: / 11/09/2010 / Richard Cacoilo

Page 1 of 23

Media QA Services

Content Management Services

Table of Contents

General Information

High Level Objectives

Overview

Bug Tracking

Product Areas and Descriptions

Upper Navigation:

Lower Navigation

Left Navigation

Content Page:

Testing Steps

Title Verification and Access

Left Navigation/Baskets:

Interface Functionality:

Lower Navigation and Content Pages:

Typical Errors:

Screen Shots

Authoring Tool Homepage:

Authoring Menu

Book Meta Data

eBook Theme Information

File Paths

Full Screen:

Upper Navigation:

Lower Navigation:

Feedback Pop-up Layer:

Left Navigation and Content Page:

Hotspot Visual Inspection

Glossary Entry Pop-up Layer:

General Information

QA Services are being requested to test all links, content display, some interface validation, and for browser/operating compatibility.

High Level Objectives

The objectives for testing are to verify that the content of the textbook is displaying properly, the title information is correct and configured properly, the table of contents, glossary, and index entries are linked properly, and all other links, hotspots and treatments are functioning as intended.

The display of the product will be evaluated for any problems or unexpected content.

All error messages, broken images, junk characters, visible code, obvious spelling errors, and any other issue that may impede use or comprehension of the content will be reported.

Overview

  • There are two types of tests available: Full ebook test and Hotspot Verification test. All “General Information” and “Product Areas and Descriptions” information apply to both types of tests unless otherwise indicated. Only the Testing Steps are different. Please refer to the “Testing Steps” section of this document for further details.
  • Testing Environment:
  • All testing will be done through the Authoring Viewer with generic SMS logins.
  • URL:
  • Vendor Login: qavendor / ebookprod

  • Matrix
  • See “configurations.doc” for OS/browser to be used for testing.
  • eText (except MyMathLab)
  • The standard matrix for all eBook+ products (except MyMathLab) will follow a Split Pass method, which consists of evenly splitting the content of the eText title across three testing configurations.
  • All discrepancies between each configuration will be reported.
  • eText (MyMathLab ONLY)
  • The standard matrix for MyMathLab eText titles will follow a hybrid Split Pass & Spot Check method.
  • A spot check will compare feature functionality and/or content display in the Full Pass configuration to other configurations. All discrepancies between the display in the Full Pass configuration and the other operating systems and browsers will be reported.
  • An outline and other documentation will be provided with each testing request. Testing should be done using instructions in this testplan in accordance with the information in the outline.
  • An hours-estimation spreadsheet should be provided with each hours estimation email.
  • All assets will be tested that they appear and function as indicated in the documentation.
  • Full Ebook Test: Source PDF files will be provided with the testing request for reference only. A page by page comparison will not be completed.
  • Source PDF files will not be provided for Hotspot Verification Tests
  • External audio/video/interactive files will not be played all the way through. Files will be tested only that the file loads and starts playing.
  • There will be no internal audio/video/interactive files.

Bug Tracking

  • All bugs are to be logged in Mantis (
  • The Product ISBN-10 followed by “_etext” will be the Project Name (example “0123456789ABC_etext”).
  • QA job number will be the Build Number.
  • The following accounts will be added to all eText projects.
  • Developer: Erik Unhjem (eriku/eriku)
  • Developer: Tyler Suydam (tylers/tylers)
  • Developer: Ann Sullivan (anns/anns)
  • Developer: Jessica Kajkowski (jessicak/jessicak)
  • Developer: Amy Merrow
  • Developer: Vendor (please see outline)

1)If “HOV” is selected: Suresh R (sureshr/sureshr)

2)If “Code Mantra” is selected: Suresh K (sureshk/sureshk)

3)If “HCL” is selected add the following :

  • Sasi Kumar Mahalingam (sasikm / sasikm)
  • Saravanan Somasundaram (saravanans / saravanans)
  • Kamalakannan Lakshmanan (kamalakannanl / kamalakannanl)
  • Admin: QA Project Manager for request

Product Areas and Descriptions

NOTE: The information listed in this section is for reference only. It should be used as a guide for new users to become familiar with the eText product interface. Please refer to the “Testing Steps” section for details on the steps required to test the product.

Upper Navigation:

  • Help: opens in new window
  • Logout: logs out of viewer environment; loads a login screen NOTE: This login screen will not work from the authoring environment viewer.
  • Last Page Button: loads last page accessed (last page accessed, not last page of the book)
  • Previous Button: loads preceding page (numerical order; not last page accessed) except from the default cover page.
  • Next Button: loads next page (numerical order)
  • Page number entry field: enter a page number and hit “enter” key
  • Arrow tool: non functional in testing environment
  • Highlight: non functional in testing environment
  • Notes: non functional in testing environment
  • Zoom (pull down menu):
  • Zoom In/Out: Range: 50%-300%
  • User has option to input custom percentage
  • “Fit Width” and “Fit Page” options are available in Zoom menu as well as on top nav (see below details)
  • Page display will be clearly visible and not distorted regardless of zoom level.
  • Fit to width button: fits page display to width of window
  • Fit to page button: fits page display to width and height of window
  • Single page view button: display one page at a time
  • Double page view: displays two page spread; collapses left navigation
  • Bookmark page: (not functional in testing environment – this is not an error) adds bookmark; page number will appear in “Bookmarks” basket
  • Print page: single page only.
  • Show links: check to show; uncheck to hide.
  • Search: functional in testing environment – The Search pane offers full-text search of individual words, phrases with quotes to look for an exact match, phases without quotes to look for any of the words in the phrase, and a combination of words with a Boolean keyword, such as and or or. The search string is case-insensitive so that typing Cats matches cat and vice versa.

Lower Navigation

  • Legal Notice: external link:
  • Privacy Policy: external link:
  • Permissions: external link:
  • Feedback: pop-up layer displays with feedback input fields; current page will be entered in page # field.

Left Navigation

  • Please refer to the outline for a list of each left navigation item or basket available for each ebook.
  • Some baskets have default behaviors as outlined below; other specific behaviors will be indicated in the outline.

Content Page:

  • Hotspots:
  • Please refer to the outline for a list of hotspots available for each title
  • Not every hotspot may need testing; please refer to outline
  • Highlight color: Instructor default color is green; Student default color is yellow

Testing Steps

Hotspot Verification Test:

A Hotspot Verification test will consist of testing ONLY in the following areas:

-Title Verification and Access

-Hotspot Verification

-Typical Errors (only as it applies to the previous two areas)

-Non-Permissioned Items (only as requested per the outline information)

Full Ebook Test:

A Full Ebook test will consist of all testing areas as indicated below in accordance with the provided outline.

Title Verification and Access

  1. Go to URL provided and login.
  2. On the Authoring Tool Homepage:
  3. Search by Book ID to find the correct project. Verify that the title, author, and edition match the test request.
  4. In the search results, select the correct title based on title and authoring information provided in the testing request.
  5. This will load the Authoring Menu.
  6. Authoring Menu: provides navigation to specific areas to be tested.
  7. Book Meta Data:
  8. Verify Global and Book IDs (please refer to outline for this information)
  9. eBook Theme Information: no testing needed.
  10. File Paths: no testing needed.
  11. On the top navigation select either “Review as Instructor” or “Review as Student” as indicated in testing request.
  12. If a title is a “Common Edition, ” select “Review as Student”
  13. The project will open in a new window.

Left Navigation/Baskets:

Expand Left Navigation Pane to display full TOC title listings

  1. Table of Contents basket: expandable tree;
  2. Compare TOC listing against source PDF TOC: all TOC entries will match exactly.
  3. Click all TOC links: click entries with page icon to load page.
  4. TOC links will hit intended page/section.
  5. Verify the number of eBook pages matches the PDF.
  6. Upon clicking last TOC entry, page forward until last page is reached.
  7. Navigate source PDF as needed to reach last page.
  8. Total number of pages will match.
  9. Glossary basket: expandable tree
  10. Click all Glossary Terms: click letter; click entry; pop up layer displays
  11. Correct term and definition will appear for Glossary Terms.
  12. Index basket:
  13. Click letter; correct page will load for Index Entries.
  14. Spot check Index Entries by clicking first 2 and last 2 entries for each letter.

Search Functionality:

  1. Test Search functionality with random text off the eText page. Test search functionality with 5 known terms, and 5 terms that won’t be found.
  2. Frequency: search functionality should be checked as indicated above every 75-100 pages while testing the Content Pages.

Lower Navigation and Content Pages:

  1. Click all Lower Navigation links.
  2. Lower Navigation links will open as expected.
  3. Click first TOC entry. The first page will load in the main frame. Use the “Next” button to page through entire product.
  4. Each page will load in numerical order
  5. No pages will be missing or blank.
  6. Page display will be clearly visible and not distorted.
  7. Test the first and last lines of all tables and images in the eBook for display.
  8. Tables and images will be clearly visible and not distorted.

Hotspot Verification

  1. Check hotspots as follows:
  2. TOC and Index Hotspots:
  3. Only 10% of TOC and Index hotspots will be tested per below instructions.
  4. Use the mouse to hover over each TOC hotspot to view the roll-over text. (Example: “Go to page 122” will appear).
  5. Verify that the page number in the roll-over text matches the page number in the TOC.
  6. Do NOT click the hotspots themselves
  7. If any TOC or Hotspot errors are found, please include the following information in a new bug:
  8. “Please note that only 10% of TOC and Index hotspots were tested per testplan instructions. Additional errors may be present. Please consult your QA Project Manager and/or the eText team for additional questions.” (Please note this as a “Suggestion.”)
  9. Visual inspection:
  10. Ensure that highlighting of hotspot elements is aligned properly and evenly to cover the entire hotspot link (see examples below).
  11. Compare all asset links/icons to placement in asset grid documentation.
  12. All assets will be correctly placed exactly as indicated in asset grids.
  13. All asset links will load intended files.
  14. For external links or external files, please do NOT verify the URL in the asset grid against a URL in the eText.
  15. The following page elements should be checked in their entirety to ensure that all occurrences are linked as a hotspot (unless otherwise mentioned in the outline):
  16. Internal cross-references (figure and section/chapter references)
  17. External media links (specified by editorial media linking spreadsheet)
  18. Any other items listed in the outline
  19. Glossary Terms Hotspot testing (if applicable):
  20. Clicking on a glossary term hotspot will load the definition in a pop-up window with a link to an audio file.
  21. Test that all terms are available on the correct pages compared to Glossary spreadsheet
  22. If glossary terms contain audio files:
  23. Test 10% of audio files
  24. Test that audio clip loads properly
  25. Test that the correct audio term plays
  26. If more than 30 glossary hotspots, custom hotstpots, or internal reference hotspots have errors, please pause testing and contact the QA team.
  27. NOTE: Please do not pause testing for 30 combined errors. Only if one hotspot type has 30 or more errors.
  28. Example: If there are 30 custom hotspots that are incorrect, please pause testing and notify the QA team.
  29. Example: If there are 10 custom hotspot +10 glossary + 10 internal reference hotspot errors, please continue testing as the errors are not greater than 30 for an individual hotspot type.

Non-Permissioned Items (if applicable)

  1. Test that all items listed in NonPermissioned Items spreadsheet are GREYED out in ebook.
  2. The items in this spreadsheet should not be visible to the user.

Typical Errors:

  • Display errors (broken/distorted/misaligned images or tables, unacceptable discrepancies between browsers, etc)
  • Incomplete or incorrect content (pages or chapters missing, instructor edition annotations appearing, etc)
  • TOC information is incorrect compared to documentation
  • Incorrect page display (wrong order, content has re-flowed, etc)
  • Permissions issues (incorrect images removed or incorrect image is displaying)
  • Assets are found in eBook that are not listed in asset grids
  • Missing assets, glossary terms, index entries, etc
  • Missing hot spots, links, etc
  • Incorrect asset, glossary term, page, etc loads
  • Incorrect audio plays for glossary term
  • Internal reference hotspot directs to incorrect page
  • Incorrect rollover information
  • Page not found errors
  • Coming soon alerts for rich media
  • Incomplete search results
  • Non-functional buttons or features

Screen Shots

Authoring Tool Homepage:

Authoring Menu

Book Meta Data

eBook Theme Information

File Paths

Top navigation select either “Review as Instructor” or “Review as Student”

Full Screen:

Upper Navigation:

Lower Navigation:

Feedback Pop-up Layer:

Left Navigation and Content Page:

  • Baskets in this screen shot: Table of Contents, Glossary, Bioflix, Index, Notes, Bookmarks
  • Content Page Items in this screen shot: Highlight, Note icon, Figure hotspot, cross reference hotspot

Hotspot Visual Inspection

Example: poorly shaped link to “orbital energy” glossary term:

Example: link to “Figure 9.21” is not completely shaped:

Glossary Entry Pop-up Layer:

Page 1 of 23