NTEP Committee 2013 Final Report

NTEP Committee 2013 Final Report

Appendix E – NTETC 2012 Software Sector Meeting Summary

Appendix E

National Type Evaluation Technical Committee (NTETC)
Software Sector Meeting Summary

March 20-21, 2012

Columbus, Ohio

Introduction

The charge of the NTETC Software Sector is important in providing appropriate type evaluation criteria for software-based weighing or measuring device based on specifications, tolerances and technical requirements of NIST Handbook 44, Specifications, Tolerances, and Other Technical Requirements for Weighing and Measuring Devices, Section 1.10. General Code, Section 2 for weighing devices, Section 3 for liquid and vapor measuring devices, and Section 5 for taximeters, grain analyzers, and multiple dimension measuring devices. The Sector’s recommendations are presented to the National Type Evaluation Program (NTEP) Committee each January for approval and inclusion in NCWMPublication 14, Technical Policy, Checklists, and Test Procedures, for national type evaluation.

The Sector is also called upon occasionally for technical expertise in addressing difficult NIST Handbook 44 issues on the agenda of the National Conference on Weights and Measures (NCWM) Specifications and Tolerances (S&T) Committee. Sector membership includes industry, NTEP laboratory representatives, technical advisors and the NTEP Administrator. Meetings are held annually, or as needed and are open to all NCWM members and other registered parties.

Suggested revisions are shown in bold face print by striking out information to be deleted and underlining information to be added. Requirements that are proposed to be nonretroactive are printed in bold faced italics.

Note: It is the policy of the National Institute of Standards and Technology (NIST) to use metric units of measurement in all of its publications; however, recommendations received by NCWM technical committees and regional weights and measures associations have been printed in this publication as submitted. Therefore, the report may contain references in inch-pound units.

Table A
Table of Contents
Title of Content / NTEP Appendix E – Page

Introduction

Welcome/Introductions

Status Reports

1.2012 NCWM Interim Meeting Report

2.2012 International Activity Report

Carry-over Items

3.Software Identification/Markings

4.Identification of Certified Software

5.Software Protection/Security

6.Software Maintenance and Reconfiguration

7.NTEP Application for Software and Software-based Devices

8.Training of Field Inspectors

New Items

9.Next Meeting

10.NCWM Publication 14 Proposed Changes

Attendance

Table B
Glossary of Acronyms and Terms
Acronym / Term / Acronym / Term
CC / Certificate of Conformance / OIML / International Organization of Legal Metrology
CRC / Cyclical Redundancy Check / OWM / Office of Weights and Measures
EPO / Examination Procedure Outline / PDC / Professional Development Committee
NCWM / National Conference on Weights and Measures / PTB / Physikalisch-TechnischeBundesanstalt
NIST / National Institute of Standards and Technology / S&T / Specifications and Tolerances Committee
NTEP / National Type Evaluation Program / SMA / Scale Manufactures Association
NTETC / National Type Evaluation Technical Committee / WELMEC / European Cooperation in Legal Metrology
Details of All Items
(In order by Reference Key)

Welcome/Introductions

Mr. Pettinato, Chair, would like to welcome new individuals that have joined the NTETC Software Sector since the last meeting. Please welcome:

• Ms. Mary Abens, Emerson Process Management
• Mr. Thomas Fink, ITW Food Equipment/Hobart
• Mr. Adam Oldham, Gilbarco, Inc.

Status Reports

1. 2012 NCWM Interim Meeting Report

Source:

NCWM S&T Committee Agenda

Background/Discussion:

There was one item on the NCWM S&T Committee Agenda for the 2012 NCWM Interim Meeting related to work done by the NTETC Software Sector. Publication 15 (2012), S&T Item 360-2 relates to the 2012 NTETC Software Sector Agenda Item 1: Marking Requirements.

Conclusion:

Attendees indicated that the 2012 Interim Meeting was well attended. Most issues were not S&T issues – more laws and packaging type issues. The one issue that wason the S&T Committee Agenda has been changed from Informational to Developing. Mr. Truex, NTEP Administrator, was not at the Open Hearings when that item was discussed, but Mr. Lewis, Rice Lake Weighing Systems, Inc. was. He said it didn’t go anywhere.

1. 2012 International Activity Report

Source:

NTETC Software Sector

Background/Discussion:

Dr. Thompson, National Institute of Standards and Technology (NIST), Office of Weights and Measures (OWM), will provide a synopsis of international activity that relates to the work of the Sector. Mr. Pettinato, Chair, will summarize the discussion that took place at the European Cooperation in Legal Metrology (WELMEC) WG7 meeting in December 2011.

Conclusion:

Highlights of interest to the NTETC Software Sector:

• Workshop on Operating Systems in Legal Metrology hosted by Physikalisch-TechnischeBundesanstalt (PTB)December 2011 coincident with WELMEC WG7 meeting.
• New D-11 draft circulated for comment early 2012.

Mr. Pettinato, Chair attended the WELMEC WG7 meeting in Berlin in December. He was struck by how similar the discussion was to our NCWM meetings. We are trailing in requirements for software security. They are trying to enforce authentication, identification, self-checking, etc. They’re dealing with Linux and other open-source issues. Some approvals have taken 18months. They seem to be starting in a new direction, possibly rewriting D7.2 to reference software documents for IT standards for security. This would result in them only focusing on metrological issues in the software, leaving the other standards to cover the remaining issues in security. Currently PTB references a National Security Agency document on securing Red Hat Linux.

Mr. Beattie, Measurement Canada, asked about the feeling regarding Common Criteria. Mr. Pettinato reported that there were a couple presentations on this subject. There are big concerns about data privacy. PTB has backed off from this approach since they’ve realized that it puts a lot of responsibility on their plate. This is part of why they are looking to recommend various IT standards. Dr. Thompson reported that the Germans had wanted to go to the extreme of detailed code-walking. Mr. Oldham, Gilbarco, Inc., mentioned that though Europe has apparently backed off on this, India and Mexico appear to be continuing to pursue it.

Carry-over Items

1. Software Identification/Markings

Source:

NTETC Software Sector

Background/Discussion:

Since its inception, the Sector has wrestled with the issue of software identification and marking requirements. See the 2011 Software Sector Meeting Summary and the 2012 Interim Meeting S&T Agenda Item 360-2 for more background on this item.

NIST,OWM had been adding items to the S&T Agendas that confused matters since the perception was that this Sector had contributed to this input. Most of the confusion arose in the 1990s, due to some items being approved, and others, such as the definitions for “Built-for-Purpose” and “Not Built-for-Purpose,” not being approved.

Mr. Truex, NTEP Administrator, discussed the difficulty there has been in coming to a consensus on these issues with a representative of the NTEP Committee. Suggestions from NTEP to come to some resolution hasbeen to write an article for the newsletter (which Mr. Bliss, Mettler-Toledo, LLC, had already done, to no effect), sending a questionnaire to the NTEP community, asking what they’d like to see, and sending a representative from this Sector to the S&T Committee.

Mr. Roach, California Division of Measurement Standards, is concerned that some people may want to interpret GS.1.(c) as requiring a serial number for software. Mr. Lewis, Rice Lake Weighing Systems, Inc. pointed out that the computer that the software was running on could have the serial number, not the software itself. That shouldn’t matter, regardless.

Mr. Bliss, Mettler-Toledo, LLC, pointed out that the terminology in G-S.1. “All equipment”, could be interpreted to mean that it doesn’t apply to software. It was proposed that G-S.1.(c) be amended to add “and software”. Mr. Bliss suggested submitting a document explaining the reasoning behind the proposed changes, rather than assume that the text is self-explanatory. Making a presentation to the various Committees on the subject in addition would be beneficial as well. If a document is written, perhaps the examples given in G-S.1.d.3.(a) can be eliminated. “Metrologically significant” isn’t explicitly defined, but it’s been used since time immemorial.

Attempts to modify G-S.1.1.have been controversial, both in this meeting and in other Committees. Unfortunately, there has been little constructive feedback from the other Committees. It would probably be easier to incorporate specific examples given in G-S.1.1.b.3 in NCWM Publication 14. After some discussion, the previously proposed language was modified slightly to address some of the concerns received via feedback from other Sectors and interested parties:

NIST Handbook 44 – Proposed changes:

G-S.1. Identification. – All equipment, except weights and separate parts necessary to the measurement process but not having any metrological effect,shall be clearly and permanently marked for the purposes of identification with the following information:

(a)the name, initials, or trademark of the manufacturer or distributor;

(b)a model identifier that positively identifies the pattern or design of the device;

(1)The model identifier shall be prefaced by the word “Model,” “Type,” or “Pattern.” These terms may be followed by the word “Number” or an abbreviation of that word. The abbreviation for the word “Number” shall, as a minimum, begin with the letter “N” (e.g., No or No.). The abbreviation for the word “Model” shall be “Mod” or “Mod.” Prefix lettering may be initial capitals, all capitals, or all lowercase.

[Nonretroactive as of January 1, 2003]

(Added 2000) (Amended 2001)

(c)anonrepetitive serial number, except for equipment with no moving or electronic component parts and not-built-for-purpose software-based software devices software;

[Nonretroactive as of January 1, 1968]

(Amended 2003and 20XX)

(1)The serial number shall be prefaced by words, an abbreviation, or a symbol, that clearly identifies the number as the required serial number.

[Nonretroactive as of January 1, 1986]

(2)Abbreviations for the word “Serial” shall, as a minimum, begin with the letter “S,” and abbreviations for the word “Number” shall, as a minimum, begin with the letter “N” (e.g., S/N, SN, Ser. No., and S. No.).

[Nonretroactive as of January 1, 2001]

(d) the current software version or revision identifierfor not-built-for-purpose software-based electronic devices;

[Nonretroactive as of January 1, 2004]

(Added 2003) (Amended 20XX)

(1) The version or revision identifier shall be prefaced by words, an abbreviation, or a symbol, that clearly identifies the number as the required version or revision.

[Nonretroactive as of January 1, 2007]

(Added 2006)

(2) Abbreviations for the word “Version” shall, as a minimum, begin with the letter “V” and may be followed by the word “Number.” Abbreviations for the word “Revision” shall, as a minimum, begin with the letter “R” and may be followed by the word “Number.” The abbreviation for the word “Number” shall, as a minimum, begin with the letter “N” (e.g., No or No.).

[Nonretroactive as of January 1, 2007]

(Added 2006)

(3)The version or revision identifier shall be accessible via the display. Instructions for displaying the version or revision identifier shall be described in the CC. As an exception, permanently marking the version or revision identifier shall be acceptable under the following conditions:

(a)The user interface does not have any control capability to activate the indication of the version or revision identifier on the display, or the display does not technically allow the version or revision identifier to be shown (analog indicating device or electromechanical counter) or

(b)the device does not have an interface to communicate the version or revision identifier.

(e)an NTEP CC number or a corresponding CC Addendum Number for devices that have a CC.

(1)The CC Number or a corresponding CC Addendum Number shall be prefaced by the terms “NTEP CC,” “CC,” or “Approval.” These terms may be followed by the word “Number” or an abbreviation of that word. The abbreviation for the word “Number” shall, as a minimum, begin with the letter “N” (e.g., No or No.)

[Nonretroactive as of January 1, 2003]

The required information shall be so located that it is readily observable without the necessity of the disassembly of a part requiring the use of any means separate from the device.

(Amended 1985, 1991, 1999, 2000, 2001, 2003, and, 2006 and 201X)

G-S.1.1. Location of Marking Information for Not-Built-For-Purposeall Software-Based Devices. – Fornot-built-for-purpose, software-based devices, either:

(a)The required information in G-S.1. Identification.(a), (b),(d), and (e) shall be permanently marked or continuously displayed on the device; or

(b)The Certificate of Conformance Number shall be:

(1)permanently marked on the device;

(2)continuously displayed; or

(3)accessible through an easily recognized menu and, if necessary, a submenu. Examples of menu and submenu identification include, but are not limited to, “Help,” “System Identification,” “G-S.1. Identification,” or “Weights and Measures Identification.”

Note:For (b), clear instructions for accessing the information required in G-S.1. (a), (b), and (d) shall be listed on the CC, including information necessary to identify that the software in the device is the same type that was evaluated.

[Nonretroactive as of January 1, 2004]

(Added 2003) (Amended 2006 and 20XX)

The new language in G-S.1.1.reflects that the Sector reached consensus on the following positions:

• The software version/revision should (with very few exceptions – see D-31 5.1.1) be accessible via the user interface.
• The means by which the software version is accessed must be described in the Certificate of Conformance (CC).

In addition, it was asserted that the previously recommended changes to G-S.1.1.(b)(3) in fact are not really necessary; the current language of NIST Handbook 44 empowers the laboratories to enforce “easily recognizable” as they see fit. In fact, the previously generated “list” of icons and menu options could certainly be used by the examining laboratories as part of the approval process (e.g., in NCWM Publication 14). Of course, a manufacturer who is reviewing NIST Handbook 44 so as to develop an acceptable device may benefit from more explicit guidance. Where does such guidance belong?

Comments related to the circulated list included a comment from the Scale Manufacturers Association (SMA) suggesting that a definition is needed for “software-based devices.” SMA opposed the definitions previously put forth by the Sector. It was suggested that perhaps SMA would be more amenable to a definition that doesn’t differentiate between software types.

The conclusion from the 2011 NTETC Software Sector Meeting was that the Sector will request feedback on the new recommended language for G-S.1.and G-S.1.1. since it does deviate somewhat from previous submissions. It is hoped that the various interested Sectors, regions, and associations will give this new proposal careful thought and submit their concerns to the NTETC Software Sector.

The list of suggested icons/menus that should be considered finite options for manufacturers was updated to reflect comments received by the Sector. The Sectornow believes this approach is adequate without a change to NIST Handbook 44; the NTEP laboratories would be able to enforce “easily recognizable” against this finite list. Hence, the Sectorrecommends the list be inserted into NCWM Publication 14.

Crafting a definition for “software based device” may be included as an item in a future agenda. Note the term “not built for purpose, software based device” is already used inNIST Handbook 44.

Some concerns seemed to stem from a lack of understanding of intent. It was suggested that a supplementary document could be written, explaining the intent of the “software based device” terminology.

Conclusion:

The Sector wishes to continue promotion of this item, with the minor edits shown above included addressing some of the concerns of other interested parties. Since this is currently defined as a Developing Item, it cannot be moved to a Voting Item at the 2012 NCWM Annual Meeting; it will have to wait until 2013. In January of 2013, the decision will be made as to changing the status of this item. This Sector will need to push to accomplish this. Developing a presentation and/or writing a supplementary document that would explain the intent behind the proposed changes to G-S.1. and G-S1.1. would most likely help in getting these changes passed. The annual meeting would be an appropriate venue for a presentation, though it may be too late to get it onto the agenda. The SMA is having their meeting next month in Monterey, California. Mr. Fink, ITW Food Equipment/Hobart, may be available to assist Mr.Pettinato, Chair, in putting together a presentation and volunteered to present it at the SMA Meeting.

1. Identification of Certified Software

Source:

NTETC Software Sector

Background/Discussion:

This item originated as an attempt to answer the question, “How does the field inspector know that the software running in the device is the same software evaluated and approved by the lab?” In previous meetings it was shown that the international community has addressed this issue (both WELMEC and International Organization of Legal Metrology [OIML]).

From WELMEC 7.2:

Required Documentation:

The documentation shall list the software identifications and describe how the software identification is created, how it is inextricably linked to the software itself, how it may be accessed for viewing, and how it is structured in order to differentiate between version changes with and without requiring a type approval.

From OIML D-31:

The executable file “tt100_12.exe” is protected against modification by a checksum. The value of checksum as determined by algorithm XYZ is 1A2B3C.

Previous discussions have included a listing of some additional examples of possible valid methods (not limiting):

• Cyclical Redundancy Check (CRC)
• Checksum
• Inextricably Linked version no.
• Encryption
• Digital Signature

Is there some method to give the weights and measures inspector information that something has changed?

Yes, the Category III Audit Trail or other means of sealing.

How can the weights and measures inspector identify an NTEP certified version?

They can’t, without adding additional requirements such as those described here, in conjunction with including the identifier on theCC.

The Sector has continued to believe that we should work towards language that would include a requirement similar to the OIML requirement inNIST Handbook 44. It is also the opinion of the Sector that a specific method should not be defined; rather the manufacturer should utilize a method and demonstrate the selected identification mechanism is suitable for the purpose. It is not clear from the discussion where such proposed language might belong.