Addendum cto BTL Test Package 9.0
[This foreword and the “Overviews” on the following pages are not part of this Test Package. They are merely informative and do not contain requirements necessary for conformance to the Test Package.]
FOREWORD
The purpose of this addendum is to present current changes being made to the BTL Test Package. These modifications are the result of change proposals made pursuant to the continuous maintenance procedures and of deliberations within the BTL-WG Committee. The changes are summarized below.
BTL-TP9.0c-1. Add Support for UTF-8, pg 2. [wID0009]
BTL-TP9.0c-2. Clarify the use of Reject PDUs, pg 3. [wID0013]
BTL-TP9.0c-3. Clarify Results of Using Special Property Identifiers, pg 4. [wID0044]
BTL-TP9.0c-4. Add Data Not for Us Test, pg 6. [wID0050]
BTL-TP9.0c-5: Define COV Notification Service Error Returns, pg 7. [wID0005]
BTL-TP9.0c-6: Adds Odd and Even Day Support and Clarifies when wildcards are allowed in Dates and Times, pg 13. [wID0008]
BTL-TP9.0c-7: Add more primitive value objects, pg 20.[wID0024]
BTL-TP9.0c-8: Clarify Trend Log Time Stamp, pg 31. [wID0042]
BTL-TP9.0c-9: Add error code UNSUPPORTED_OBJECT_TYPE for CreateObject service, pg 32. [wID0014]
BTL-TP9.0c-10: Add new Primitive Value Objects to View BIBBs, pg 34.[wID0118]
BTL-TP9.0c-11: Change to update External Document References, pg 37.[wID0213]
BTL-TP9.0c-12:Add support for long Backup and Restore times, pg 39. [wID0011]
BTL-TP9.0c-13: ReadRange Error Situations, pg 40. [wID0018]
BTL-TP9.0c-14: Add Event_Message_Texts, pg 45. [wID0048]
In the following document, language to be added to existing clauses within the BTL Test Package 9.0 is indicated through the use of italics, while deletions are indicated by strikethrough. Where entirely new subclauses are proposed to be added, plain type is used throughout.
In addition, changes to BTL Specified Tests might also contain a yellow highlight to indicate the changes made by this addendum.
When this addendum is applied, all highlighting will be removed. Change markings on tests will remain to indicate the difference between the new test and an existing 135.1 test. If a test being modified has never existed in 135.1, the applied result should not contain any change markings. When this is the case, square brackets will be used to describe the changes required for this test.
Each addendum can stand independently unless specifically noted via dependency within the addendum. If multiple addenda change the same test or section, each future released addendum that changes the same test or section will note in square brackets whether or not those changes are reflected.
This addendum contains all changes required to move the BTL Test Package up from Protocol_Revision 9 to Protocol_Revision 12.
This addendum does not include any changes that may have been included in previous addenda documents.BTL-TP9.0c-1 Add Support for UTF-8
Overview
This document applies changes to the test package for:
- Addendum 135-2008k.1 Add Support for UTF-8.
Changes:
[In BTL Specified Tests, modify section 7.2.1.3]
7.2.1.3Octetstrings and Characterstrings
Properties with an octetstring or characterstring datatype shall be tested with a string of length zerothe minimum supported length, a string with the maximum supported length, and a string with some length between the two. The vendor shall provide the actual value of the maximum length string in the EPICS. See 4.4.2.
When testing character string properties in a device that supports UTF-8 (Protocol_Revision >= 10), at least one of the data values shall contain multi-byte characters.
BTL-TP9.0c-2 Clarify the use of Reject PDUs
Overview:
This document applies changes to the test package for:
- Addendum 135-2008u.1 Clarify the use of RejectPDUs.
Changes:
[In BTL Test Plan, Add into 4.8.1 WPM-B Base Requirements]
BTL - 9.23.2.X1 WritePropertyMultiple Reject TestTest Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed if the IUT claims Protocol_Revision 10 or greater.
Test Directives
Testing Hints
Notes & Results
[In BTL Specified Tests, add new test]
9.23.2.X1 WritePropertyMultiple Reject Test
Reason for Change: Addendum 135-2008u section 1.
Purpose: This test case verifies that the IUT does not send a Reject-PDU after applying part of a WritePropertyMultiple.
Test Concept: Two writable properties, P1 and P2 are written to the IUT but the portion of the WritePropertyMultiple specifying P2 is invalid. If the IUT returns a Reject, then the value of the first property is checked to ensure it has not changed.
Test Steps:
1.READ OldValue = O1, P1
2.TRANSMIT WritePropertyMultiple-Request,
'Object Identifier' =O1,
'Property Identifier' =P1,
'Property Value' =(NewValue: any value other than OldValue that would be accepted by
the IUT for P1)
'Object Identifier' =O2,
'Property Identifier' =P2
3.RECEIVEWritePropertyMultiple-Error,
'Error Class' = SERVICES,
'Error Code' = INVALID_TAG
'Object Identifier' = O2
'Property Identifier' = P2) |
(RECEIVE BACnet-Reject-PDU,
'Reject Reason' =INVALID_TAG | MISSING_REQUIRED_PARAMETER)
4.IF (an Error-PDU was received in step 3) THEN
VERIFY (O1), P1 = NewValue
ELSE -- a Reject-PDU was received
VERIFY (O1), P1 = OldValue
BTL-TP9.0c-3. Clarify Results of Using Special Property Identifiers
Overview:
This document applies changes to the test package for:
- Addendum 135-2008x.4 Clarify Results of Using Special Property Identifiers.
Changes:
[BTL Test Plan, modify the following referencesin 4.4.1 Data Sharing - ReadPropertyMultiple-B Base Requirements]
135.1-2009 - 9.20.1.7 to BTL - 9.20.1.7
135.1-2009 - 9.20.1.8 to BTL - 9.20.1.8
135.1-2009 - 9.20.1.9 to BTL - 9.20.1.9
[BTL Specified Tests, add tests 9.20.1.7, 9.20.1.8, 9.20.1.9]
[The tests below were also modified by Add-BTL Test Package 9.0-b-v2, those changes are not reflected here]
9.20.1.7 Reading ALL Properties
Reason for Change: Addendum 135-2008x.
Purpose: To verify the ability to correctly execute a ReadPropertyMultiple service request that uses the special property identifier ALL. One instance of each object-type supported is tested.
Test Steps:
1.REPEAT ObjectX = (one instance of each supported object type) DO {
TRANSMIT ReadPropertyMultiple-Request,
'Object Identifier' =ObjectX,
'Property Identifier' =ALL
RECEIVE ReadPropertyMultiple-ACK,
'Object Identifier' = Object1ObjectX,
REPEAT P = (each property supported by Object1ObjectX) DO {
'Property Identifier' =P,
'Property Value' =(the value of P specified in the EPICS)
}
}
Notes to Tester: Any proprietary properties that are supported for the object-type shall also be returned (see BACnet 15.7.3.1.2). If a property which is not readable using the ReadPropertyMultiple service is in the specified object, and Protocol_Revision < 7, then either no entry is returned, or an error code is returned. If Protocol_Revision >= 7, then the entry shall contain Error Class: PROPERTY and ‘Error-Code’: READ_ACCESS_DENIED for that property.
9.20.1.8 Reading OPTIONAL Properties
Reason for Change: Addendum 135-2008x.
Purpose: To verify the ability to correctly execute a ReadPropertyMultiple service request that uses the special property identifier OPTIONAL. One instance of each object-type supported is tested.The property identifier OPTIONAL means that only those standard properties present in the object that have a conformance code "O" shall be returned.
Test Steps:
1.REPEAT ObjectX = (one instance of each supported object type) DO {
TRANSMIT ReadPropertyMultiple-Request,
'Object Identifier' =Object1ObjectX,
'Property Identifier' =OPTIONAL
RECEIVE ReadPropertyMultiple-ACK,
'Object Identifier' = Object1ObjectX,
REPEAT P = (each optional property supported by Object1ObjectX) DO {
'Property Identifier' =P,
'Property Value' =(the value of P specified in the EPICS)
}
}
Notes to Tester: If no optional properties are supported then an empty 'List of Results' shall be returned for the specified property. If a property which is not readable using the ReadPropertyMultiple service is in the specified object, and Protocol_Revision < 7, then either no entry is returned, or an error code is returned. If Protocol_Revision >= 7, then the entry shall contain Error Class: PROPERTY and ‘Error-Code’: READ_ACCESS_DENIED for that property.
9.20.1.9Reading REQUIRED Properties
Reason for Change: Addendum 135-2008x.
Purpose: To verify the ability to correctly execute a ReadPropertyMultiple service request that uses the special property identifier REQUIRED. One instance of each object-type supported is tested. The property identifier REQUIRED means that only those standard properties having a conformance code of "R" or "W" shall be returned.
Test Steps:
1.REPEAT ObjectX = (one instance of each supported object type) DO {
TRANSMIT ReadPropertyMultiple-Request,
'Object Identifier' =Object1ObjectX,
'Property Identifier' =REQUIRED
RECEIVE ReadPropertyMultiple-ACK,
'Object Identifier' = Object1ObjectX,
REPEAT P = (each required property defined for Object1ObjectX) DO {
'Property Identifier' =P,
'Property Value' =(the value of P specified in the EPICS)
}
}
Notes to Tester: If a property which is not readable using the ReadPropertyMultiple service is in the specified object, and Protocol_Revision < 7, then either no entry is returned, or an error code is returned. If Protocol_Revision >= 7, then the entry shall contain Error Class: PROPERTY and ‘Error-Code’: READ_ACCESS_DENIED for that property.
BTL 9.0c-4 Add Data Not for Us Test
Overview:
This applies changes to the test package for:
- Addendum 135-2008z.3 Modify MS/TP State Machine to Ignore Data Not For Us.
Add a test that checks whether the complete message is properly skipped when it is not aimed at the IUT
Changes:
[In BTL Test Plan, add to Data link Layer - MS/TP Master Node and Data link Layer - MS/TP Slave Node ]
BTL - 2.2.X1 - Data Not For Us TestTest Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
[In BTL Specified Tests, add a new test]
2.2.X1 Data Not For Us Test
Purpose: Verify that the IUT properly skips the complete data portion of frames not intended for the IUT.
Test Concept: Send a BACnet Data Not Expecting Reply frame that contains the frame pre-amble octet sequence to an address other that the IUT. Follow it immediately with a ReadProperty request for the IUT’s device object to ensure that the IUT will correctly receive and process the ReadProperty request.
Test Steps:
1.TRANSMIT
Frame Type = BACnet Data Not Expecting Reply
Destination Address = (any Unicast address other than IUT),
Length = 7,
Data = (55 FF 05 FF 00 01 F5)
2.TRANSMIT ReadProperty-Request
‘Object Identifier’= (device, 4194303),
‘Property Identifier’= Object_Name
3.RECEIVE ReadProperty-Response
‘Object Identifier’= (device, IUT),
‘Property Identifier’= Object_Name,
‘Value’= (any valid value)
BTL-TP9.0c-5: Define COV Notification Service Error Returns
Overview:
This document applies changes to the test package for:
- Addendum 135-2008h.5 Define COV Notification Service Error Returns.
4 existing tests are modified and 3 new tests are added to provide negative testing for both A and B side COV.
Changes:
[In BTL Test Plan, modify DS-COV-A Base Requirements section]
4.9.1 Base Requirements
Base requirements must be met by any IUT claiming conformance to this BIBB. There are no base requirements tests for this section.
[In BTL Test Plan, add the following entries to DS-COV-A Base Requirements section]
BTL - 9.2.2.1 - Change of Value Notification Arrives after Subscription has ExpiredTest Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
BTL - 9.2.2.2 - Change of Value Notifications with Invalid Process Identifier
Test Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
BTL - 9.2.2.3 - Change of Value Notifications with Invalid Initiating Device Identifier
Test Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
BTL - 9.2.2.4 - Change of Value Notifications with Invalid Monitored Object Identifier
Test Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
[In BTL Test Plan, add the following entries to DS-COV-B Base Requirements section]
BTL - 9.2.10.X1 - The Monitored Object Does Not ExistTest Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
BTL - 9.2.10.X2 - There Is No Space For A Subscription
Test Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
BTL - 9.2.10.X3 - The LifeTime Parameter is Out of Range
Test Method
Configuration / As per BTL Specified Tests.
Test Conditionality / Must be executed.
Test Directives
Testing Hints
Notes & Results
[ In BTL Specified Tests, Add9.2.2.1 ]
9.2.2.1 Change of Value Notification Arrives after Subscription has Expired
Reason for Change: 135-2008h allows for a SimpleAck or a specific error code to return if a subscription does not exist.
Purpose: To verify that an appropriate error is returned if a COV notification arrives after the subscription time period has expired.
Test Steps:
1.RECEIVE SubscribeCOV,
'Subscriber Process Identifier' =(any valid process identifier),
'Monitored Object Identifier' =(any object X of a type that supports COV notification),
'Issue Confirmed Notifications ' =TRUE,
'Lifetime' =(a value no greater than one minute)
2.TRANSMIT BACnet-SimpleACK-PDU
3.WAIT (a value two times Lifetime)
4.TRANSMIT ConfirmedCOVNotification-Request,
'Subscriber Process Identifier' =(the process identifier used in step 21),
'Initiating Device Identifier' =TD,
'Monitored Object Identifier' =X,
'Time Remaining' =(any amount of time greater than 0),
'List of Values' =(a list of values appropriate to object X)
5.IF (Protocol_Revision is present and Protocol_Revision >= 10) THEN
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =UNKNOWN_SUBSCRIPTION |
(BACnet-SimpleACK-PDU)
ELSE
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =(any valid error code for class SERVICES) |
(BACnet-SimpleACK-PDU)
[In BTL Specified Tests, Add9.2.2.2]
9.2.2.2 Change of Value Notifications with Invalid Process Identifier
Reason for Change: 135-2008h allows for a SimpleAck or a specific error code to return if a subscription does not exist.
Purpose: To verify that an appropriate error is returned if a COV notification arrives that contains a process identifier that does not match any current subscriptions.
Test Steps:
1.RECEIVE SubscribeCOV,
'Subscriber Process Identifier' =(any valid process identifier),
'Monitored Object Identifier' =(any object X of a type that supports COV notification),
'Issue Confirmed Notifications ' =TRUE,
'Lifetime' =(a value no greater than one minute)
2.TRANSMIT BACnet-SimpleACK-PDU
3.TRANSMIT ConfirmedCOVNotification-Request,
'Subscriber Process Identifier' =(a process identifier different from the one used in step 21),
'Initiating Device Identifier' =TD,
'Monitored Object Identifier' =X,
'Time Remaining' =(any amount of time greater than 0),
'List of Values' =(a list of values appropriate to object X)
4.IF (Protocol_Revision is present and Protocol_Revision >= 10) THEN
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =UNKNOWN_SUBSCRIPTION |
(BACnet-SimpleACK-PDU)
ELSE
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =(any valid error code for class SERVICES) |
(BACnet-SimpleACK-PDU)
[In BTL Specified Tests, Add9.2.2.3]
9.2.2.3Change of Value Notifications with Invalid Initiating Device Identifier
Reason for Change: 135-2008h allows for a SimpleAck or a specific error code to return if a subscription does not exist.
Purpose: To verify that an appropriate error is returned if a COV notification arrives that contains an initiating device identifier that does not match any current subscriptions.
Test Steps:
1.RECEIVE SubscribeCOV,
'Subscriber Process Identifier' =(any valid process identifier),
'Monitored Object Identifier' =(any object X of a type that supports COV notification),
'Issue Confirmed Notifications ' =TRUE,
'Lifetime' =(a value no greater than one minute)
2.TRANSMIT BACnet-SimpleACK-PDU
3.TRANSMIT ConfirmedCOVNotification-Request,
'Subscriber Process Identifier' =(the process identifier different used in step 21),
'Initiating Device Identifier' =(any valid Device object except TD),
'Monitored Object Identifier' =X,
'Time Remaining' =(any amount of time greater than 0),
'List of Values' =(a list of values appropriate to object X)
4.IF (Protocol_Revision is present and Protocol_Revision >= 10) THEN
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =UNKNOWN_SUBSCRIPTION |
(BACnet-SimpleACK-PDU)
ELSE
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =(any valid error code for class SERVICES) |
(BACnet-SimpleACK-PDU)
[In BTL Specified Tests, Add9.2.2.4]
9.2.2.4 Change of Value Notifications with Invalid Monitored Object Identifier
Reason for Change: 135-2008h allows for a SimpleAck or a specific error code to return if a subscription does not exist.
Purpose: To verify that an appropriate error is returned if a COV notification arrives that contains a monitored object identifier that does not match any current subscriptions.
Test Steps:
1.RECEIVE SubscribeCOV,
'Subscriber Process Identifier' =(any valid process identifier),
'Monitored Object Identifier' =(any object X of a type that supports COV notification),
'Issue Confirmed Notifications ' =TRUE,
'Lifetime' =(a value no greater than one minute)
2.TRANSMIT BACnet-SimpleACK-PDU
3.TRANSMIT ConfirmedCOVNotification-Request,
'Subscriber Process Identifier' =(the process identifier used in step 21),
'Initiating Device Identifier' =TD,
'Monitored Object Identifier' =(any object Y supporting COV notification except X),
'Time Remaining' =(any amount of time greater than 0),
'List of Values' =(a list of values appropriate to object Y)
4.IF (Protocol_Revision is present and Protocol_Revision >= 10) THEN
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =UNKNOWN_SUBSCRIPTION |
(BACnet-SimpleACK-PDU)
ELSE
RECEIVE BACnet-Error-PDU,
Error Class =SERVICES,
Error Code =(any valid error code for class SERVICES)|
(BACnet-SimpleACK-PDU)
[In BTL Specified Tests, Modify 9.10.2.1]
9.10.2.1The Monitored Object Does Not Support COV Notification
Reason for Change: 135-2008h allows for a SimpleAck or a specific error code to return if a subscription does not exist.
Purpose: To verify that the IUT correctly responds to a SubscribeCOV request to establish a subscription when the monitored object does not support COV notifications.
Test Steps:
1.TRANSMIT SubscribeCOV-Request,
'Subscriber Process Identifier' =(any valid process identifier),
'Monitored Object Identifier' =(any object that exists in the IUT anddoes not support COV notifications),
'Issue Confirmed Notifications' =TRUE,
'Lifetime' =60
[The following step 2 displayed from BTL Specified Tests 9.0 should be deleted]
2.IF (Protocol_Revision < 10) THEN
RECEIVE (BACnet-Error PDU,
Error Class = SERVICES,
Error Code = SERVICE_REQUEST_DENIED | OTHER |
COV_SUBSCRIPTION_FAILED) |
(BACnet-Error PDU,
Error Class = PROPERTY,
Error Code = NOT_COV_PROPERTY) |
(BACnet-Error PDU,
Error Class = OBJECT,