Test Case Items - oasis-open.org fileTC-IMPEXP-2-20 •Problem –Test Case contains incorrect Fresh •Solution –Correct it –export does not alter Fresh and we should update the

Test Case Items

February, 2019

Problem

• Need to fix things in some test cases

• Need to adjust some things in the specification

QS-M-2-20

• Problem - Incorrect type

• Solution – Correct the type

-@@ -40,7 +40,7 @@

<Operation type="Enumeration" value="Create"/>

<ResultStatus type="Enumeration" value="OperationFailed"/>

<ResultReason type="Enumeration" value="GeneralFailure"/>

- <ResultMessage type="Enumeration" value="NOT_SAFE"/>

+ <ResultMessage type="TextString" value="NOT_SAFE"/>

<ResponsePayload>

</ResponsePayload>

</BatchItem>

QS-M-2-20

• Problem – Empty response payload on error

• Solution – Remove it – it should not be present

@@ -41,8 +41,6 @@


<ResultReason type="Enumeration" value="GeneralFailure"/>

<ResultMessage type="TextString" value="NOT_SAFE"/>

- <ResponsePayload>

- </ResponsePayload>

</BatchItem>

</ResponseMessage>

BL-M-2-20

• Problem – Typo in Interop Identifier• Solution – Correct it – in both places

@@ -14,7 +14,7 @@

<Operation type="Enumeration" value="Interop"/>

<RequestPayload>

<InteropFunction type="Enumeration" value="Begin"/>

- <InteropIdentifier type="TextString" value="BL-M-2-10"/>

+ <InteropIdentifier type="TextString" value="BL-M-2-20"/>

</RequestPayload>

</BatchItem>

</RequestMessage>

@@ -218,7 +218,7 @@

<Operation type="Enumeration" value="Interop"/>

<RequestPayload>

<InteropFunction type="Enumeration" value="End"/>

- <InteropIdentifier type="TextString" value="BL-M-2-10"/>

+ <InteropIdentifier type="TextString" value="BL-M-2-20"/>

</RequestPayload>

</BatchItem>

</RequestMessage>

TC-LOGIN-2-20

• Problem – Error in return – missing Operation

• Solution – Correct it

@@ -297,7 +297,8 @@

<BatchCount type="Integer" value="1"/>

</ResponseHeader>

<BatchItem>

- <ResultStatus type="Enumeration" value="OperationSuccess"/>

+ <Operation type="Enumeration" value="Interop"/>

+ <ResultStatus type="Enumeration" value="Success"/>

<ResponsePayload>

</ResponsePayload>

</BatchItem>

TC-LOGIN-3-20



@@ -340,7 +340,8 @@


</ResponseHeader>

<BatchItem>

- <ResultStatus type="Enumeration" value="OperationSuccess"/>

+ <Operation type="Enumeration" value="Interop"/>

+ <ResultStatus type="Enumeration" value="Success"/>

<ResponsePayload>

</ResponsePayload>

</BatchItem>

TC-LOGIN-2-20



@@ -261,6 +261,7 @@


</ResponseHeader>

<BatchItem>

+ <Operation type="Enumeration" value="Query"/>


<ResultReason type="Enumeration" value="InvalidTicket"/>

<ResultMessage type="TextString" value="Kmip"/>

TC-LOGIN-2-20

• Problem – Test Case / Specification Difference

• Solution – Correct Specification – matches intent(note – in three locations in this test case)

@@ -90,8 +90,10 @@

<Credential>

<CredentialType type="Enumeration" value="Ticket"/>

<CredentialValue>

+ <Ticket>

<TicketType type="Enumeration" value="Login"/>

<TicketValue type="ByteString" value="$TICKET_VALUE"/>

+ </Ticket>

</CredentialValue>

</Credential>

</Authentication>

PKCS11-M-1-20

• Problem – Test Case contains non-required item

• Solution – Correct it – correlation value is non-meaningful after C_Finalize call

@@ -111,7 +111,6 @@

<ResultStatus type="Enumeration" value="Success"/>

<ResponsePayload>

<PKCS_11Function type="Enumeration" value="C_Finalize"/>

- <CorrelationValue type="ByteString" value="$CORRELATION_VALUE"/>

<PKCS_11ReturnCode type="Enumeration" value="OK"/>

</ResponsePayload>

</BatchItem>

TC-IMPEXP-1-20

• Problem – Test Case contains incorrect Fresh

• Solution – Correct it – export does not alter Fresh and we should update the specification to make that clearer

@@ -139,7 +139,7 @@

<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>

<State type="Enumeration" value="PreActive"/>

<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>

- <Fresh type="Boolean" value="false"/>

+ <Fresh type="Boolean" value="true"/>

<Sensitive type="Boolean" value="false"/>

<AlwaysSensitive type="Boolean" value="false"/>

<Extractable type="Boolean" value="true"/>

TC-IMPEXP-2-20



@@ -139,7 +139,7 @@









@@ -194,7 +194,7 @@

<ActivationDate type="DateTime" value="2000-02-02T00:00:00+10:00"/>

<State type="Enumeration" value="Active"/>







TC-IMPEXP-3-20• Problem – Test Case contains incorrect Fresh• Solution – Correct it – export does not alter Fresh and we should update

the specification to make that clearer

@@ -135,7 +135,7 @@


<ProtectStopDate type="DateTime" value="2000-02-01T00:00:00+10:00"/>







@@ -186,7 +186,7 @@









@@ -272,7 +272,7 @@









TC-IMPEXP-4-20• Problem – Test Case contains incorrect Fresh• Solution – Correct it – export does not alter Fresh and we should update

the specification to make that clearer

@@ -151,7 +151,7 @@









@@ -256,7 +256,7 @@









@@ -360,7 +360,7 @@









TC-IMPEXP-5-20



@@ -144,7 +144,7 @@









@@ -218,7 +218,7 @@









MSGENC-HTTPS-M-1-20

• Problem – Test Case has ClientCorrelationValuein wrong location

• Solution – Correct it @@ -51,8 +51,8 @@

<ProtocolVersionMajor type="Integer" value="2"/>

<ProtocolVersionMinor type="Integer" value="0"/>

</ProtocolVersion>

- <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>

<MaximumResponseSize type="Integer" value="2048"/>

+ <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>


</RequestHeader>

<BatchItem>

MSGENC-JSON-M-1-20





</ProtocolVersion>





</RequestHeader>

<BatchItem>

MSGENC-XML-M-1-20





</ProtocolVersion>





</RequestHeader>

<BatchItem>

XML and JSON

• Problem – time values without time zone

• Solution – note it during testing – not permitted as the other party does not know the time zone settings and cannot adjust

2019-02-26T06:09:36+00:00

2019-02-26T06:09:36Z

2019-02-26T06:00:36+09:00

2019-02-26T06:09:36

Interop Operation

• Problem – only a subset of 2.0 tests used it

• Solution – require it for all tests for interop

• BL-M-{1..13}-20

• TC-LOGIN-{1..3}-20

• TC-DLOGIN-{1..3}-20

• TC-IMPEXP-{1..5}-20

• TC-SETATTR-{1..3}-20

i.e. 27 out of the 188 defined test cases

Conclusion

• Simple updates from latest interop

• General consensus that testing went well

• Were things were handled differently for specific test cases – either interpretation was accepted during interop

Documents

Test Case Items - oasis-open.org fileTC-IMPEXP-2-20 •Problem –Test Case contains incorrect Fresh •Solution –Correct it –export does not alter Fresh and we should update the