Traceability Interoperability Test Results

Summary

These are the test results for the Open API for Interoperable Traceability as of: 2023-02-02 02:13:16.014484

The highest current % of passed tests by a single provider is: 94.2%
The lowest is: 73.1%
Across all providers the average % of passed tests is: 86.2%

Provider Summary

GS1US

75.5%

of tests taken, passed

Mavennet

87.2%

of tests taken, passed

Transmute

91.4%

of tests taken, passed

mesur.io

88.8%

of tests taken, passed

GS1US - Mavennet

88.5%

of tests taken, passed

GS1US - Transmute

90.4%

of tests taken, passed

GS1US - mesur.io

86.5%

of tests taken, passed

Mavennet - GS1US

73.1%

of tests taken, passed

Mavennet - Transmute

92.3%

of tests taken, passed

Mavennet - mesur.io

88.5%

of tests taken, passed

Transmute - GS1US

75.0%

of tests taken, passed

Transmute - Mavennet

94.2%

of tests taken, passed

Transmute - mesur.io

92.3%

of tests taken, passed

mesur.io - GS1US

73.1%

of tests taken, passed

mesur.io - Mavennet

90.4%

of tests taken, passed

mesur.io - Transmute

92.3%

of tests taken, passed

Provider & Test Summary

Test Type
GS1US
Mavennet
Transmute
mesur.io

Credentials Issue

100.0%

100.0%

100.0%

100.0%

Credentials Revocation

96.2%

76.9%

100.0%

80.8%

Credentials Verify

94.7%

89.5%

100.0%

89.5%

DID Web Discovery

81.8%

100.0%

100.0%

100.0%

Presentations Verify

65.1%

86.5%

84.1%

88.1%

Workflow Instance Join

n/a

n/a

100.0%

n/a


Test Type
GS1US - Mavennet
GS1US - Transmute
GS1US - mesur.io
Mavennet - GS1US
Mavennet - Transmute
Mavennet - mesur.io
Transmute - GS1US
Transmute - Mavennet
Transmute - mesur.io
mesur.io - GS1US
mesur.io - Mavennet
mesur.io - Transmute

OAuth Presentations Exchange

88.9%

100.0%

77.8%

66.7%

100.0%

77.8%

66.7%

88.9%

77.8%

66.7%

88.9%

100.0%

Presentations Exchange

88.4%

88.4%

88.4%

74.4%

90.7%

90.7%

76.7%

95.3%

95.3%

74.4%

90.7%

90.7%




Results

Details

Provider
Test Type
Test Step
Assertion
Result
Error Message
Passing

mesur.io - GS1US

Presentations Exchange

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

Response must include 'service' array

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

'service' array must define Traceability API service endpoint

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

`issuer_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

must include valid JSON response body

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

didDocument must be present in response body

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

verification method controller must match did subject

Pass

1

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

'service' array must define Traceability API service endpoint

Fail

Cannot read properties of undefined (reading 'find')

0

mesur.io - GS1US

Presentations Exchange

Get Organization DIDs (Verifier)

`verifier_exchange_endpoint` is persisted to collectionVariables

Fail

Cannot read properties of undefined (reading 'find')

0

mesur.io - GS1US

Presentations Exchange

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Issue Credential

must return `201 Created` status

Pass

1

mesur.io - GS1US

Presentations Exchange

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

mesur.io - GS1US

Presentations Exchange

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Initiate Exchange

must return `200 Success` status

Fail

expected { Object (id, _details, ...) } to have property 'code'

0

mesur.io - GS1US

Presentations Exchange

Initiate Exchange

response must include 'domain' property

Fail

Unexpected token u in JSON at position 0

0

mesur.io - GS1US

Presentations Exchange

Initiate Exchange

response must include 'challenge' property

Fail

Unexpected token u in JSON at position 0

0

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`verifiable_credential` collection variable must be set

Fail

expected null to be a string

0

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`domain` collection variable must be set

Fail

expected '' not to be empty

0

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`challenge` collection variable must be set

Fail

expected '' not to be empty

0

mesur.io - GS1US

Presentations Exchange

Sign Presentation

must return `201 Success` status

Fail

expected response to have status code 201 but got 500

0

mesur.io - GS1US

Presentations Exchange

Sign Presentation

`verifiable_presentation` persisted to collectionVariables

Pass

1

mesur.io - GS1US

Presentations Exchange

Complete Exchange

`verifier_access_token` collection variable must be set

Pass

1

mesur.io - GS1US

Presentations Exchange

Complete Exchange

must return `200 Success` status

Fail

expected { Object (id, _details, ...) } to have property 'code'

0

mesur.io - GS1US

Presentations Exchange

Complete Exchange

verification response should be 'true'

Fail

Unexpected token u in JSON at position 0

0

mesur.io - GS1US

OAuth Presentations Exchange

Holder gets Verifier's Token

must return `200 Success` status

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must include non-empty access_token

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must represent `Bearer` token

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Holder gets Verifier's Token

returned token must expire in the future

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Holder gets Verifier's Token

`access_token` persisted to collectionVariables

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Get Verifier Organization DIDs

Status code is 200

Pass

1

mesur.io - GS1US

OAuth Presentations Exchange

Get Verifier Organization DIDs

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Fail

Cannot read properties of undefined (reading '0')

0

mesur.io - GS1US

OAuth Presentations Exchange

Presentation

must return `200 Success` status

Fail

expected { Object (id, _details, ...) } to have property 'code'

0

mesur.io - GS1US

OAuth Presentations Exchange

Presentation

Content-Type header is application/json

Fail

the given combination of arguments (undefined and string) is invalid for this assertion. You can use an array, a map, an object, a set, a string, or a weakset instead of a string

0

GS1US - Transmute

Presentations Exchange

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

GS1US - Transmute

Presentations Exchange

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

Response must include 'service' array

Fail

expected undefined to be an array

0

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

'service' array must define Traceability API service endpoint

Fail

Cannot read properties of undefined (reading 'find')

0

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

`issuer_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

must include valid JSON response body

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

didDocument must be present in response body

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

verification method controller must match did subject

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

'service' array must define Traceability API service endpoint

Pass

1

GS1US - Transmute

Presentations Exchange

Get Organization DIDs (Verifier)

`verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Issue Credential

must return `201 Created` status

Pass

1

GS1US - Transmute

Presentations Exchange

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Initiate Exchange

must return `200 Success` status

Pass

1

GS1US - Transmute

Presentations Exchange

Initiate Exchange

response must include 'domain' property

Pass

1

GS1US - Transmute

Presentations Exchange

Initiate Exchange

response must include 'challenge' property

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

`verifiable_credential` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

`domain` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

`challenge` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Sign Presentation

must return `201 Success` status

Fail

expected response to have status code 201 but got 404

0

GS1US - Transmute

Presentations Exchange

Sign Presentation

`verifiable_presentation` persisted to collectionVariables

Pass

1

GS1US - Transmute

Presentations Exchange

Complete Exchange

`verifier_access_token` collection variable must be set

Pass

1

GS1US - Transmute

Presentations Exchange

Complete Exchange

must return `200 Success` status

Fail

expected response to have status code 200 but got 500

0

GS1US - Transmute

Presentations Exchange

Complete Exchange

verification response should be 'true'

Fail

expected undefined to be true

0

mesur.io

DID Web Discovery

Get Access Token

must return `200 Success` status

Pass

1

mesur.io

DID Web Discovery

Get Access Token

response body must include non-empty access_token

Pass

1

mesur.io

DID Web Discovery

Get Access Token

response body must represent `Bearer` token

Pass

1

mesur.io

DID Web Discovery

Get Access Token

returned token must expire in the future

Pass

1

mesur.io

DID Web Discovery

Get Access Token

`access_token` persisted to collectionVariables

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

Status code is 200

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

must include valid JSON response body

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

didDocument must be present in response body

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

Response must include 'service' array

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

'service' array must define Traceability API service endpoint

Pass

1

mesur.io

DID Web Discovery

Get Organization DIDs

verification method controller must match did subject

Pass

1

Transmute

Presentations Verify

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

Transmute

Presentations Verify

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

Transmute

Presentations Verify

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

Transmute

Presentations Verify

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

Transmute

Presentations Verify

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

Transmute

Presentations Verify

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

Transmute

Presentations Verify

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

Transmute

Presentations Verify

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

Transmute

Presentations Verify

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

Transmute

Presentations Verify

Get Organization DIDs (Verifier)

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

Transmute

Presentations Verify

Issue Credential

must return `201 Created` status

Pass

1

Transmute

Presentations Verify

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Initiate Exchange

must return `200 Success` status

Pass

1

Transmute

Presentations Verify

Initiate Exchange

response must include 'domain' property

Pass

1

Transmute

Presentations Verify

Initiate Exchange

response must include 'challenge' property

Pass

1

Transmute

Presentations Verify

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

Transmute

Presentations Verify

Sign Presentation

`verifiable_credential` collection variable must be set

Fail

expected null to be a string

0

Transmute

Presentations Verify

Sign Presentation

`domain` collection variable must be set

Pass

1

Transmute

Presentations Verify

Sign Presentation

`challenge` collection variable must be set

Pass

1

Transmute

Presentations Verify

Sign Presentation

must return `201 Success` status

Fail

expected response to have status code 201 but got 500

0

Transmute

Presentations Verify

Sign Presentation

`verifiable_presentation` persisted to collectionVariables

Pass

1

Transmute

Presentations Verify

Complete Exchange

`verifier_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Complete Exchange

must return `200 Success` status

Fail

expected response to have status code 200 but got 500

0

Transmute

Presentations Verify

Complete Exchange

verification response should be 'true'

Fail

expected undefined to be true

0

Transmute

Presentations Verify

Verify Presentation

`verifier_access_token` collection variable must be set

Pass

1

Transmute

Presentations Verify

Verify Presentation

`verifiable_presentation` collection variable must be set

Fail

expected null to be a string

0

Transmute

Presentations Verify

Verify Presentation

`domain` collection variable must be set

Pass

1

Transmute

Presentations Verify

Verify Presentation

`challenge` collection variable must be set

Pass

1

Transmute

Presentations Verify

Verify Presentation

must return `200 Success` status