Traceability Interoperability Test Results

Summary

These are the test results for the Open API for Interoperable Traceability as of: 2022-10-03 01:40:05.654558

The highest current % of passed tests by a single provider is: 100.0%
The lowest is: 91.6%
Across all providers the average % of passed tests is: 96.4%

Provider Summary

Mavennet

91.6%

of tests taken, passed

Transmute

100.0%

of tests taken, passed

mesur.io

95.5%

of tests taken, passed

Mavennet - Transmute

100.0%

of tests taken, passed

Mavennet - mesur.io

92.3%

of tests taken, passed

Transmute - Mavennet

96.2%

of tests taken, passed

Transmute - mesur.io

92.3%

of tests taken, passed

mesur.io - Mavennet

100.0%

of tests taken, passed

mesur.io - Transmute

100.0%

of tests taken, passed

Provider & Test Summary

Test Type
Mavennet
Transmute
mesur.io

Credentials Issue

100.0%

100.0%

100.0%

Credentials Revocation

80.8%

100.0%

88.5%

Credentials Verify

89.5%

100.0%

100.0%

DID Web Discovery

100.0%

100.0%

100.0%

Presentations Verify

92.9%

100.0%

95.2%

Workflow Instance Join

n/a

100.0%

n/a


Test Type
Mavennet - Transmute
Mavennet - mesur.io
Transmute - Mavennet
Transmute - mesur.io
mesur.io - Mavennet
mesur.io - Transmute

OAuth Presentations Exchange

100.0%

77.8%

100.0%

77.8%

100.0%

100.0%

Presentations Exchange

100.0%

95.3%

95.3%

95.3%

100.0%

100.0%




Results

Details

Provider
Test Type
Test Step
Assertion
Result
Error Message
Passing

mesur.io

Presentations Verify

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Verifier)

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Issue Credential

must return `201 Created` status

Pass

1

mesur.io

Presentations Verify

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

response must include 'domain' property

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

response must include 'challenge' property

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`verifiable_credential` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`domain` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`challenge` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

must return `201 Success` status

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`verifiable_presentation` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Complete Exchange

`verifier_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Complete Exchange

must return `200 Success` status

Fail

expected response to have status code 200 but got 403

0

mesur.io

Presentations Verify

Complete Exchange

verification response should be 'true'

Fail

expected undefined to be true

0

mesur.io

Presentations Verify

Verify Presentation

`verifier_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Verify Presentation

`verifiable_presentation` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Verify Presentation

`domain` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Verify Presentation

`challenge` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Verify Presentation

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Verify Presentation

verification response should be 'true'

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Holder gets Verifier's Token

must return `200 Success` status

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must include non-empty access_token

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must represent `Bearer` token

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Holder gets Verifier's Token

returned token must expire in the future

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Holder gets Verifier's Token

`access_token` persisted to collectionVariables

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Get Verifier Organization DIDs

Status code is 200

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Get Verifier Organization DIDs

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

Transmute - mesur.io

OAuth Presentations Exchange

Presentation

must return `200 Success` status

Fail

expected response to have status code 200 but got 404

0

Transmute - mesur.io

OAuth Presentations Exchange

Presentation

Content-Type header is application/json

Fail

expected 'text/html; charset=utf-8' to include 'application/json'

0

Transmute - Mavennet

OAuth Presentations Exchange

Holder gets Verifier's Token

must return `200 Success` status

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must include non-empty access_token

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must represent `Bearer` token

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Holder gets Verifier's Token

returned token must expire in the future

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Holder gets Verifier's Token

`access_token` persisted to collectionVariables

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Get Verifier Organization DIDs

Status code is 200

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Get Verifier Organization DIDs

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Presentation

must return `200 Success` status

Pass

1

Transmute - Mavennet

OAuth Presentations Exchange

Presentation

Content-Type header is application/json

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

Response must include 'service' array

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

'service' array must define Traceability API service endpoint

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

`issuer_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

must include valid JSON response body

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

didDocument must be present in response body

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

verification method controller must match did subject

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

'service' array must define Traceability API service endpoint

Pass

1

Transmute - Mavennet

Presentations Exchange

Get Organization DIDs (Verifier)

`verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Issue Credential

must return `201 Created` status

Pass

1

Transmute - Mavennet

Presentations Exchange

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Initiate Exchange

must return `200 Success` status

Pass

1

Transmute - Mavennet

Presentations Exchange

Initiate Exchange

response must include 'domain' property

Pass

1

Transmute - Mavennet

Presentations Exchange

Initiate Exchange

response must include 'challenge' property

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`verifiable_credential` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`domain` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`challenge` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

must return `201 Success` status

Pass

1

Transmute - Mavennet

Presentations Exchange

Sign Presentation

`verifiable_presentation` persisted to collectionVariables

Pass

1

Transmute - Mavennet

Presentations Exchange

Complete Exchange

`verifier_access_token` collection variable must be set

Pass

1

Transmute - Mavennet

Presentations Exchange

Complete Exchange

must return `200 Success` status

Fail

expected response to have status code 200 but got 400

0

Transmute - Mavennet

Presentations Exchange

Complete Exchange

verification response should be 'true'

Fail

expected undefined to be true

0

Mavennet - Transmute

OAuth Presentations Exchange

Holder gets Verifier's Token

must return `200 Success` status

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must include non-empty access_token

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Holder gets Verifier's Token

response body must represent `Bearer` token

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Holder gets Verifier's Token

returned token must expire in the future

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Holder gets Verifier's Token

`access_token` persisted to collectionVariables

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Get Verifier Organization DIDs

Status code is 200

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Get Verifier Organization DIDs

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Presentation

must return `200 Success` status

Pass

1

Mavennet - Transmute

OAuth Presentations Exchange

Presentation

Content-Type header is application/json

Pass

1

mesur.io

Credentials Issue

Get Access Token

must return `200 Success` status

Pass

1

mesur.io

Credentials Issue

Get Access Token

response body must include non-empty access_token

Pass

1

mesur.io

Credentials Issue

Get Access Token

response body must represent `Bearer` token

Pass

1

mesur.io

Credentials Issue

Get Access Token

returned token must expire in the future

Pass

1

mesur.io

Credentials Issue

Get Access Token

`access_token` persisted to collectionVariables

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

`access_token` collection variable must be set

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

Status code is 200

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

must include valid JSON response body

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

didDocument must be present in response body

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

verification method controller must match did subject

Pass

1

mesur.io

Credentials Issue

Get Organization DIDs

`credential_issuer_id` persisted to collectionVariables

Pass

1

mesur.io

Credentials Issue

Issue Credential

`access_token` collection variable must be set

Pass

1

mesur.io

Credentials Issue

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io

Credentials Issue

Issue Credential

must return `201 Created` status

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

response body must include non-empty access_token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

response body must represent `Bearer` token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

returned token must expire in the future

Pass

1

mesur.io

Presentations Verify

Get Access Token (Issuer)

`access_token` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

response body must include non-empty access_token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

response body must represent `Bearer` token

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

returned token must expire in the future

Pass

1

mesur.io

Presentations Verify

Get Access Token (Verifier)

`access_token` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

Status code is 200

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

must include valid JSON response body

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

didDocument must be present in response body

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

verification method controller must match did subject

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Issuer)

`credential_issuer_id` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Verifier)

Status code is 200

Pass

1

mesur.io

Presentations Verify

Get Organization DIDs (Verifier)

Issuer makes unauthenticated discovery of verifiers exchange endpoint. `verifier_exchange_endpoint` is persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Issue Credential

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Issue Credential

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Issue Credential

must return `201 Created` status

Pass

1

mesur.io

Presentations Verify

Issue Credential

`verifiable_credential` persisted to collectionVariables

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

`verifier_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

must return `200 Success` status

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

response must include 'domain' property

Pass

1

mesur.io

Presentations Verify

Initiate Exchange

response must include 'challenge' property

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`issuer_access_token` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`credential_issuer_id` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`verifiable_credential` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`domain` collection variable must be set

Pass

1

mesur.io

Presentations Verify

Sign Presentation

`challenge` collection variable must be set