Skip to content

Test Scenarios Description

Emmanuel Mathot edited this page Nov 11, 2020 · 9 revisions

The Test Suite is organized around a series of Test Scenarios chaining a set of Test Cases.

Test Scenarios

The Test Scenarios are designed as a sequence of basic Test Cases covering one or several functionalities of the Target Site in order to reproduce a typical user operation on the target site.

The following table describes each Test Scenario vided in 2 groups:

  • Local Test Scenarios are locally executed measuring metrics of the various functions from the local Test Site towards the Target Site. They are ran using cdab-client.
  • Remote Test Scenarios are remotely executed on a virtual machines within the service providers' cloud infrastructure (when available) measuring metrics of the various functions directy within the Target Site. They are ran using cdab-remote-client.

Local Test Scenarios

Scenario ID Title Test case sequence
TS01 Simple data search and single download TC101 → TC201 → TC301
TS02 Complex data search and bulk download TC101 → TC202 → TC302
TS03 Systematic periodic data search and related remote data download TC203 → TC303
TS04 Offline data download TC204 → TC304
TS05 Data Coverage Analysis TC501 → TC502
TS06 Data Latency Analysis TC601 → TC602
TS07 Storage Upload and Download Performance TC701 → TC702

Remote Test Scenarios

Scenario ID Title Test cases
TS11 Cloud services simple local data search and single local download on single virtual machines TC411 (→ #TC211 → #TC311)
TS12 Cloud services complex local data search and multiple local download on multiple virtual machines #TC412 (→ #TC212 → #TC312)
TS13 Cloud services simple local data search, download and simple processing of downloaded data TC413
TS15 Cloud services processing of specific workflows TC415 (→ TC416)

Test Scenario 15 (TS15) covers several end-to-end scenarios which are independent of each other.

Test cases

The following sections give a short overview about the simple test cases and how they can be configured and run.

TC101: Service Reachability

TC201: Basic query

TC202: Complex query (geo-time filter)

TC203: Specific query (handle multiple results pages)

TC204: Offline data query

TC211: Basic query from cloud services

TC212: Complex query from cloud services

TC301: Single remote online download

TC302: Multiple remote online download

TC303: Remote Bulk download

TC304: Remote Bulk download

TC311: Single remote online download from cloud services

TC312: Multiple remote online download from cloud services

TC411: Cloud Services Single Virtual Machine Provisioning

TC412: Cloud Services Multiple Virtual Machine Provisioning

TC413: Cloud Services Virtual Machine Provisioning for Processing

TC415: Automated Processing of End-to-End Scenario of Specific Applications

TC501: Catalogue Coverage

TC502: Local Data Coverage

TC503: Data Offer Consistency

TC601: Data Operational Latency Analysis [Time Critical]

TC602: Data Availability Latency Analysis

TC701: Data Storage Upload Analysis

TC702: Data Storage Download Analysis

Clone this wiki locally