Certification Guidelines

5GASP defines a V-Model Certification Workflow as shown in Figure 1. Any NetApp Applicant should follow this workflow in the certification process. After the published 5GASP NetApp certificate, the NetApp use case stakeholders (they may not be the numbers of 5GASP project) could validate the NetApp on the Field of their target 5G facility that may be a testbed or a commercial Cloud.

Figure 1 – 5GASP NetApp V-Model Certification Workflow

GASP NetApp Certification Application Process

Certification Application Requesting

The NetApp Applicant needs to send the complete application form to all@5GASP.eu to start the 5GASP NetApp certification workflow. The NetApp application form can be submitted at any time. The submitted application is received by the 5GASP Project Coordination Team (PCT) and then forwarded to the 5GASP Technical Committee (TC) to handle the review. The approval process is handled by 5GASP PCT. The application form is defined in Annex A, and it contains among others the following information:

  • General information about NetApp, incl. NetApp name, NetApp description, vendor name, vendor location (address), and primary contacts
  • Information about the general requirements

5GASP PCT should check the completeness of the mandatory information in the application form before forwarding it to 5GASP TC.

Certification Application Reviewing and Evaluation

Once 5GASP PCT forwards the application form to 5GASP TC, 5GASP TC should assign each application to one reviewer, one Work Package leader, or the technical lead in one Work Package. The applications should be equally distributed to the reviewers.

The reviewer is selected from the list of reviewers, which 5GASP TC maintains. The reviewer list is accessible to all 5GASP members and contributors, and it contains information about the reviewers such as name, e-mail address, phone number, company affiliation, and assigned applications. Any representative of 5GASP members or contributors can be registered in or unregistered from the list of reviewers at his or her request at any time. 5GASP TC can re-select the assigned reviewer if needed.

The assigned reviewer checks the application form to ensure it is complete and in compliance with the requirements. If needed, the reviewer may request the applicant to provide additional information for any missing or unclear information in the application form. The reviewer is designated as the point of contact for all communications with the NetApp Applicant. The reviewer helps the NetApp Applicant to complete the application form. The reviewer guarantees completeness and compliance with the application form. The reviewer does not approve or evaluate the application.

Once the application is completed, the assigned reviewer needs to inform 5GASP TC to schedule a review meeting where the applicant will present and defend the application to 5GASP members. If needed, 5GASP TC can also try to coordinate the application with other NetApps to avoid fragmentation, overlap, etc.

5GASP TC should collect the preliminary favorable or unfavorable recommendations during the review meeting. 5GASP TC should provide the recommendations to the NetApp Applicant after the review meeting. 5GASP TC should also add the recommendations and summary of the review meeting to the NetApp application form. NetApp Applicant has the rights to provide their statements and any necessary information or correction if the unfavorable recommendation is made. The applicant statements and corrections are also added to the application form.

It needs to be noted that the application cannot be approved or rejected by 5GASP TC.

Certification Application Approval

The completed application form with 5GASP TC recommendations and with NetApp Applicant statements, if provided, shall be sent back to the 5GASP PCT for further approvals. The application is handled as a process document and not as a technical specification. NetApp Applicant needs to address any question or inquiry raised during this official approval process.

After passing the 5GASP approval process, the NetApp Applicant must sign the 5GASP Certification Agreement with 5GASP project. The qualification process is considered completed after the agreement is signed.

It needs to be noted that 5GASP PCT can terminate the agreement without cause at any time with prior written notice.

5GASP Certification Environment Preparation

After the application process, NetApp is under certification in 5GASP. The NetApp Applicant should involve NetApp Developers in the certification environment preparation process. In this process, NetApp, Facilities, and Test tools would be ready for the coming processes.

NetApp Developments and Adaptations

NetApp Developers should start the developments of the NetApp under certification according to the approved requirements in the application form if NetApp is not fully developed, or NetApp Developers should make the adaptations if NetApp has been fully developed.

5GASP TC should schedule a set of joint meetings where NetApp Developers will present and report the status of the developments or the adaptations. If needed, 5GASP TC can also try to coordinate the NetApp Developers with other NetApps to avoid fragmentation, overlap, etc.

5GASP TC should collect the preliminary favorable or unfavorable recommendations during the joint meetings. 5GASP TC should provide the recommendations to NetApp Developers after each meeting. 5GASP TC should also support NetApp Developers on the recommendations during their developments or adaptations.

5GASP TC should approve NetApp for the coming processes after all the recommendations are included in NetApp. 5GASP TC should also inform 5GASP PCT for the application approval.

5GASP Facilities Adaptations

Usually, the NetApp under certification should be validated in any 5GASP facility. The Facility Administrator of all 5GASP facilities should make the adaptations according to the approved requirements in the NetApp application form.

If the NetApp under certification recommends one dedicated 5GASP facility, the Facility Administrator of the target 5GASP facility should start the adaptations according to the approved requirements in the NetApp application form.

Facility administrators should present and report the status of the adaptations in the set of joint meetings that 5GASP TC schedules with NetApp Developers.

5GASP TC should collect the preliminary favorable or unfavorable recommendations during the joint meetings. 5GASP TC should provide the recommendations to Facility administrators after each meeting. 5GASP TC should also support Facility administrators on the recommendations during the adaptations.

5GASP TC should approve Facility/Facilities for the coming processes after all the recommendations are included in the Facility/Facilities.

5GASP Tools Adaptations

Usually, the NetApp under certification should be validated under the set of the open source tools in Chapter 3. Tool Administrator of all 5GASP tools should make the adaptation according to the approved requirements in the NetApp application form.

If the NetApp under certification recommends one dedicated tool, the NetApp Developers should share the exact reasons and the tool requirements. 5GASP TC should then schedule a joint meeting with all the Tool Administrators. Tool Administrators should select an existing open source tool if possible or create a new open source tool.

Tool administrators should present and report the status of the adaptations in the set of joint meetings that 5GASP TC schedules with NetApp Developers and Facility administrators.

5GASP TC should collect the preliminary favorable or unfavorable recommendations during the joint meetings. 5GASP TC should provide the recommendations to Tool administrators after each meeting. 5GASP TC should also support Tool administrators on the recommendations during the adaptations.

5GASP TC should approve tools for the coming processes after all the recommendations are included in the tools.

5GASP NetApp Onboarding Process

In this process, NetApp under certification should be onboarded to the tailored (per Vertical) 5GASP facilities via the 5GASP platform.

NetApp Onboarding to 5GASP platform

NetApp under certification should be onboarded to the 5GASP platform for the Pre-Deployment Validation as shown in Figure 2.

Figure 2 – NetApp onboarding to 5GASP platform

NetApp Onboarding to tailored 5GASP Facilities

After the Pre-Deployment Validation, NetApp under certification should be onboarded to the tailored 5GASP Facility as shown in Figure 3.

If the NetApp under certification recommends being validated in more than one facility, the NetApp should be onboarded to the facilities one by one.

Figure 3 – NetApp onboarding to 5GASP Facility

5GASP NetApp Validation Process

In this process, NetApp under certification should be tested in 5GASP Facilities. If the NetApp under certification recommends being validated in more than one facility, the NetApp should be tested in the facilities one by one.

NetApp Testing Execution

5GASP defines a test repository per facility that contains the pre-configured tests. The test tools will use this repository for the tests and then store the test logs and results in this repository.

Below is an example of Jenkins with Robot framework in Figure 4.

Figure 4 – Example of Jenkins with Robot framework

It needs to be noted that there would be multiple rounds of testing execution for the NetApp under certification.

The details of the tools will be defined in the next coming version 1.0.

NetApp Testing Results Review

The test logs and results are stored in the test repository per facility. During the test execution, the notification messages would be sent via Slack to NetApp Developers in the case that one test case fail. After one round of testing execution of all the test cases, NetApp Tester should schedule a review meeting for the testing results where NetApp Developers, Facility Administrator, and Tool Administrator will present. If needed, NetApp Tester can also try to coordinate the NetApp Developers with other NetApps to avoid fragmentation, overlap, etc.

NetApp Tester should collect the preliminary favorable or unfavorable recommendations during the joint meeting. NetApp Tester should provide the recommendations to NetApp Developers, Facility Administrator, and Tool Administrator. NetApp Tester should also support the recommendations if some adaptations are needed in NetApp under certification, facilities, and tools.

NetApp Testing Results Acceptance

After all the recommendations are included in the NetApp under certification, the facilities, and the tools, the NetApp Tester should execute all the test cases again for the results acceptance.

NetApp Tester should schedule an acceptance meeting for the testing results where 5GASP TC, NetApp Developers, Facility Administrator, and Tool Administrator will present.

It needs to be noted that not NetApp Tester but only 5GASP TC could approve the acceptance after the acceptance meeting.

The details of the acceptance criteria will be defined in the coming version 1.0.

5GASP NetApp Publish Process

In this process, NetApp is already be certificated in 5GASP. 5GASP NetApp Certificate should be online published in the 5GASP marketplace.

The definition of who can and how to issue a 5GASP certificate will be under further discussion. The details of the definition will be in the future version.

Download the certification guideline