BAcKFLiP

Benchmarking network functions to collect the world's largest NFV performance dataset

Catalogue

About

In the next generation of networks (you may know it as “5G”) many network components will be moved to the cloud to improve the flexibility and manageability of our networks. In this scenario, called network function virtualisation (NFV), virtualised network functions (VNFs), like firewalls or intrusion detection systems, which are installed in virtual machines or containers ([Docker](https://www.docker.com/)) and can be deployed on-demand on cloud infrastructures, such as [OpenStack](https://www.openstack.org/) or [Kubernets](https://kubernetes.io/). These VNFs can then be connected (chained) to form more complex network services. This simplifies the development of novel network services, because deployments can be fully automated and be done in minutes instead of days, as required by legacy, hardware-based network functions.

To deploy such VNFs and services, it has to be decided how many resources, like vCPU cores or memory, have to be assigned to the VNFs to meet the expected performance goals. Those resource dimensioning decisions can, for example, be based on so-called VNF performance profiles (VNF-PP) [1], [2]. VNF-PPs can be generated by (offline) profiling/benchmarking procedures [1]. They describe the relationship between assigned resources and various performance metrics achieved by single VNFs or chained services. These VNF-PPs can then serve (i) as inputs to orchestration systems (e.g., [OpenSource MANO](https://osm.etsi.org/)), (ii) utilised by placement and scaling optimisation algorithms [3], or (iii) be used for further (offline) data analyses, e.g., to find performance issues.

However, the availability of such VNF-PP datasets is still limited to few examples. Because of this, the research community is seeking for more public datasets, based on real-world measurements, to serve as the basis for further research and the development of new tools that make use of VNF-PPs. The goal of this project group is to collect those datasets for a diverse collection of different VNFs and network services. To perform and automate this collection process, existing measurement tools, like the [5GTANGO NFV benchmarking tool](https://github.com/sonata-nfv/tng-sdk-benchmark), will be used and extended within this project. Finally, the collected datasets need to be polished and analysed before they are made available for the research community, i.e., through one or more scientific publications.

The goal of this project group is to collect those datasets for a diverse collection of different VNFs and network services. To perform and automate this collection process, existing measurement tools, like the 5GTANGO NFV benchmarking tool, will be used and extended within this project. Finally, the collected datasets need to be polished and analysed before they are made available for the research community.

Goal

  • Identify and analyse candidate VNFs and network service projects to be benchmarked e.g. OpenIMS
  • Setup a benchmarking testbed and integrate it with existing NFV benchmarking solutions
  • Design and run a first set of benchmarking experiments using the existing toolchain
  • Integrate VNFs and network services to be executed and tested on the benchmarking testbed
  • Extend and improve the 5GTANGO benchmarking tool to be able work with one of the most prominent NFV MANO solutions in the telecom industry: OpenSource MANO
  • Run a second set of benchmarking experiments using your extended toolchain
  • Document all experiment setups and outcomes
  • Analyse the outcomes and polish the data for publication
Responsive image

References:

Supervisors

Prof. Dr. Holger Karl
Dr. Manuel Peuster
Stefan Schneider

Project Members

Abdul Ahad Ayaz
Anush Shankar
Arif Hossen
Arjun Parab
Avi Mehenwal
Bhuvan Sharma
Deepak Bhardwaj Anantha Rao
Harshita Puri
Haydar Qarawlus
Ishwariya Raveendran
Suganthi Jaganathan

Contact

Project Group Backflip

pg-backflip@lists.uni-paderborn.de