Monday , July 16 2018

Implementation and Evaluation of VXLAN Gateway-based
Data Center Network Virtualization

Junji KINOSHITA1*, Kazuhiro MAEDA1, Hitoshi YABUSAKI1, Ken AKUNE1, Motohide NOUMI2, Norihisa KOMODA3

1 Center for Technology Innovation, Information and Telecommunications,
Hitachi Ltd.,

292 Yoshida-cho, Totsuka-ku, Yokohama, Kanagawa, 244-0817, Japan

* Corresponding author

2 Alaxala Networks Corp.,
1-1-2, Kashimada, Kawasaki, Kanagawa, 212-0058, Japan
3 Codesolution, K.K.,
1-2-11-9F, Edobori, Nishi-ku, Osaka, 550-0002, Japan

Abstract: To achieve platform-independent network virtualization among multiple service infrastructures in service providers’ data centers, we propose hardware gateway-based data center network virtualization architecture where we place a gateway on each service infrastructure and inter-connect them using overlay network virtualization. By considering a type of VXLAN gateway for this architecture, integration method with server virtualization environment and management mechanism for virtual network among service infrastructures, we propose the implementation method of our proposed architecture. We evaluated and confirmed feasibility of the proposed architecture based on our prototype. We also confirmed that the proposed architecture does not have any performance issue on our network throughput measurement evaluation.

Keywords: cloud, data center, network virtualization, VXLAN, gateway.

>>Full text
Junji KINOSHITA*, Kazuhiro MAEDA, Hitoshi YABUSAKI, Ken AKUNE, Motohide NOUMI, Norihisa KOMODA, Implementation and Evaluation of VXLAN Gateway-based Data Center Network Virtualization, Studies in Informatics and Control, ISSN 1220-1766, vol. 25(3), pp. 313-322, 2016.

1. Introduction

As more and more enterprise companies and organizations have been using IT services like cloud computing, service providers have been facing challenges to achieve higher resource utilization and scalability in their data centers to become competitive in the market.

However, their data centers are becoming “siloed” environment where resources are physically divided into service infrastructures (silos) rather than a single flat resource pool. This is because scalability limitations of components used in those silos, like specification maximums of server virtualization software, network and storage system. As a result, service providers are suffering from problems like resource shortage in a silo, migration among silos and integration among silos.

To solve these problems, Layer 2 network extension technologies have been tried in the last several years so that service users’ network can be expanded among different silos. But those solutions come with vendor lock-in or require replacement of whole inter-silo network.

We proposed a new architecture[1] that connects silos using VXLAN[2] (Virtual Extensible LAN) gateways to solve problems and also avoid vendor lock-in. We discuss implementation and evaluate feasibility of our approach. We also confirm there is no performance issue caused by this approach.


  1. KINOSHITA, J., K. MAEDA, H. YABUSAKI, K. AKUNE, N. KOMODA, Realization of VXLAN Gateway-based Data Center Network Virtualization, IIAI AAI EAIS, 2016.
  2. Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks, rfc7348, IETF, RFC7348, 2014.
  1. vSphere,, last visited 2016-01-13.
  2. Hyper-V, virtualization.aspx, last visited 2016-01-13.
  3. OpenStack,, last visited 2016-01-13.
  4. 802.1Q – Virtual LANs, http://www., IEEE, last visited 2016-01-13.
  5. PFAFF, B., J. PETTIT, T. KOPENEN, K. AMIDON, M. CASADO, S. SHENKER, Extending Networking into the Virtualization Layer, ACM SIGCOMM Workshop on Hot Topics in Networking (HotNets), 2009.
  6. NVGRE: Network Virtualization Using Generic Routing Encapsulation,, IETF, RFC7637, 2015.
  7. A Stateless Transport Tunneling Protocol for Network Virtualization (STT),, IETF, 2014 last visited 2016-01-13
  8. Security Architecture for the Internet Protocol,, IETF, RFC4301, 2005.
  9. The Secure Sockets Layer (SSL) Protocol Version 3.0,, IETF, RFC6101, 2011.
  10. 802.1ah – Provider Backbone Bridges,, IEEE, last visited 2016-01-13
  11. 802.1ad – Provider Bridges, http://www., IEEE, last visited 2016-01-13
  12. Multiprotocol Label Switching Architecture,” rfc3031, IETF, RFC3031, 2001.
  13. Multitenancy Options in Brocade VCS Fabrics,, Brocade, last visited 2016-01-13.
  14. Cisco Application Centric Infrastructure Fundamentals,
    aci/apic/sw/1-x/aci-fundamentals/b_ACI-Fundament als/b_ACI_Fundamentals_BigBook_chapter_0100.html, last visited 2016-08-13.
  15. McKEOWN, N. T. ANDERSON, H. BALAKRISHNAN, G. PARULKAR, L. PETERSON, J. REXFORD, S. SHENKER, J. TURNER, OpenFlow: Enabling Innovation in Campus Networks, in ACM SIGCOMM Computer Communication Review, vol. 38(2), 2008, pp. 69-74.
  16. LIM, C.-G., S.-M. PAHK, T.-I. KIM, J.-H. LEE, Design and Implementation of Hardware Accelerated VTEP in Datacentre Networks, Advanced Communication Tech. (ICACT), 2015.
  17. GILL, P., N. JAIN, N. NAGAPPAN, Understanding Network Failures in Data Centers: Measurement, Analysis, and Implications, ACM SIGCOMM 11 Proceedings of the ACM SIGCOMM 2011 conference, 2011, pp. 350-361.
  18. SINGH, A., J. ONG, A. AGARWAL, G. ANDERSON, A. ARMISTEAD, R. BANNON, S. BOVING, G. DESAI, B. FELDERMAN, P. GERMANO, A. KANAGALA, J. PROVOST, J. SIMMONS, E. TANDA, J. WANDERER, U. HÖLZLE, S. STUART, A. VAHDAT, Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google’s Datacenter Network, ACM SIGCOMM 15 of the 2015 ACM Conference on Special Interest Group on Data Communication, 2015, pp. 183-197.