NVMe™ Flash as a Service is happening now. Are you on board?

NVMe™ Flash as a Service is happening now. Are you on board?

Kumoscale logo

Disaggregated NVMe-oF™ Storage Management for Data Centers

What is KumoScale™?

KumoScale™ software implements the NVMe™ over Fabrics (NVMe-oF™). By which the product provides a fast, networked block storage service between initiator and target through high speed network connection.The software runs on storage node populated with NVMe™ SSD and realizes storage disaggregation. KumoScale software supports both RDMA and NVMe over TCP for network transport and that provides shared, clustered storage pool to enable logical split by NVMe namespace on a bunch of SSDs. Comparing to Direct Attached Storage(DAS), KumoScale volume management capability gives much flexibility to control big storage pool that consists of large individual SSDs.

 

KIOXIA NVMe-oF Storage Solutions using NVMe SSDs and KumoScale Software
What is KumoScale™?

KumoScale™ 3.20 Highlights

Additional Deployment Options:
In addition to the KumoScale software’s streamlined appliance install, KumoScale software version 3.20 adds an option to deploy on generally available commercial operating systems. For large data centers, storage infrastructure of necessity tightly integrated with variety of sub systems such as provisioning, monitoring, telemetry and network. KumoScale “managed mode” enables complete flexibility for engineering and security administrators to configure, integrate and control the storage layer OS environment while KumoScale software “appliance mode” provides simpler installation and automated deployment with reduced deployment complexity for small & medium enterprise customers but with more limited OS configurability.

NVIDIA GPUDirect® Storage Support:
Version 3.20 adds support for NVIDIA GPUDirect Storage. GPUDirect Storage is a technology introduced in NVIDIA Kepler™ GPUs and NVIDIA CUDA™ 5.0 which enables a direct path for data exchange between the GPU and a third-party peer device using standard features of PCI Express®. Examples of third-party devices include network interfaces, video acquisition devices, and storage adapters. KumoScale software behaves as a storage adapter to GPUDirect Storage.

OpenID® Connect™ Support:
Version 3.20 adds support for third-party OpenID Connect 1.0. OpenID Connect is an identity layer on top of the OAuth 2.0 protocol that allows clients to verify the identity of users and session based on the authentication performed by an Authorization Server for service account permissions. KumoScale software support for OpenID Connect simplifies security integration into CSP data center environments.

Improve storage utilization and better flexibility to manage pooled fast NVMe™ SSD

Capacity and performance of latest PCIe® Gen 4 NVMe SSD is exploded than that of PCIe Gen 3 and are far more than a single compute node can consume. Sharing SSDs over different user applications and servers/VMs are an urgent need. Until NVMe-oF™ is introduced and widely spread, networked storage has been either slow or expensive, or both. It is no longer true with NVMe-oF™. KumoScale™ software increases storage utilization by sharing SSD, dividing shared SSD by NVMe name space and adds more flexibility to provision the right amount of capacity from the pool through the software at the performance of NVMe™ SSD.

Supports RDMA and NVMe over TCP protocol

KumoScale software supports RDMA and TCP transport protocol. If you seek faster and low latency storage service by KumoScale software, RoCEv2(RDMA over Converged Ethenet) should fit. On the other hand if you prefer network compatibility in existing data center network, TCP/IP could be used for KumoScale software. For network card validated with latest KumoScale software please refer to HCL(Hardware Compatibility List).

Adapting customer provisioning and telemetry architecture

  • For OpenStack®, KumoScale™ software provides OpenStack Cynder® driver supporting Wallaby release and beyond.

  • For Kubernetes® ,containerized applications are connected to KumoScale™ storage node by KumoScale Container Storage Interface (CSI) driver.

  • For baremetal environment, Ansible™ playbooks or other popular automation tools may be used for deployment automation and provisioning of storage to compute nodes.

  • For telemetry integration, KumoScale™ software provides interface to enable push/pull data exchange for existing telemetry (time series metrics) and logging (asynchronous events) infrastructure.

Data Protection and High Availability

Data Protection -Cross Domain Data Replication (CDDR)-

KumoScale™ software provides data protection via a technique called Cross Domain Data Replication (CDDR).  CDDR creates multiple replicas of a logical volume on top of pooled SSDs, and maps them to storage nodes located in different failure domains. The replication is based on initiator and replica can be placed across 2nd or 3rd KumoScale™ storage node. For replication KumoScale agent runs on initiator to check volume availability. Once the agent  detects volume falure whatever reasons, the volume is automatically reconnected to replicated volume on different storage node. After resilient volume comes back from the failure, all data is rebuild to fresh resilient volume automatically.

 

> Delivering Next-Generation NVMe-oF™ Data Resilience in the Data Center

 

Ensure High Availability

KumoScale™ storage node supports L3 BGP(Border Gate Protocol) so that network path is automatically rerouted to available network path based on predefined optimal routing table when there is network connection issue.

Use cases

Typical application and use case

  • High performance storage service for cloud-native application
  • Persistent storage service for OpenStack™  and Kubernetes®
  • High speed block storage service for HPC applications and other scentific application
  • Backend storage for AI/ML/DL applications
KumoScale™ software should work with generally available NVMe-oF™ initiator software as well as standard based NVMe SSDs. Proprietary software driver or hardware are not necessary.

KumoScale™ architecture

The KumoScale™ suite consists of multiple components.

 

KumoScale architecture
  Description
KumoScale™ Storage Node KumoScale™ Storage Node accepts NVMe-oF™ I/O commands directed at virtual volumes and translates them into NVMe™ commands directed at the physical SSDs installed in the storage node.
KumoScale™ Provisioner KumoScale™ Provisioner is a distributed, resilient service that tracks the fleet of SSDs and KumoScale™ storage nodes. It handles the mapping of user volumes to nodes and to physical drives.
KumoScale™ CSI driver KumoScale™ CSI driver is an implementation of the Container Storage Interface– a standards-based method for connecting storage to orchestrated containers. It provides an API translation between an orchestration system and KumoScale™ Provisioner for containerized deployments.
KumoScale™ Agent The agent is a health-monitoring daemon that detects and repairs volume connections that become unavailable for any reason.
KumoScale™ Cinder driver The KumoScale™ Cinder driver enables the OpenStack™ environment to seamlessly carve out storage from KumoScale™ storage and consume it by connecting it to VMs and containers.
KumoScale™ Analytics Service KumoScale™ Analytics Service collects and analyzes telemetry information from the storage nodes for the purpose of optimized data placement.

KumoScale™ Platform Requirements

KumoScale™software has been tested on both bare metal, OpenStack and Kubernetes® deployments on a wide range of industry standard servers. Any NVMe-oF™ compliant initiator can be used, including Linux® kernel version 4.8 or later. Supported platform is show below.

 

 

Components Minimal Requirement
Memory 64GB DDR4
System Disk 2 x 128GB SATA DOM
NIC MCX516A-CCAT or MCX545A-CCAN ConnectX-5 EN network interface card, 100GbE dual/single port QSFP28, PCIe®3.0 x16 ROHS R6 MCX416A-CCAT ConnectX-4 EN network interface card, 100GbE dual/single port QSFP28, PCIe®3.0 x16 ROHS R6 Solarflare Communications XtremeScale SFC9250 10/25/40/50/100G Ethernet Controller  
Power Supply Dual power supply, hot swappable
Management Interface A dedicated management port is optional. KumoScale™ can use the data port for management traffic, or it can utilize a dedicated management port.
KumoScale™ Provisioner KumoScale™ Provisioner does not require any additional servers nor a container.

Documents

Inquiries regarding KumoScale

Please contact us using the inquiry form.

* Before submitting an inquiry, please carefully read the important considerations and accept it, then select "KumoScale" in the "Products" drop-down menu of the inquiry form.

*: 15us latency addition at 4KB read compared to DAS. Measured by KIOXIA in June 2020 using measurement tool specified by KIOXIA. 15us is the difference of 4KB read latency between DAS and NVMe-oF™ storage configuration on the same hardware.

  • NVMe and NVMe-oF are trademarks of NVM Express, Inc.
  • PCIe is a registered trademark of PCI-SIG.
  • Kubernetes is a registered trademark of The Linux Foundation in the United States and/or other countries.
  • Ansible is a registered trademark of Red Hat, Inc. in the United States and other countries.
  • Linux is a registered trademark of Linus Torvalds in the U.S. and other countries.
  • The OpenStack Word Mark is a registered trademark of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
  • Prometheus is a registered trademark of The Linux Foundation.
  • Grafana and Loki are trademarks or registered trademarks of Grafana Labs, Inc.
  • All company names, product names and service names may be trademarks of their respective companies.