Cloud Hardware Specifications

On This Page

Overview

This document lists the hardware specifications for deployment of version 2.8.0 of the Iguazio Data Science Platform (“the platform”) in these cloud environments:

Note
  • Provisioning of the servers is handled automatically by the platform provisioning tool. Do not attempt to provision the servers manually prior to the deployment.
  • All capacity calculations in the hardware specifications are performed using the base-10 (decimal) number system. For example, 1 TB = 1,000,000,000,000 bytes.

Hardware Configurations

The platform is available in two configurations, which differ in a variety of aspects, including the performance capacity, footprint, storage size, and scale capabilities:

Development Kit
A single data-node and single application-node cluster implementation. This configuration is designed mainly for evaluation trials and doesn’t include high availability (HA) or performance testing.
Operational Cluster
A scalable cluster implementation that is composed of multiple data and application nodes. This configuration was designed to achieve superior performance that enables real-time execution of analytics, machine-learning (ML), and artificial-intelligence (AI) applications in a production pipeline. The minimum requirement for HA support is three data nodes and three application nodes.

Amazon Web Services (AWS) Specifications

The following specifications are applicable when deploying the platform in the Amazon Web Services (AWS) cloud; for details, refer to the AWS documentation:

Note
AWS platform deployments also require an Elastic IP address. For more information, see the AWS documentation.

AWS Data-Node Specifications

Data nodes in platform AWS cloud deployments must use one of the following EC2 instance types and fulfill the related specifications; choose the type that best fits your requirements:

  • i3.4xlarge

    Component Specification
    vCPUs 16
    Memory 122 GiB
    Data disks (local storage) 2 x 1.9 TB NVMe SSD
    OS boot disk (EBS volume) General Purpose SSD (gp2); 250 GB (minimum)
    Usable storage capacity Single node (Development Cluster) — 2.5 TB; 3 nodes (Operational Cluster) — 4 TB
  • i3.8xlarge

    Component Specification
    vCPUs 32
    Memory 244 GiB
    Data disks (local storage) 4 x 1.9 TB NVMe SSD
    OS boot disk (EBS) General Purpose SSD (gp2); 250 GB (minimum)
    Usable storage capacity 3 nodes (Operational Cluster) — 9 TB

AWS Application-Node Specifications

Application nodes in platform AWS cloud deployments must use one of the following EC2 instance types; choose the type that best fits your requirements. For specification details, refer to the AWS documentation.

Note
All of the supported application-node configurations also require a 400 GB General Purpose SSD (gp2) OS boot disk (EBS volume).
CPU-Based Instances
  • m5.4xlarge (default configuration)
  • m5.8xlarge
  • m5.12xlarge
  • m5.16xlarge
  • m5.24xlarge

GPU-Based Instances

  • p3.2xlarge (trial only)
  • p3.8xlarge
  • p3.16xlarge
  • g4dn.12xlarge
  • g4dn.16xlarge

Microsoft Azure Specifications

The following specifications are applicable when deploying the platform in the Microsoft Azure cloud; for details, refer to the Azure documentation:

Note
Azure platform deployments also require a static public IP address. For more information, see the Azure documentation.

Azure Data-Node Specifications

Data nodes in platform Azure cloud deployments must fulfill the following hardware specification requirements:

Component Specification
Instance type Standard_L16s_v2
vCPUs 16
Memory 128 GB
Data disks (local storage) 2 x 1.9 TB NVMe SSD
OS boot disk (Azure managed disk) Premium SSD; 256 GB (minimum)
Usable storage capacity Single node (Development Cluster) — 2.5 TB; 3 nodes (Operational Cluster) — 4 TB

Azure Application-Node Specifications

Application nodes in platform Azure cloud deployments must use one of the following instance types; choose the type that best fits your requirements. For specification details for each type, refer to the Azure documentation.

Note
All of the supported application-node configurations also require a 400 GB premium-SSD OS boot disk (Azure managed disk).
  • Standard_D16s_v3 (default configuration)
  • Standard_D32s_v3
  • Standard_D48s_v3
  • Standard_D64s_v3

See Also