Overview of Oracle Cloud VMware Solution

Use Oracle Cloud VMware Solution to create and manage VMware enabled software-defined data centers (SDDCs) in OCI.

Solution Highlights

Oracle Cloud Infrastructure VMware Solution gives you full access to the features of a VMware SDDC, along with the following benefits:

  • High availability: All VMware components are distributed across different fault domains within the OCI region’s availability domains.
  • Scalability: Using dense shapes, you can start with 3 ESXi hosts and scale up to 64 hosts in a single SDDC. If you use standard shapes, you can start with 3 ESXi hosts and scale up to 32 hosts in a single ESXi cluster within the SDDC.
  • Define clusters: Define up to 6 vSphere clusters in an SDDC. Use clusters to segregate workloads and provide for future expansion.
  • Lift and shift: Migration of on-premises VMware workloads to a VMware Solution SDDC is seamless.
  • Full integration: Because the SDDC resides in a virtual cloud network (VCN), it can be configured to communicate with other OCI resources such as compute instances, DB systems and Autonomous Databases, and so on.
  • Manageability: The OCI Console provides workflows to help SDDC creation and networking configuration.
  • Layer 2 networking: SDDCs are configured with VLANs, which support applications that need layer 2 networking to run in the public cloud.
Note

Bring your own hypervisor deployment of ESXi on bare metal compute instances isn't supported.

SDDC Details

There are two types of SDDC configuration available: a multi host SDDC, and a single host SDDC used for testing and short-term development.

Multi Host SDDCs

Multi host SDDCs provide high availability and you can use the full range of VMware Solution features to migrate and support production workloads.

You can create a multi host SDDC with up to 6 clusters containing up to 64 hosts. Each cluster can contain many ESXi hosts to support the specific workload requirements of the cluster. SDDCs require a unified management cluster to host the VMware management components, which is created as part of the SDDC setup workflow. See About the VMware Software for more information.

Any clusters you create after the unified management cluster are workload clusters, and don't contain any management components. The number of ESXi hosts you can create in a workload cluster depends on the compute shape you select for the cluster. See Supported Shapes for more information.

Each cluster in the SDDC has its own networking resources, which you define when you create the cluster. This lets you configure an SDDC that can meet segregated workload requirements. Workload mobility between clusters is allowed by default, but you can configure the Network Security Group (NSG) settings for each cluster VLAN to restrict workload mobility. See VLANs for more information.

When you create a cluster, you define a shape to use for the provisioning of ESXi hosts in the cluster. All the hosts are provisioned using that shape. After the cluster is provisioned, you can add hosts of different shapes, as long as all shapes in the cluster have the same processor vendor. The VMware software version is defined for the whole SDDC, but you can select different minor versions for each cluster. See Defining Clusters for more information.

When you provision an SDDC and define its initial clusters, you select a pricing interval for each cluster. The pricing interval for a cluster applies to all hosts in the cluster. Different clusters can have different pricing intervals. Any clusters you add to the SDDC after initial provisioning can also have its own selected pricing interval. So you can have several clusters, all with different pricing intervals, and different shapes within a cluster. See Billing Options for more information.

Single Host SDDCs

Single host SDDCs are used for testing and short-term development. A single host SDDC consists of a single unified management cluster with a single EXSi host. The host is created using a OCI bare metal dense shape instance. A single host SDDC is created with a subnet and VLANs in an OCI VCN.

Use cases for a single-host SDDC:
  • Faster onboarding for proof-of-concept, or testing and development.
  • Migration between on-premises and OCI VMware Solution using VMware HCX, VMware vMotion for live migration, and cold migration.
  • Disaster Recovery Evaluation with VMware Site Recovery (SRM) optimized for OCI VMware Solution. VMware SRM is bought separately.
  • Hybrid Linked Mode support for a single view of on-premises and OCI VMware Solution resources.
  • High-bandwidth, low-latency access to other Oracle services.

Limitations and Considerations for Single Host SDDCs:

  • Standard shapes aren't supported.
  • Production workloads aren't supported.
  • No OCI supported service-level agreement (SLA) is provided.
  • Oracle support is limited to commercially reasonable support. VMware support is available only for the first 60 days for a single-node SDDC deployment.
  • Single host SDDCs don't expire, but they're limited to the Hourly and Monthly billing options. See Billing Options for more information.
  • Single host SDDCs aren’t designed as long-term solutions. If you require a long-term SDDC, you can migrate workloads to a new production SDDC using HCX. See HCX License Types for more information.
  • Single host SDDCs aren't backed up. If the host fails, the data is lost.
  • You're limited to a global maximum of 10 single-host SDDC deployments across all tenancies and regions.
  • Features that require more than one host don't work. For example:
    • Distributed management components
    • High-availability (HA) for VMware clustering
    • Distributed Resource Management (DRM) for VMware clustering

Defining Clusters

A cluster is a group of ESXi hosts and associated resources within an SDDC. Clusters segregate workloads and provide for future expansion to shapes that suit specific business needs. For example, you might set up different clusters that meet different compliance requirements for different lines of business. Another example is setting up different clusters that contain shape types for specialized workloads or cost requirements.

When you create an SDDC, the first cluster created is always the management cluster. The management cluster contains all the resources necessary for the SDDC to function such as vCenter Server, NSX-T Manager Cluster and NSX-T Edge Nodes and services. A single set of management components is deployed for the whole SDDC. The unified management cluster can contain from 3 to 64 hosts and can also be used to host workloads.

Any clusters you create after the unified management cluster are workload clusters, and don't contain any management components. You can create up to 5 workload clusters. The number of ESXi hosts you can create in a workload cluster depends on the compute shape you select for the cluster. For dense shapes, you can have a maximum of 64 hosts. For standard shapes, you can have up to 32 hosts in the same cluster. You can have a total of 64 hosts in an SDDC.

Create clusters during initial SDDC provisioning or at any time thereafter. All clusters in the SDDC are created in the Availability domain specified during the initial SDDC provisioning. ESXi host shapes, pricing interval, VLANs, and datastores are configured separately for each cluster in the SDDC.
Important

Each cluster's resources are independent of the other clusters in the SDDC, so each cluster requires its own set of prerequisite resources. Before you create clusters in an SDDC, be sure you have all the resources you need.

See Service Limits for a list of applicable limits and instructions for requesting a limit increase.

You can add more ESXi hosts to a cluster any time after provisioning. When you add a host to a cluster, the host's resources become part of the cluster. You can add an ESXi host of a different shape and billing interval than was initially specified for hosts during provisioning, as long as all shapes in the cluster have the same processor vendor. You can mix different shapes, billing intervals, and ESXi host software versions within a cluster to suit your business needs.

Cluster 1 Cluster 2 +
Type Management and workload Workload
Shapes
  • You can use any supported shape or processor family.
  • Defaults to the shape selected in Cluster 1, but you can change it to any supported shape.
Cores The number of cores you can configure depends on the shape you select.
  • You can configure a higher or lower number of cores than specified in Cluster 1.
  • The number of cores you can configure depends on the shape you select.
Number of ESXi Hosts
  • 3 to 64 hosts, constrained by tenancy limits.
  • Single host SDDCs contain only one cluster with one ESXi host.
  • Up to 32 standard shape hosts, constrained by tenancy limits.
  • Up to 64 dense shape hosts, constrained by tenancy limits.
  • Single host SDDCs contain only one cluster with one ESXi host.
Billing interval
  • Any billing interval supported by the selected shape
  • Defaults to the interval selected in Cluster 1, but you can change it to any interval supported by the selected shape.
Software
  • Select any VMware software bundle supported by the selected shape.
  • VMware software licensing is the same for all clusters in the SDDC.
Networking
  • You can use existing VLANs or set them up during SDDC provisioning.
  • You can use the same VLANs for all clusters, or create new VLANs for each cluster.
Storage
  • Depends on the selected shape. See Supported Shapes.
  • You can create and attach more block volume storage at any time.

Supported Shapes

VMware Solution supports both Standard and Dense shapes for ESXi hosts. Each shape type has different benefits and limitations to consider when planning your SDDC. When you create a workload cluster, the number of allowed ESXi hosts in the cluster depends on the shape you choose. For dense shapes, you can have a maximum of 64 hosts. For standard shapes, you can have up to 32 hosts in the same cluster.

Dense Shapes

  • Dense shapes provide local NVMe storage and don't require block volume storage.
  • vSAN converged storage technology replicates data across all the ESXi hosts in the SDDC.
  • All pricing commitment types and HCX license types are available for Dense shapes.
  • Dense shapes can be deployed across several Availability domains.
  • No memory limit, network bandwidth limit or VNIC count limit.
  • You can use a dense shape to create a single-node SDDC.
Processor Type Shape OCPU Available Core Configurations
Intel BM.DenseIO2.52 52 52
AMD BM.DenselO.E4.128 128 32, 64, 128
See Compute Dense I/O Shapes for more detail.

Standard Shapes

  • Standard shapes provide a lower-cost option than Dense shapes.
  • Standard shapes require block volume storage. See the following section for more detail.
  • Standard shapes are only available for a single Availability domain.
  • Monthly pricing commitment isn't available for standard shapes.
  • Limits for memory, bandwidth, and number of VNICs. (See table.)
  • Single-node SDDCs using standard shapes aren't supported.
Processor Type Shape OCPU Available Core Configurations Memory (GB) Network Bandwidth Limit (Gbps) Max VNIC Limit
Intel BM.Standard2.52 52 52 768 50 200
Intel BM.Standard3.64 64 16, 32, 48, 64 1024 100 256
AMD BM.Standard.E4.128 128 32, 64, 96, 128 2048 100 256
See Compute Standard Shapes for more detail.

Data Storage

Standard shape SDDCs leverage the Block Volume service for durability. All volumes are automatically replicated for you, helping to protect against data loss. Many copies of data are stored redundantly across many storage servers with built-in repair mechanisms. See Block Volume Durability for more information.

If you select a standard shape when you create an SDDC, the workflow automatically creates a management datastore block volume with the following characteristics:
  • Capacity: 8 TB
  • Default VPUs/GB: 10 (Balanced)
If you want more storage, you can create more volumes during the create SDDC workflow or using the Block Volume service. You're charged for all storage at regular block volume rates. The following limits apply to the SDDC data storage pool:
  • Maximum volumes: 32
  • Minimum volume size: 50 GB
  • Maximum volume size: 32,768 GB (32 TB)

Shielded Instances

When you create an SDDC and define its clusters, you can choose to use shielded instances for ESXi hosts. Shielded instances harden the firmware security on ESXi hosts to defend against malicious boot level software. Shielded instances for VMware Solution provide the following features:
  • Secure boot checks the signature of each piece of boot software, including firmware drivers, EFI applications and the OS. If the signature is valid, the server boots and the firmware gives control to the OS. If the signature isn't found in the valid signatures database, the system doesn't boot. See the VMware Secure Boot Documentation for more information.
  • Trusted Platform Module (TPM) is a computer chip that can securely store artifacts like signatures, certificates and encryption keys used to authenticate the platform. See the VMware TPM Documentation for more information.

If the ESXi hosts are shielded instances, you can use Virtual Trusted Platform Module (vTPM) on the VMs. vTPM is a software representation of a physical TPM that can be used by VMs. See the VMware vTPM Documentation for more information.

Important

Shielded instances must be enabled when you create the SDDC. All hosts created in the SDDC are shielded instances. You can't enable this option later, or for specific ESXi hosts. If you have already created an SDDC without enabling shielded instances, and later want to use shielded instances, you must re-create the SDDC.

For general information about shielded compute instances in OCI, see Shielded Instances.

Using Reserved Capacity

When you create a new ESXi host, you can choose to create it with reserved capacity, or create it with on-demand capacity.

On-demand capacity means that the compute capacity required to create the host is provisioned at the time of the request. You start paying for the capacity when it's provisioned.

Capacity reservations enable you to reserve instances in advance so that the capacity is available for workloads when you need it. Capacity reservations provide the following benefits:

  • Assurance that you have the capacity necessary to manage the workload. Reserved capacity is available for the tenancy to consume at any time.
  • No size or time commitments. Create a reservation with as little or as much capacity as you need, and delete the reservation at any time to stop paying for it.
  • When instances that use reserved capacity are deleted, the capacity is returned to the reservation.
Note

Capacity reservation isn't supported for an SDDC that uses more than one Availability domain.
Important

When a host is still in a reserved capacity pool, billing is based on Reserved Capacity SKU pricing. After the host is provisioned from reserved capacity pool to an SDDC, the host switches to VMware Solution SKU pricing based on the commitment interval you select.

If the host is deleted before the commitment period ends, you continue to be billed for the host for the duration of the commitment.

Inactive hosts in a reserve capacity pool are billed independently of VMware Solution.

To use reserved capacity for VMware hosts, you must first set up a capacity reservation. For more information, see Capacity Reservations.

Oracle Cloud VMware Solution Architecture

The following diagram shows how the various components of the Oracle Cloud VMware Solution SDDC are deployed on OCI bare metal compute instances, and how the solution is integrated into the OCI environment.

Diagram showing the architecture of the Oracle Cloud VMware Solution

The diagram shows three ESXi hosts of an SDDC that resides in an OCI VCN. The center host shows the installed VMware software components for compute (vSphere), network (NSX-T), and storage (vSAN) support. The NSX overlay manages the flow of traffic between the VMs, and between the VMs and the rest of the resources in the solution. The VCN here includes various gateways that allow connectivity between the SDDC and an on-premises network, the internet, and the Oracle Services Network.

Host Distribution and Availability Domains

To provide for high throughput and low latency, Oracle Cloud Infrastructure VMware Solution SDDCs are deployed by default across a minimum of three fault domains within a single Availability domain in a region. This architecture provides for low latency, high throughput connections to provide maximum performance and reliability.

If the SDDCs require deployment across many availability domains, this option is available at request. There are some considerations and potential limitations in a multi Availability domain solution:

  • A multi Availability domain can prevent data loss in the event of a single AD. If a host is lost in the SDDC, VMs are restarted on an available host in another Availability domain.
  • Careful consideration must be taken when requesting to provision an SDDC across many availability domains. Performance might be impacted because of the possibility of increased network latency and storage throughput when compared with a single Availability domain deployment.
  • As a multi Availability domain SDDC scales upward, demand on the network also grows. Replicating data across hosts in different availability domains impacts such functions as vSAN storage synchronization, and rebuild and resync times. More management functions can also impact performance of customer workloads.
  • We recommend VMware SDDCs deployed across availability domains within a region don't exceed a maximum of 16 ESXi hosts.

To request a multi Availability domain deployment, contact the Oracle Cloud VMware Solution team here.

For general information, see About Regions and Availability Domains.

HCX Manager

When you provision an SDDC, you can enable HCX Manager (not shown in the diagram). HCX is an application mobility platform that simplifies application migration, workload rebalancing, and business continuity across data centers and clouds. For HCX to function correctly in VMware solution, you must have:
  • A FastConnect connection for intersite communication
  • A NAT gateway as required by HCX Manager for license activation, updates, and VMware enhanced support
Note

HCX Manager requires connectivity to a VMware SaaS portal provided by a NAT gateway. Read more about VMware's requirements for HCX Manager: Why does HCX Manager require connectivity for activation and updates?

About the VMware Software

OCI's VMware software bundle contains vSphere, vSAN, NSX, vCenter, and HCX components to support compute, storage, and network needs for a fully functional VMware environment.

  • vSphere: vSphere is VMware's virtualization platform for unified management of the SDDC's CPU, storage, and networking infrastructure. Two key components of vSphere are ESXi hypervisor and vCenter Server.
  • NSX-T: NSX-T Data Center provides the SDDC with its virtual networking and security capabilities. The NSX-T deployment includes NSX Manager unified appliances with NSX-T Local Manager and NSX-T Controller, and NSX-T Edge nodes.
  • vSAN: Oracle Cloud VMware Solution SDDCs use VMware's vSAN storage technology, which provides a single shared datastore for compute andx management workloads (VMs).
  • HCX: The Hybrid Cloud Extension is an application mobility platform that removes complexity from application and workload migration. HCX is optionally installed as a plugin when you set up an SDDC. You can choose to install HCX Advanced at no extra cost, or HCX Enterprise as a billed upgrade. See HCX License Types for more information.

When you provision the SDDC, you select the initial version of this software bundle to install on the ESXi hosts created during provisioning. You can change the SDDC's default software version later. When you add ESXi hosts to the SDDC, you don't need to use the SDDC default version. You can select any ESXi software version under the major version deployed with the SDDC.

Note

  • Changes that you make to the SDDC by using the Oracle Cloud InfrastructureConsole, API, or CLI aren't automatically made in vCenter. For example, if you change the software version or the SSH keys, the change applies only to ESXi hosts that you add to the SDDC. To change these properties for existing hosts, you must make the applicable updates in vCenter manually.
The following tables list the components and versions for current VMware software bundles:
vSphere 8.0
Component Version Build
VMware ESXi ESXi 8.0 U1c 22088125
VMware vCenter Server Appliance vCenter Server 8.0 20519528
VMware NSX-T Data Center 4.0.1.1 20598726
HCX Cloud 4.6.3 21913437
HCX Connector 4.6.3 21913513
vSphere 7.0
Component Version Build
VMware ESXi ESXi 7.0 U3k 21313628
VMware vCenter Server Appliance vCenter Server 7.0 U3k 21290409
VMware NSX-T Data Center 3.2.2 20737185
HCX Cloud 4.5.2 20914430
HCX Connector 4.5.2 20914338

The following table shows versions of the software bundle that have reached an End of support state.

Software Version vSphere vSAN NSX-T

6.7 update 3*

6.7 U3

6.7 U3

3.2.0.1

6.5 update 3*

6.5 U3

6.5 U3

3.2.0.1
Note

* vSphere 6.5 and vSphere 6.7 reached the End of General Support from VMware Solution on October 15, 2022. Oracle provides commercially reasonable support for provisioning of vSphere 6.5 and 6.7 environments when they enter the Technical Guidance phase after that date. We recommend that you use the latest version of vSphere when you create an SDDC.

Upgrading VMware Software from 6.x to 7.x

Because there are significant architectural changes to the platform from vSphere version 6.x to 7.x., OCI provides a workflow that guides you through the upgrade process step-by-step. To perform the upgrade, the workflow provisions a new vSphere 7.0 SDDC and ESXi hosts on OCI VMware Solution and uses VMware HCX to migrate workloads to the new vSphere 7 SDDC. During the upgrade workflow two more VLANs are required for provisioning and migration. You can create the VLANs before you start the workflow, or let the workflow create them for you.

See Upgrading VMware Software for more information and instructions.

Note

OCI only supports an in-place upgrade workflow from version 6.x to 7.x. To upgrade from 7.x to 8.x, create a new SDDC and hosts using version 8.x. Then, migrate workloads from the 7.x SDDC to the 8.x SDDC, and transfer the host billing commitments. See Transferring Billing Commitments for more information.

HCX License Types

The Hybrid Cloud Extension (HCX) is an application mobility platform that simplifies application migration, workload rebalancing, and business continuity across data centers and clouds. To run HCX, each physical socket at the destination must have at least one license key assigned. The number of on-premises keys provided depends on the HCX license type.

License Number of Keys Standard Shape SDDCs Dense Shape SDDCs Notes
Advanced 3 Not supported Included at no extra cost This license type lets you migrate fewer workloads with some application downtime.
Enterprise 10 Enterprise license included at no extra cost. No option to downgrade to an Advanced license. Billed upgrade. You can choose to downgrade to an Advanced license later.

This license type lets you migrate many mission-critical workloads with zero downtime.

Any HCX Enterprise charges applied are billed monthly and are independent from host billing intervals. After SDDC provisioning is complete, you can view the HCX Monthly Billing Cycle End Date on the Details page.

If you're using dense shapes for an SDDC, you can change the HCX license type:
  • Updgrading to Enterprise: Increases the number of on-premises connection keys issued from 3 to 10. The upgrade work request starts immediately. The HCX Enterprise billing cycle begins as soon as the work request is complete.
  • Downgrading to Advanced: Decreases the number of on-premises connection keys from 10 to 3. You must specify 3 license keys to retain after the downgrade. The downgrade request remains in a pending state until the HCX Monthly Billing Cycle End Date. You can cancel the downgrade request as long as it's still in a pending state.
Note

Standard shapes include the Enterprise license type at no cost, and are free. You can't change the license type in SDDCs that use standard shapes.

For more information, see Upgrading an SDDC's HCX License and Downgrading an SDDC's HCX License.

Billing Options

OCI's VMware Solution bundle offers flexible billing options that you can choose from.
  • Pricing interval: Define a pricing interval for ESXi hosts in an SDDC or cluster. Each cluster in an SDDC can have a different pricing interval. Select from hourly, monthly, yearly, or every three years.
  • Swap billing commitments: You can transfer the billing commitment, HCX commitment, and billing end date from one ESXi host to another. Billing commitments can be transferred from a deleted host or an existing host.

For more detail, see Billing Options and Transferring Billing Commitments.

Additional Documentation Resources

The following Oracle Cloud VMware Solution playbooks and white papers are available: