Supported Compute Shapes
Data Science supports specific Compute shapes for various resources in the service.
VM Compute shapes and GPU Compute shapes describe these shapes in detail.
OCPUs represent physical CPU cores. Most CPU architectures, including x86, run two threads per physical core, so one OCPU is the equal of two vCPUs for x86-based compute. The cost per vCPU is half the cost of an OCPU, see Data Science pricing.
AMD CPU
Shape | OCPUs | GB Memory |
---|---|---|
VM.Standard.E3.Flex | 1–64 | 1–1024 (dependent on OCPU count) |
VM.Standard.E4.Flex | 1–64 | 1–1024 (dependent on OCPU count) |
For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU
up to the maximum allowed memory. For example, for two OCPUs, the maximum allowed memory
is 2 * 64 = 128 GB
. For 20 OCPUs, 20 * 64 = 1280 GB > 1024
GB
. Therefore, for 20 OCPUs, the maximum allowed memory for both
VM.Standard.E3. Flex and VM.Standard.E4.Flex is 1,024 GB.
Example:
OCPU | GB Memory |
---|---|
1 | 1-64 |
2 | 1-128 |
3 | 1-192 |
4 | 1–256 |
When you use standard flexible shapes for model deployments:
- The minimum memory is 6 GB per OCPU used for the model server and load.
- The maximum memory is 64 GB per OCPU up to the allowed memory for each shape. For example, maximum allowed memory for the VM.Standard.E3. Flex shape is
1,024 GB
.
ARM CPU
Shape | OCPUs | GB Memory |
---|---|---|
VM.Standard.A1.Flex | 1–80 | 1–1024 (dependent on OCPU count) |
For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU
up to the maximum allowed memory (1024 GB). For example, for two OCPUs, the maximum
allowed memory is 2 * 64 = 128 GB
. For 20 OCPUs, 20 * 64 = 1280
GB > 1024 GB
.
OCPU | GB Memory |
---|---|
1 | 1-64 |
2 | 1-128 |
3 | 1-192 |
4 | 1–256 |
Intel CPU (X9)
Shape | OCPUs | GB Memory |
---|---|---|
VM.Standard3.Flex | 1–32 | 1–512 (dependent on OCPU count) |
VM.Optimized3.Flex | 1–18 | 1–256 (dependent on OCPU count) |
Intel CPU (X7)
Shape | OCPUs | GB Memory |
---|---|---|
VM.Standard2.1 | 1 | 15 |
VM.Standard2.2 | 2 | 30 |
VM.Standard2.4 | 4 | 60 |
VM.Standard2.8 | 8 | 120 |
VM.Standard2.16 | 16 | 240 |
VM.Standard2.24 | 24 | 320 |
NVIDIA GPU
Shape | GPU Type | GPU Count |
GPU Memory (GB) |
OCPU Count | CPU Memory (GB) | Available Regions |
---|---|---|---|---|---|---|
VM.GPU2.1 (older generation) |
P100 | 1 | 16 | 12 | 72 | Germany Central (Frankfurt), US East (Ashburn) |
VM.GPU3.1 | V100 | 1 | 16 | 6 | 90 |
Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose) |
VM.GPU3.2 | V100 | 2 | 32 | 12 | 180 |
Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose) |
VM.GPU3.4 | V100 | 4 | 64 | 24 | 360 |
Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose) |
BM.GPU2.2 |
P100 | 2 | 32 | 28 | 192 |
Germany Central (Frankfurt), US East (Ashburn) |
BM.GPU3.8 | V100 | 8 | 128 | 52 | 768 |
Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose) |
BM.GPU4.8 | A100 | 8 | 320 | 64 | 2048 |
Australia East (Sydney), Australia Southeast (Melbourne), Brazil East (Sao Paulo), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Israel Central (Jerusalem), Italy Northwest (Milan), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UAE East (Dubai), US East (Ashburn), UK South (London), US West (Phoenix), US West (San Jose) |
BM.GPUA10.4 | A10 | 4 | 96 | 64 | 1024 |
Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose) |
VM.GPU.A10.1 | A10 | 1 | 24 | 15 | 240 |
Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose) |
VM.GPU.A10.2 | A10 | 2 | 48 | 30 | 480 |
Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose) |