Oracle Big Data Service provides enterprise-grade Hadoop as a service, with end-to-end security, high performance, and ease of management and upgradeability.
About Oracle Big Data Service
Big Data Service includes:
- A full Hadoop stack, with a complete installation of the Cloudera Distribution Including Apache Hadoop (CDH). CDH includes Cloudera Manager, Apache Hadoop, Apache Flume, Apache Hive, Apache Spark, Apache Hue, Apache Kafka, Apache Solr, Apache Sentry, and other services for working with and securing big data.
- All of the tools and utilities from Cloudera Enterprise Data Hub.
- Oracle Cloud Infrastructure features and resources, including identity management, networking, compute, storage, and monitoring.
- A REST API for creating and managing clusters.
bda-oss-admincommand line interface for managing storage providers.
odcpcommand line interface for copying and moving data.
- The ability to create clusters of any size, based on native Oracle Cloud Infrastructure shapes. For example, you can create small, short-lived clusters in flexible virtual environments, very large, long-running clusters on dedicated hardware, or any combination between.
- Optional secure, high availablity (HA) clusters.
- Oracle Cloud SQL integration, for analyzing data across Apache Hadoop, Apache Kafka, NoSQL, and object stores using Oracle SQL query language.
Oracle Big Data Manager, a browser-based tool for managing and analyzing data, isn't included in this release of Big Data Service. It is expected to be included in future releases.
For the latest information on the regions where Big Data Service and related services are available, see Data Regions for Platform and Infrastructure Services.
Big Data Service has the following default limits for all regions:
|Resource||Monthly Universal Credits||Pay-as-You-Go|
|VM.Standard2.1||12 instances (12 OCPUs)||3 instances (3 OCPUs)|
|VM.Standard2.4||12 instances (48 OCPUs)||8 instances (32 OCPUs)|
|VM.Standard2.8||8 instances (64 OCPUs)||Contact us|
|Contact us||Contact us|
For more information about service limits, see Service Limits in the Oracle Cloud Infrastructure documentation.
To submit a request to increase your service limits, see Requesting a Service Limit Increase in the Oracle Cloud Infrastructure documentation.
Big Data Service administrators can set quota policies to enforce restrictions on users by limiting the resources that they can create.
For information about how Oracle Cloud Infrastructure handles quotas, see About Compartment Quotas.
Use the following information to create quotas:
|vm-standard-2-1-ocpu-count||Regional||Number of VM.Standard2.1 OCPUs|
|vm-standard-2-2-ocpu-count||Regional||Number of VM.Standard2.2 OCPUs|
|vm-standard-2-4-ocpu-count||Regional||Number of VM.Standard2.4 OCPUs|
|vm-standard-2-8-ocpu-count||Regional||Number of VM.Standard2.8 OCPUs|
|vm-standard-2-16-ocpu-count||Regional||Number of VM.Standard2.16 OCPUs|
|vm-standard-2-24-ocpu-count||Regional||Number of VM.Standard2.24 OCPUs|
|vm-dense-io-2-8-ocpu-count||Regional||Number of VM.DenseIO2.8 OCPUs|
|vm-dense-io-2-16-ocpu-count||Regional||Number of VM.DenseIO2.16 OCPUs|
|vm-dense-io-2-24-ocpu-count||Regional||Number of VM.DenseIO2.24 OCPUs|
|bm-hpc2-36-ocpu-count||Regional||Number of BM.HPC2.36 OCPUs|
|bm-dense-io-2-52-ocpu-count||Regional||Number of BM.DenseIO2.52 OCPUs|
|bm-standard-2-52-ocpu-count||Regional||Number of BM.Standard2.52 OCPUs|
Big Data Service quota policy examples:
Limit the number of VM.Standard2.4 OCPUs that users can allocate to services they create in the
mycompartmentcompartment to 40.
Set big-data quota vm-standard-2-4-ocpu-count to 40in Compartment mycompartment
Limit the number of BM.DenseIO2.52 OCPUs that users can allocate to services they create in the
testcompartmentcompartment to 20.
Set big-data quota bm-dense-io-2-52-ocpu-count to 20 in Compartment testcompartment
Don't allow users to create any VM.Standard2.4 OCPUs in the
Zero big-data quota vm-standard-2-4-ocpu-count in Compartment examplecompart
Asynchronous Work Requests
Open Big Data Service in the Oracle Cloud Console
You can't create clusters until you've set up your Oracle Infrastructure environment to support Big Data Service. See Set Up Oracle Cloud Infrastructure for Oracle Big Data Service.
The Big Data Service pages give you access to your clusters, but you'll use other Oracle Cloud Console pages to manage other aspects of your service, for example the Networking pages for your network and the Identity pages for identity and access management.
- Open the Oracle Cloud Console. See Signing In to the Console in the Oracle Cloud Infrastructure documentation.
- In the Oracle Cloud Console, open the navigation menu. Under AI and Big Data, select Big Data.