Data Transfer Appliance is one of Oracle's offline data transfer solutions that lets you migrate petabyte-scale datasets to Oracle Cloud Infrastructure. You send your data as files on one or more secure, high-capacity, Oracle-supplied storage appliances to an Oracle transfer site. Operators at the Oracle transfer site upload the files into the designated Object Storage bucket in your tenancy. You are then free to move the uploaded data to other Oracle Cloud Infrastructure services as needed.
The following concepts are essential to understanding Data Transfer Appliance.
- transfer job
- A transfer job is the logical representation of a data migration to Oracle Cloud Infrastructure. A transfer job is associated with one or more transfer appliances.
- transfer appliance
- A transfer appliance is high storage capacity device that is specially prepared to copy and upload data to Oracle Cloud Infrastructure. You request a transfer appliance from Oracle, copy your data to the appliance, and then ship the appliance back to Oracle to upload your data.
- Data Transfer Utility
- The Data Transfer Utility is the command-line software that Oracle provides for you to prepare transfer appliances for your data and for shipment to Oracle. In addition, you can use this software to manage transfer jobs and obtain status information about your appliances.
- The computer at your site on which you download the Data Transfer Utility to perform Data Transfer Appliance tasks.
- The logical container in Oracle Cloud Infrastructure Object Storage where Oracle operators upload your data. A bucket is associated with a single compartment in your tenancy that has An IAM document that specifies who has what type of access to your resources. It is used in different ways: to mean an individual statement written in the policy language; to mean a collection of statements in a single, named "policy" document (which has an Oracle Cloud ID (OCID) assigned to it); and to mean the overall body of policies your organization uses to control access to resources. that determine what actions a user can perform on a bucket and on all the objects in the bucket.
- data transfer administrator
- A new or existing IAM user that has the authorization and permissions to create and manage transfer jobs. See Preparing for Data Transfer.
- data transfer upload user
- A temporary IAM user that grants Oracle personnel the authorization and permissions to upload the data from your transfer devices to your designated Oracle Cloud Infrastructure Object Storage bucket. Delete this temporary user after your data is uploaded to Oracle Cloud Infrastructure. See Preparing for Data Transfer.
- data transfer appliance management service
- Software running on the transfer appliance that provides management functions. Users interact with this service though the Data Transfer Utility.
Transfer Appliance Specifications
You use NFSv3 to copy your data onto the Oracle data transfer appliance. Here are some details about the appliance:
150 TB of protected usable space
- 10 GbE - RJ45
- 10 GbE - SFP+You are responsible for providing all network cables. If you want to use SFP+, your transceivers must be compatible with Intel X520 NICs.
- NEMA 5-15 type B to C13
- C13-14 power
- USB-DB9 serial
- Operational temperature: 10–35°C
- Operational relative humidity: 8–90% non-condensing
- Acoustics: < 75 dB @ 23° C
- Operational altitude: -300–3048 m (10,000 ft)
- Consumption: 554 W
- Voltage: 100–240 VAC
- Frequency: 47–63 Hz
- Conversion efficiency: 89%
- Unit: 38 lbs (17.2365 kg)
- Unit + Transit Case: 64 lbs (29.0299 kg)
Task Flow for Data Transfer Appliance
Here is a high-level overview of the tasks involved in transferring data to Oracle Cloud Infrastructure using Data Transfer Appliance.
Performing prerequisite tasks in preparation for data transfer
An Oracle Cloud Infrastructure administrator must perform prerequisite tasks in preparation for data transfer. These tasks and are covered in detail in Preparing for Data Transfer.
- Create or designate a bucket in your tenancy where Oracle is to upload your data.
- Create or use an existing IAM group for data transfer administrators with the authorization and permissions to create and manage transfer jobs and manage objects in Oracle Cloud Infrastructure Object Storage.
- Create or use an existing IAM data transfer administrator user and add that user to the data transfer administrators group.
- Create or use an existing IAM group for data transfer upload users with the authorization and permissions to upload data to Oracle Cloud Infrastructure Object Storage.
- Create a temporary IAM data transfer upload user and add that user to data transfer upload user group.
- Write the authorization policies to allow the data transfer administrator and upload user groups to perform the required data transfer tasks.
Important Security Consideration
For security reasons, we recommend creating a unique IAM data transfer upload user for each transfer job and then deleting that user after your data is uploaded to Oracle Cloud Infrastructure.
A data transfer administrator performs the remaining tasks. These tasks are covered in detail in Managing Appliance Data Transfers.
Preparing for and copying your data
- Create a transfer job.
- Request a transfer appliance.
- Monitor your transfer appliance request.
- Set up your host machine.
- Unpack and prepare your transfer appliance.
- Configure networking on your transfer appliance.
- Write data to your transfer appliance.
Preparing your appliances for shipment
Post shipment tasks
- Optionally, cancel a transfer appliance if you don't want Oracle to upload your data.
- Monitor your transfer appliance return shipment.
- Review transfer appliance log files.
- Close the transfer job.
This section highlights the security details of the Data Transfer Appliance process.
- Appliances are shipped from Oracle to you with a tamper-evident security tie on the transit case. A second tamper-evident security tie is included in the appliance transit case for you to secure the case when you ship the case back to Oracle. The number on the physical security ties must match the numbers logged by Oracle in the transfer appliance details.
When you configure the transfer appliance for the first time:
- The transfer appliance generates a master AES-256 bit encryption key that is used for all data written to or read from the device. The encryption key never leaves the device.
- The encryption key is protected by an encryption passphrase that you must know to access the encrypted data. The Data Transfer Utility securely fetches a provided encryption passphrase from Oracle Cloud Infrastructure and registers that passphrase on the transfer appliance.
- All data is encrypted as the data is copied to an Oracle transfer appliance.
- All network communication between the Data Transfer Utility and Oracle Cloud Infrastructure is encrypted in-transit using Transport Layer Security (TLS).
After copying your data to a transfer appliance, the Data Transfer Utility generates a manifest file. The manifest contains an index of all of the copied files and generated data integrity hashes. The Data Transfer Utility also encrypts and copies the
config_upload_userconfiguration file to the transfer appliance. This configuration file describes the temporary IAM data transfer upload user. Oracle uses the credentials and entries defined in the
config_upload_userfile when processing the transfer appliance and uploading files to Oracle Cloud Infrastructure Object Storage.Note
Data Transfer Service Does Not Support Passphrases on Private Keys
While we recommend encrypting a private key with a passphrase when generating API signing keys, Data Transfer does not support passphrases on the key file required for the
config_upload_user. If you use a passphrase, Oracle personnel cannot upload your data.
Oracle cannot upload data from a transfer appliance without the correct credentials defined in this configuration file. See Installing and Configuring the Data Transfer Utility for more information about the required configuration files.
- Oracle erases all of your data from the transfer appliance after it has been processed. The erasure process follows the NIST 800-88 standards.
We provide two ways to manage data transfer appliances:
- The Data Transfer Utility is a full-featured command-line tool. For more information and installation instructions, see Installing and Configuring the Data Transfer Utility.
- The Console is an easy-to-use, partial-featured browser-based interface. For more information, see Signing In to the Console.
You can perform many data transfer tasks using either the Console or the Data Transfer Utility. However, there are some tasks you can only perform using the Data Transfer Utility. Managing Appliance Data Transfers describes the management tasks in detail and guides you to the appropriate management interface to use for each task.
You are now ready to perform the prerequisite data transfer tasks. See Preparing for Data Transfer.