Appliance Import Reference

This topic provides complete task details for certain components associated with Appliance-Based Data Imports. Use this topic as a reference to learn and use commands associated with components included in the Appliance-Based Data Import procedure.

Transfer Jobs

A transfer job is the logical representation of a data migration to Oracle Cloud Infrastructure. A transfer job is associated with one or more import appliances.

Note

It is recommended that you create a compartment for each transfer job to minimize the required access your tenancy.

Creating Transfer Jobs

Create the transfer job in the same compartment as the upload bucket and supply a human-readable name for the transfer job. Avoid entering confidential information when providing transfer job names.

Creating a transfer job returns a job ID that you specify in other transfer tasks. For example:

ocid1.datatransferjob.region1.phx..<unique_ID>
To create a transfer job using the Console
To create a transfer job using the CLI

Displaying Transfer Jobs

To display the list of transfer jobs using the Console
To display the list of transfer jobs using the CLI

Displaying Transfer Job Details

To display the details of a transfer job using the Console
To display the details of a transfer job using the CLI

Editing Transfer Jobs

To edit the name of a transfer job using the Console
To edit the name of a transfer job using the CLI
To edit the tags associated with a transfer job using the CLI
To delete the tags associated with a transfer job using the CLI

Moving Transfer Jobs Between Compartments

To move a data transfer job to a different compartment using the Console
To move a data transfer job to a different compartment using the CLI

Verifying Upload User Credentials

Note

You can only use the CLI command to verify upload user credentials.

You can verify the current upload user credentials to see whether there are any problems or updates required. If any configuration file is incorrect or invalid, the upload fails.

To verify the upload user credentials of a transfer job using the CLI

Deleting Transfer Jobs

You can delete transfer jobs when they are in the Initiated, Preparing, and Close states.

To delete a transfer job using the Console
To delete a transfer job using the CLI

Closing Transfer Jobs

Typically, you would close a transfer job when no further transfer job activity is required or possible. Closing a transfer job requires that the status of all associated transfer packages be returned, canceled, or deleted. In addition, the status of all associated transfer disks must be complete, in error, missing, canceled, or deleted.

To close a transfer job using the Console
To close a transfer job using the CLI

Import Appliances

This section describes tasks associated with the Oracle-provided import appliance.

Requesting Appliances

Tip

To save time, identify the data you intend to upload and make data copy preparations before requesting the import appliance.

Creating an import appliance request returns an Oracle-assigned appliance label. For example:

XA8XM27EVH
To request an appliance using the Console
To request an appliance using the CLIs

Monitoring the Appliance Request Status

The time it takes to approve, prepare, and ship your appliance request varies and depends on various factors, including current available inventory. Oracle provides status updates daily throughout the appliance request and ship process.

To monitor the status of your appliance request using the Console
To monitor the status of your appliance request using the CLI

Displaying the List of Appliances

To display the list of appliances using the Console
To display the list of appliances using the CLI

Displaying Appliance Details

To display the details of an appliance using the Console
To display the details of an appliance using the CLI

Editing the Appliance Request Shipping Information

You can only edit the shipping information when the status is Requested.

To edit the appliance request shipping information using the Console
To edit the appliance request shipping information using the CLI

Deleting an Appliance Request

You can delete an appliance request before Oracle approves the request—the status must be Requested. For example, you initiated the transfer by creating a transfer job and requested an appliance, but changed your mind.

To delete an appliance request using the Console
To delete an appliance request using the CLI

Datasets

A dataset is a collection of files that are treated similarly. You can write up to 100 million files onto the appliance for import. We currently support one dataset per appliance.

Note

You can only use the CLI to run dataset tasks.

Creating Datasets

Appliance data transfer supports NFSversion 3, 4, and 4.1 to write data to the import appliance. In preparation for writing data, create and configure a dataset to write to.

To create a dataset using the CLI

Activating the Dataset

Activation creates the NFS export, making the dataset accessible to NFS clients.

To activate the dataset using the CLI

Configuring Export Settings on the Dataset

To configure export settings on a dataset using the CLI

Deactivating the Dataset

Note

Deactivating the dataset is only required if you are running appliance commands using the Data Transfer Utility. If you are using the Oracle Cloud Infrastructure CLI to run your Appliance-Based Data Import, you can skip this step and proceed to Sealing the Dataset.

After you are done writing data, deactivate the dataset. Deactivation removes the NFS export on the dataset, disallowing any further writes.

To deactivate the dataset using the CLI

Sealing the Dataset

Sealing a dataset stops all writes to the dataset. This process can take some time to complete, depending upon the number of files and total amount of data copied to the import appliance.

If you issue the seal command without the --wait option, the seal operation is triggered and runs in the background. You are returned to the command prompt and can use the seal-status command to monitor the sealing status. Running the seal command with the --wait option results in the seal operation being triggered and continues to provide status updates until sealing completion.

Important

You can only copy regular files to transfer appliances. Special files (for example, symbolic links, device special, sockets, and pipes) cannot be copied directly. To transfer special files, create a tar archive of these files and copy the tar archive to the transfer appliance.

The sealing operation generates a manifest across all files in the dataset. The manifest contains an index of the copied files and generated data integrity hashes.

To seal the dataset using the CLI
To monitor the dataset sealing process using the CLI

Downloading the Dataset Seal Manifest

After sealing the dataset, you can optionally download the dataset's seal manifest to a user-specified location. The manifest file contains the checksum details of all the files. The transfer site uploader consults the manifest file to determine the list of files to upload to object storage. For every uploaded file, it validates that the checksum reported by object storage matches the checksum in manifest. This validation ensures that no files got corrupted in transit.

To download the dataset seal manifest file using the CLI

Reopening a Dataset

If changes are necessary after sealing a dataset or finalizing an import appliance, you must reopen the dataset to modify the contents. Make the required changes and again seal the dataset. Resealing the dataset generates a new manifest.

Note

If an import appliance is rebooted or power cycled, follow the instructions in this topic to reopen the dataset.

Step 1: Unlocking the Appliance

You must unlock the appliance before you can write data to it. Unlocking the appliance requires the strong passphrase that is created by Oracle Cloud Infrastructure for each appliance. Unlocking can be accomplished in two different ways:

  • If you provide the --job-id and --appliance-label when running the unlock command, the data transfer system retrieves the passphrase from Oracle Cloud Infrastructure and sends it to the appliance during the unlock operation.
  • You can query Oracle Cloud Infrastructure for the passphrase and provide that passphrase when prompted during the unlock operation.
To retrieve the passphrase to unlock the appliance
To query Oracle Cloud Infrastructure for the passphrase to provide to unlock the appliance

Step 2: Reopening the Appliance

Reopen the dataset to write data to the import appliance again.

To reopen an NFS dataset

Step 3: Repeat Steps to Write Data to the Appliance

Repeat the same tasks you performed when you originally wrote data to the import appliance beginning with activating the dataset in the Copying Files to the NFS Share section.

Displaying Datasets

Note

You can only use the CLI command to display a list of datasets.

To display the list of datasets using the CLI

Displaying Dataset Details

Note

You can only use the CLI command to display details of a dataset.

To display the details of a transfer job using the CLI

Deleting a Dataset

Note

You can only use the CLI command to delete a dataset.

To delete a dataset using the CLI

Appliances

Displaying Registered Appliances

You can display a list of all appliances registered through the initialize authentication command. See Initializing Authentication to the Appliance for more information.

Note

You can only use the CLI command to display a list of all appliances registered through the initialize authentication command.

Unregistering Appliances

You can unregister an appliance previously registered through the initialize authentication command. See Initializing Authentication to the Appliance for more information.

To unregister an appliance using the CLI

oci dts physical-appliance unregister