1. Move data to object storage in the cloud by using Rclone
  2. Learn About Moving Data to Cloud-based Object Storage by Using Rclone

Learn About Moving Data to Cloud-based Object Storage by Using Rclone

If you have a strategy to move your apps and app data to the cloud, but find the prospect of moving existing unstructured and object data to the cloud from multiple sources daunting, you can use Rclone with this architecture to simplify this task.

Rclone lets you transfer large amounts of unstructured data like videos, backups, and logs from cloud or on-premises sources into Oracle Cloud Infrastructure Object Storage.

Considerations for Moving Data to Cloud-based Object Storage

This solution is intended for technical audiences, including systems and network administrators, site reliability engineers, solutions architects, and engineers. Before attempting it, consider the following:

  • To successfully complete this solution, you should have:
    • Basic familiarity with Linux and command line (CLI) tools.
    • Administrator-level access in order to run yum commands.
    • Valid credentials for Object Storage.
  • The rate of transfer over the network varies based on network bandwidth and compute resources. If migrating data from on-premises to OCI over the internet, consider FastConnect options in addition to using multiple servers to achieve faster migration times.
  • You should use an Oracle Cloud Infrastructure Compute instance when transferring data from other cloud providers. All examples in this solution have been tested on a VM.DenseIO1.4 Compute instance.
  • Oracle does not charge additional fees for transferring data from other cloud providers. Data transferred to Object Storage is priced based on standard Object Storage pricing. If you use an Oracle Cloud Infrastructure Compute instance for transferring data, you will be charged separately for that usage.

About Oracle Cloud Infrastructure Object Storage

The Oracle Cloud Infrastructure Object Storage service provides unlimited scale for large amounts of unstructured data like videos, backups, and logs. Data in Object Storage is automatically replicated across multiple fault domains.

One of the first steps in using Object Storage is to transfer your existing data. You can choose from a variety of different methods, tools, and services, and your choices depend on your specific use cases, the amount of data that needs to be transferred, and available network bandwidth.

This solution shows how to transfer data to Object Storage from other cloud providers. It provides specific instructions and examples for transferring data from Oracle Cloud Infrastructure Object Storage Classic, Amazon S3, and Microsoft Azure Blob Storage. It also provides instructions on a secondary use case, transferring data to Object Storage from a local file system.

About the Steps for Using Rclone to Move Data to Oracle Cloud Infrastructure Object Storage

This playbook leads you through the four steps required to move data to cloud storage:

  1. Install Rclone. You can install Rclone either for all users on a system or for a single user.
  2. Configure your source. This simply that you export your source path as an environment variable and depends on the source you are using.
  3. Transfer the data and verify the transfer.