Oracle Cloud Infrastructure Documentation

Features of Storage Gateway

This topic highlights key features of Storage Gateway.

POSIX-Compliant NFS Access to Oracle Cloud Infrastructure Object Storage

Using Storage Gateway, your applications can interact with Oracle Cloud Infrastructure Object Storage through standard NFSv4 protocols. You connect Storage Gateway file systems to Object Storage buckets. Storage Gateway stores files as objects in an Oracle Cloud Infrastructure Object Storage bucket and supports multipart uploads for large objects. Object Storage does not, however, support symbolic links, hard links, or special device files.

Data Integrity with Checksum Verification

The built-in data integrity checks ensure that data is validated as it moves through the data path from Storage Gateway to Oracle Cloud Infrastructure Object Storage. Checksum verification helps ensure the data integrity. Metadata integrity checks are performed to ensure that the metadata is in consistent state. The checksum for each file can be read using a custom interface.

Large File Support

The Oracle Cloud Infrastructure Object Storage service supports multipart uploads for faster, more efficient, and resilient uploads. Storage Gateway uses multipart upload for files larger than 128 MB. With multipart uploads, individual parts of an object can be uploaded in parallel to reduce the amount of time you spend uploading. Multipart uploads also minimize the impact of network failures by letting you retry a failed part upload instead of requiring you to retry an entire object upload. See Using Multipart Uploads for details.

Support for Data Archival

In addition to uploading to buckets in the Object Storage Standard tier, Storage Gateway supports uploading to and restoring objects from buckets in the Archive Storage tier.

When you create a file system, you specify which storage tier, Standard (the default), or Archive, to create the corresponding Object Storage bucket.

  • The Standard Object Storage tier is used for storing data to which you need fast, immediate, and frequent access.
  • The Archive Storage tier is used for storing data that is accessed infrequently and requires long retention periods.

While Archive Storage is more cost effective than Object Storage for preserving cold data, you must first restore the objects before you can access them. The restoration process can take up to four hours depending on the size of the object. See Overview of Archive Storage and Restoring Files/Objects from Archive Storage for details.

Storage Gateway also supports the Oracle Cloud Infrastructure Object Storage object lifecycle policies feature to manage the archiving and deletion of objects in a bucket according to a pre-defined schedule. Using object lifecycle policies, you can initially specify bucket creation in the Standard Object Storage tier, and then create a policy to schedule the subsequent movement of data to the Archive Storage tier. This lifecycle policy archival method is useful if you have on-premises applications that generate intermediary or temporary files and directories that would be inappropriate for immediate archival. See Using Object Lifecycle Management for details.

Automated Object Deletion

When you delete a Storage Gateway file from a file system, the corresponding object in Object Storage is automatically deleted.

Quick Access to Select Files with Cache Pinning

Storage Gateway lets you pin files to the file system cache for quick access. You can pin files to the cache for file systems connected to either the Object Storage Standard or Archive tier.

When you write a file to your Storage Gateway file system, the file is initially stored in the file system cache, and then asynchronously uploaded to your Oracle Cloud Infrastructure bucket. After a file has been uploaded, the cache manager can remove the file from the file system cache. To meet the cache threshold specified for the file system, cache is reclaimed using the Least Recently Used (LRU) cache management policy. If you want specific files to be available in the cache for quick access, you can pin the files to the file system cache. Once pinned, files are not removed from the file system cache until you explicitly unpin them.

Storage Gateway Health Check

The Storage Gateway performs automated "health checks" on the system to monitor the status of the following:

  • Storage Gateway services and resources
  • Local storage, file system cache, metadata storage, and log storage

Integrated Cloud Transfer and Synchronization (Cloud Sync)

Storage Gateway 1.2.1 provides an integrated cloud transfer and synchronization feature called Cloud Sync that lets you back up and transfer files on local storage to and from Oracle Cloud Infrastructure Object Storage buckets. This new feature replaces the independent, downloadable cloud sync utility that was available in the previous Storage Gateway version.

You can use the Storage Gateway management console or CLI to easily create, monitor, and manage Cloud Sync jobs similar to other enterprise NAS backup/replication offerings. Cloud Sync runs as part of the Storage Gateway software inside the Docker instance on the host.