| Package | Description |
|---|---|
| com.google.cloud.hadoop.gcsio | |
| com.google.cloud.hadoop.gcsio.testing |
| Modifier and Type | Class and Description |
|---|---|
class |
CacheSupplementedGoogleCloudStorage
CacheSupplementedGoogleCloudStorage adds additional book-keeping to a GoogleCloudStorage instance
using a
DirectoryListCache and wraps the create/copy/delete/list methods to provide
immediate same-client consistency for "list" operations following a "create/copy/delete". |
class |
GoogleCloudStorageImpl
Provides read/write access to Google Cloud Storage (GCS), using Java nio channel semantics.
|
class |
MetadataReadOnlyGoogleCloudStorage
MetadataReadOnlyGoogleCloudStorage holds a collection of Storage object/bucket metadata entries
and serves listObjectNames, listObjectInfo, getItemInfos, and getItemInfo exclusively from the
in-memory cache.
|
class |
ThrottledGoogleCloudStorage
Throttled GCS implementation that will limit our bucket creation and delete operations
to N per second.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
GoogleCloudStorageImpl.validateCopyArguments(String srcBucketName,
List<String> srcObjectNames,
String dstBucketName,
List<String> dstObjectNames,
GoogleCloudStorage gcsImpl)
Validates basic argument constraints like non-null, non-empty Strings, using
Preconditions in addition to checking for src/dst bucket existence and compatibility of bucket
properties such as location and storage-class. |
| Constructor and Description |
|---|
CacheSupplementedGoogleCloudStorage(GoogleCloudStorage gcsDelegate,
DirectoryListCache resourceCache)
Constructs a CacheSupplementedGoogleCloudStorage that should be usable anywhere a
GoogleCloudStorage interface is used and that supplements missing listObject/listBucket
results from an in-memory cache of known GCS resources that may not have propagated into
the eventually-consistent remote "list" index yet.
|
GoogleCloudStorageFileSystem(GoogleCloudStorage gcs)
Constructs a GoogleCloudStorageFilesystem based on an already-configured underlying
GoogleCloudStorage
gcs. |
GoogleCloudStorageFileSystem(GoogleCloudStorage gcs,
GoogleCloudStorageFileSystemOptions options)
Constructs a GoogleCloudStorageFilesystem based on an already-configured underlying
GoogleCloudStorage
gcs. |
ThrottledGoogleCloudStorage(double operationsPerSecond,
GoogleCloudStorage wrappedGcs,
EnumSet<ThrottledGoogleCloudStorage.StorageOperation> throttledOperations) |
ThrottledGoogleCloudStorage(GoogleCloudStorage wrappedGcs,
com.google.common.util.concurrent.RateLimiter rateLimiter)
Construct a ThrottledGoogleCloudStorage object that throttles all operations.
|
ThrottledGoogleCloudStorage(com.google.common.util.concurrent.RateLimiter rateLimiter,
GoogleCloudStorage wrappedGcs,
EnumSet<ThrottledGoogleCloudStorage.StorageOperation> throttledOperations) |
| Modifier and Type | Class and Description |
|---|---|
class |
InMemoryGoogleCloudStorage
InMemoryGoogleCloudStorage overrides the public methods of GoogleCloudStorage by implementing
all the equivalent bucket/object semantics with local in-memory storage.
|
Copyright © 2016. All rights reserved.