S3
- How to delete a large S3 bucket on Creodias
- How to mount object storage container as a file system in Linux using s3fs on Creodias
- What we are going to cover
- Prerequisites
- Step 1: Sign in to your Linux machine
- Step 2: Install s3fs
- Step 3: Create file or files containing login credentials
- Step 4: Create mount points
- Step 5: Mount a container
- Unmounting a container
- Configuring automatic mounting of your object storage
- Stopping automatic mounting of a container
- Potential problems with the way s3fs handles objects
- What to do next
- Bucket sharing using s3 bucket policy on Creodias
- How to use Object Storage on Creodias
- What We Are Going To Cover
- Prerequisites
- Creating a new object storage container
- Viewing the container
- Creating a new folder
- Navigating through folders
- Uploading a file
- Deleting files and folders from a container
- Recommended number of files in your object storage containers
- Working with public object storage containers
- What To Do Next
- How to access private object storage using S3cmd or boto3 on Creodias
- S3FS cache on Creodias
- How to install boto3 in Windows on Creodias
- Server-Side Encryption with Customer-Managed Keys (SSE-C) on Creodias
- How to mount object storage container from Creodias as file system on local Windows computer
- Prerequisites
- What we are going to cover
- Software tools used in this article
- How to use the Rclone configuration file
- Step 1: Download and install the required software
- Step 2: Enter the connection data
- Step 3: Perform a test mount
- Step 4: Tweak the –dir-cache-time option
- Step 5: Configure automatic mounting of your container
- Removing software responsible for automatic mounting of object storage
- What to do next
- Create an S3 bucket and use it in Sentinel Hub requests
- Prerequisites
- Step 1: Create CREODIAS account using CDSE login
- Step 2: Complete the account
- Step 3: Define an organization
- Step 4: Create a new project in the WAW3-1 region
- Step 5: Access the OpenStack environment
- Step 6: Create an S3 bucket in WAW3-1
- Step 7: Generate EC2 credentials for WAW3-1
- Step 8: Configure s3cmd for WAW3-1
- Step 9: Set bucket policy
- How to install s3cmd on Linux on Creodias
- Configuration files for s3cmd command on Creodias
- How to access object storage from Creodias using boto3
- Prerequisites
- Terminology: containers vs. buckets
- How to use the examples provided
- Running Python code
- Listing buckets
- Choosing a bucket for the examples
- Creating a bucket, if needed
- Checking when a bucket was created
- Listing files in a bucket
- Listing files from a particular path in a bucket
- Uploading file to a bucket
- Downloading file from a bucket
- Removing file from a bucket
- Removing a bucket
- General troubleshooting
- What to do next
- How to access object storage from Creodias using s3cmd
- What we are going to cover
- Prerequisites
- Object storage and standard file systems
- Terminology: containers and buckets
- Configuring s3cmd
- S3 paths in s3cmd
- Listing buckets
- Choosing a bucket for the examples
- Creating a bucket, if needed
- Uploading a file to a bucket
- Listing files and folders in the root of a bucket
- Listing files and folders below a prefix
- Removing a file from a bucket
- Downloading a file from a bucket
- Checking how much storage is used by a bucket
- Removing a bucket
- What to do next
- S3 bucket object versioning on Creodias
- Prerequisites
- What we are going to cover
- Configuring and testing AWS CLI
- Choosing bucket names
- Creating a bucket, if needed
- Enabling versioning on a bucket
- Uploading the first version of a file
- S3 paths
- Uploading another version of a file
- Listing available versions of a file
- Downloading a chosen version of a file
- Deleting objects on version-enabled buckets
- Using lifecycle policy to configure automatic deletion of previous versions
- Suspending versioning
- What to do next