Overview

Migrating from Cloudflare R2 to Google Cloud Storage (GCS) enables integration with GCP's powerful analytics, machine learning, and data processing services. This guide provides a comprehensive walkthrough of the migration process using Cloney.

Migration Benefits

GCS offers seamless integration with BigQuery, Cloud Functions, Vertex AI, and other GCP services for advanced data analytics and processing.

Prerequisites

  • A Cloney account with an active subscription
  • Cloudflare R2 bucket with data to migrate
  • Google Cloud Storage bucket created (destination)
  • Appropriate credentials for both services

Setup Access Credentials

Before proceeding, ensure you have configured least privilege access for both services:

Cloudflare R2: Least Privilege AccessGoogle Cloud: Least Privilege Access Setup

Step 1: Add Your Cloudflare R2 Source

  1. Log in to your Cloney dashboard
  2. Navigate to Jobs → Create New Job
  3. Select Cloudflare R2 as your source provider
  4. Enter your R2 credentials:
    • Account ID: Your Cloudflare account ID
    • Access Key ID: Your R2 API token access key
    • Secret Access Key: Your R2 API token secret key
    • Bucket Name: The name of your source R2 bucket
  5. Click Validate Connection to verify access

Step 2: Configure Your GCS Destination

  1. Select Google Cloud Storage as your destination provider
  2. Upload your GCP service account JSON key file or enter credentials manually:
    • Project ID: Your GCP project identifier
    • Service Account Email: The service account email address
    • Private Key: The service account private key
    • Bucket Name: The name of your destination GCS bucket
  3. Click Validate Connection to verify access

Step 3: Configure Migration Options

Customize your migration with these options:

OptionDescriptionRecommendation
Prefix/Path FilterMigrate only objects matching a specific prefixUse for partial migrations
Preserve MetadataCopy object metadata along with dataEnable for full fidelity
Storage ClassSet the GCS storage class for migrated objectsStandard for frequent access
Overwrite ExistingReplace objects that already exist in destinationEnable for sync operations

Step 4: Start the Migration

  1. Review your migration configuration
  2. Click Start Migration
  3. Monitor progress in the Jobs dashboard
  4. Cloney will provide real-time updates on transfer progress
Migration Complete

Once finished, verify your data in the GCS console and update your applications.

GCS Storage Class Options

Choose the appropriate GCS storage class based on your access patterns:

Access PatternGCS ClassUse Case
Frequent accessStandardHot data, frequently accessed
Monthly accessNearlineBackups, data accessed monthly
Quarterly accessColdlineDisaster recovery, quarterly access
Yearly accessArchiveLong-term archival, compliance

Best Practices

  • Enable Object Versioning: Turn on versioning in GCS for data protection.
  • Use Autoclass: Let GCS automatically manage storage classes based on access patterns.
  • Integrate with BigQuery: Use BigQuery external tables to query data directly in GCS.
  • Set Up Cloud Functions: Trigger serverless functions on object uploads for processing.