Back to Docs

Cold Storage Archives

Learn how to manage historical telemetry data, configure cloud storage, and automate database cleanups.

Overview

Monitor Hub tracks metrics at sub-minute intervals. To maintain optimal database performance and reduce database storage overhead, historical telemetry (website response time metrics and server telemetry metrics) is cleared from primary storage.

With Cold Storage Archives, you can automatically bundle, compress, encrypt, and upload older data to your own cloud storage. Once an archive is verified to exist on your provider, the archived records are safely removed from the active database.

Automated Cleanup

Cleans Postgres in chunks of 50k rows to avoid lock escalation.

GZIP Compression

Bundles metrics in `.json.gz` formats, reducing file size by up to 90%.

Configuration & Credentials

Navigate to Dashboard > Cold Storage Archives > Storage Settings. Choose your provider and paste the matching JSON credentials block into the textarea.

AWS S3 / Cloudflare R2 / Backblaze B2

Provide access keys, target bucket, and region. For Cloudflare R2 or Backblaze B2, include the custom endpoint URL.

{
  "accessKeyId": "AKIAIOSFODNN7EXAMPLE",
  "secretAccessKey": "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY",
  "region": "us-east-1",
  "bucket": "my-uptime-archives",
  "endpoint": "https://<account_id>.r2.cloudflarestorage.com" // (Optional - required for R2/B2)
}

Google Drive

Provide an OAuth Access Token. To store files in a specific directory, add a destination Google Drive Folder ID.

{
  "accessToken": "ya29.a0AfB_byDEXAMPLE...",
  "folderId": "1a2b3c4d5e6f7g8h9i0j-EXAMPLE" // (Optional)
}

Dropbox & Microsoft OneDrive

Provide a valid OAuth Access Token with read/write file scope permissions.

{
  "accessToken": "sl.BEXAMPLE_access_token_here..."
}

Usage Modes

Auto-Archival

Toggle "Enable Auto-Archival" and set the retention threshold (e.g., 30 Days). A background scheduler checks your logs nightly. Any records older than 30 days are automatically archived and cleaned up.

Manual Archival

Click "Archive Now" in the top-right corner. This immediately schedules archival jobs for both your website monitors and server agents, processing all metrics matching your retention period limit.

Troubleshooting

Error: Credentials must be valid JSON

Ensure you are pasting a valid JSON object. Verify there are no trailing commas, double-quotes are used for all keys/values, and brackets are balanced.

Upload verification failed or "Failed to generate download link"

Monitor Hub verifies files after uploading. If this fails, double-check that your API token hasn't expired (common for Google Drive and OneDrive short-lived tokens) and that the AWS IAM User has `s3:PutObject`, `s3:GetObject`, and `s3:HeadObject` permissions.

Archive Status stays "Pending"

Archiving is handled asynchronously. If it's stuck in pending, verify that the backend worker server (`BullMQ`) is running and connected to your Redis instance.