Extension Amazon S3 File Storage


Extension Basics

Title
Amazon S3 File Storage
Name
ckanext-s3filestore
Type
Public extension
Description
Amazon S3 cloud storage integration for CKAN file uploads and resource management with enhanced performance.
CKAN versions
Download-Url (zip)
Download-Url commit date
2024-08-22
Url to repo
Category
Cloud Infrastructure & Storage


Background Infos

Description (long)
Show details

The Amazon S3 File Storage extension provides seamless integration between CKAN and Amazon S3 cloud storage services, enabling scalable, reliable, and cost-effective file storage for CKAN instances. This essential extension replaces the default local file storage with S3 bucket storage, supporting automatic uploads, intelligent file organization, and optimized download handling through S3’s global content delivery network. The system provides transparent file operations where users experience no difference in upload or download workflows while benefiting from enterprise-grade cloud storage capabilities. Advanced features include multipart upload support for large files, automatic MIME type detection, configurable bucket organization, and integration with AWS IAM for fine-grained access control. The extension supports multiple S3-compatible storage providers including AWS S3, DigitalOcean Spaces, and MinIO for hybrid cloud deployments. Performance optimizations include direct S3 streaming, bandwidth management, and CDN integration for global file delivery. Security features provide encrypted storage, signed URL generation for secure downloads, and comprehensive access logging. Administrative tools include storage analytics, cost monitoring, and batch migration utilities for existing file stores. Essential for high-traffic CKAN instances requiring scalable storage, organizations with global user bases needing fast file access, and deployments where local storage limitations, backup requirements, or disaster recovery capabilities make cloud storage strategically necessary.

Version
Latest
Version release date
2024-08-22
Contact name
Datopian Team
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Requires AWS S3 bucket and credentials configuration for cloud file storage

Plugins to configure (ckan.ini)
s3filestore
CKAN Settings (ckan.ini)
# ckanext.s3filestore.aws_bucket_name = 'your-ckan-bucket' # ckanext.s3filestore.aws_access_key_id = 'your_access_key' # ckanext.s3filestore.aws_secret_access_key = 'your_secret_key' # ckanext.s3filestore.region_name = 'us-east-1' # ckanext.s3filestore.signature_version = 's3v4' # ckanext.s3filestore.use_https = true
DB migration to be executed
(not set)
<< back to Extensions