Extension Amazon S3 cloud storage connector


Extension Basics

Title
Amazon S3 cloud storage connector
Name
ckanext-cloudconnector
Type
Public extension
Description
Store CKAN resources on Amazon S3 cloud storage
CKAN versions
Download-Url (zip)
Download-Url commit date
2015-01-01
Url to repo
Category
Cloud Infrastructure & Storage


Background Infos

Description (long)
Show details

This extension provides cloud storage connectivity for CKAN, specifically supporting Amazon S3 for storing uploaded resources. Features include: Amazon S3 cloud storage integration for resource files, AWS Key and AWS Secret Key authentication, configurable failover behavior (save locally on fail or raise exception), admin UI configuration interface under ‘Cloud connector’ tab, automatic dependency installation (boto library), cloud storage enable/disable toggle. The extension moves resource file storage from local filesystem to AWS S3 buckets, enabling scalable and distributed file storage. Developed for CKAN 2.2 and requires active AWS account with proper credentials. Configuration can be managed either via config file or through the admin settings interface.

Version
0.1
Version release date
2015-01-01
Contact name
Sergey Motornyuk
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Install the extension:

Activate CKAN virtualenv

. /usr/lib/ckan/default/bin/activate

Install from source

cd /some/dir/ckanext-cloudconnector

python setup.py install

Enable the plugin in your CKAN config file:

ckan.plugins = cloud_connector

Configuration settings (can also be configured via Admin UI ‘Cloud connector’ tab):

Enable or disable cloud storage connector

ckan.cloud_storage_enable = true

AWS S3 customer key

ckan.s3_aws_key = YOUR_AWS_S3_KEY

AWS S3 secret key

ckan.s3_secret_key = YOUR_AWS_S3_SECRET

Failover behavior when cloud upload fails:

1 = save file locally as fallback

2 = raise exception (strict cloud-only mode)

ckan.cloud_failover = 1

Restart CKAN:

sudo service apache2 reload

Requirements: - Active AWS account - Valid AWS Key and AWS Secret Key - S3 bucket created for resource storage - boto library (installed automatically as dependency)

Note: Currently supports only Amazon S3. Configuration can be set in config file or managed dynamically through CKAN’s admin interface under the ‘Cloud connector’ tab. All dependencies install automatically during setup.

Plugins to configure (ckan.ini)
cloud_connector
CKAN Settings (ckan.ini)
# ckan.cloud_storage_enable = true|false //is connector enabled or not? # ckan.s3_aws_key = AWS_S3_KEY //customer key of your AWS instance # ckan.s3_secret_key = AWS_S3_SECRET //secret key of your AWS instance # ckan.cloud_failover = 1|2 //1 - save file locally in case of fail, 2 - raise exception
DB migration to be executed
(not set)
<< back to Extensions