Extension S3 Exporter


Extension Basics

Title
S3 Exporter
Name
ckanext-s3-exporter
Type
Public extension
Description
Create dataset resources from AWS S3 bucket files
CKAN versions

~2.9, ~2.10, ~2.11

Show details
Download-Url (zip)
Download-Url commit date
2024-07-08
Url to repo
Category
Cloud Infrastructure & Storage


Background Infos

Description (long)
Show details

Creates dataset resources from files uploaded to AWS S3 bucket. Allows exporting dataset data to S3 storage and automatically creating resources from uploaded files. Compatible with CKAN 2.10+.

Version
1.0.0
Version release date
2024-07-08
Contact name
LinkDigital
Contakt email
(not set)
Contact Url
(not set)


Installation Guide

Configuration hints

Requirements: CKAN 2.10+

Configuration:

ckanext.s3_exporter.access_key = xxx # AWS Access Key ID (required)

ckanext.s3_exporter.secret_key = xxx # AWS Secret Key (required)

ckanext.s3_exporter.bucket_name = xxx # S3 bucket name (required)

ckanext.s3_exporter.queue_name = xxx # Queue for export jobs (optional, uses default queue if not specified)

Installation:

pip install ckanext-s3-exporter

Add s3_exporter to ckan.plugins

Development:

git clone https://github.com/DataShades/ckanext-s3-exporter.git

cd ckanext-s3-exporter

python setup.py develop

pip install -r dev-requirements.txt

Tests:

pytest –ckan-ini=test.ini

Plugins to configure (ckan.ini)
s3_exporter
CKAN Settings (ckan.ini)
(not set)
DB migration to be executed
(not set)
<< back to Extensions