Extension Blob Storage


Extension Basics

Title
Blob Storage
Name
ckanext-blob-storage
Type
Public extension
Description
Cloud storage extension for offloading file storage to external providers like S3, GCS, Azure.
CKAN versions

~2.8.0, ~2.9.0

Show details
Download-Url (zip)
Download-Url commit date
2024-07-06
Url to repo
Category
Cloud Infrastructure & Storage


Background Infos

Description (long)
Show details

The Blob Storage extension revolutionizes CKAN’s file management by replacing the default local storage system with a sophisticated cloud-native solution. This extension enables direct browser-to-cloud uploads, bypassing CKAN servers entirely for improved performance and scalability. It supports major cloud providers including Amazon S3, Google Cloud Storage, Azure Blob Storage, and custom storage backends through a pluggable architecture. The extension implements Git LFS protocol standards, allowing seamless integration with Git-based workflows and third-party tools. Authentication is handled through JWT tokens via ckanext-authz-service, ensuring secure access control. Files are managed with SHA256 hashing for integrity verification and include comprehensive metadata tracking. The system dramatically reduces server load by eliminating file proxy operations while maintaining full CKAN compatibility. Essential for large-scale data portals requiring enterprise-grade storage solutions with high availability, disaster recovery, and cost optimization through cloud provider features.

Version
0.9.0
Version release date
2023-01-03
Contact name
Datopian Team
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Requires external Git LFS server (Giftless recommended) and ckanext-authz-service.

Plugins to configure (ckan.ini)
blob_storage
CKAN Settings (ckan.ini)
# ckanext.blob_storage.storage_service_url = 'https://your-lfs-server.com' # ckanext.blob_storage.storage_namespace = my-ckan-instance
DB migration to be executed
(not set)
<< back to Extensions