Extension Harvest Basket


Extension Basics

Title
Harvest Basket
Name
ckanext-harvest-basket
Type
Public extension
Description
Collection of custom harvesters for CKAN, ODS, ArcGIS, Socrata, DKAN, Junar and other data platforms
CKAN versions

~2.9, ~2.10, ~2.11

Show details
Download-Url (zip)
Download-Url commit date
2025-06-05
Url to repo
Category
Data Management & Quality


Background Infos

Description (long)
Show details

The harvest-basket extension provides a comprehensive set of custom harvesters for CKAN, making it easy to gather data from various platforms including ODS, ArcGIS, Socrata, DKAN, Junar, CSIRO, CSW, and DCAT JSON sources. The extension automatically pulls datasets from different sources into your CKAN instance. Key features include integration with ckanext-transmute for dataset transformation during harvesting, source checkup preview that tests connectivity and harvests one sample dataset when creating a source, and anonymous user access restrictions for harvester pages. Available harvesters: DKAN, Junar, Socrata, ArcGIS, Custom CKAN, ODS, DCAT JSON, CSW, and CSIRO. Full documentation available at https://datashades.github.io/ckanext-harvest-basket/

Version
1.5.3
Version release date
2025-06-05
Contact name
DataShades
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Installation: pip install ckanext-harvest-basket

Optional CSW support: pip install ckanext-harvest-basket[csw]

Development installation: git clone https://github.com/DataShades/ckanext-harvest-basket.git cd ckanext-harvest-basket pip install -e ‘.[dev]’

Add to ckan.plugins (main plugin + desired harvesters): ckan.plugins = … harvest_basket arcgis_harvester socrata_harvester dkan_harvester junar_harvester ods_harvester custom_ckan_harvester basket_dcat_json_harvester basket_csw_harvester basket_csiro_harvester …

Available harvesters: - dkan_harvester: DKAN platform harvester - junar_harvester: Junar platform harvester - socrata_harvester: Socrata platform harvester - arcgis_harvester: ArcGIS platform harvester - custom_ckan_harvester: Custom CKAN harvester - ods_harvester: OpenDataSoft (ODS) harvester - basket_dcat_json_harvester: DCAT JSON harvester - basket_csw_harvester: CSW (Catalogue Service for the Web) harvester (requires OWSLib) - basket_csiro_harvester: CSIRO platform harvester

Requirements: - ckanext-transmute>=1.7.0,<2 (for dataset transformation) - html2markdown>=0.1.7,<1 - geojson>=2.5.0,<4 - jsonschema>=3.0.0,<4 - OWSLib>=0.31.0,<1 (optional, for CSW harvester)

Features: - Integration with ckanext-transmute for dataset transformation during harvest - Source checkup preview: tests connectivity and harvests sample dataset - Anonymous user restrictions for harvester pages - Supports harvest source configuration for transformations

Documentation: https://datashades.github.io/ckanext-harvest-basket/

Testing: pytest –ckan-ini=test.ini

Plugins to configure (ckan.ini)
harvest_basket dkan_harvester junar_harvester socrata_harvester arcgis_harvester custom_ckan_harvester ods_harvester basket_dcat_json_harvester basket_csw_harvester basket_csiro_harvester
CKAN Settings (ckan.ini)
(not set)
DB migration to be executed
(not set)
<< back to Extensions