Extension Logstash Integration


Extension Basics

Title
Logstash Integration
Name
ckanext-logstash
Type
Public extension
Description
Elasticsearch Logstash integration for advanced logging, monitoring, and analytics capabilities.
CKAN versions
Download-Url (zip)
Download-Url commit date
2019-10-17
Url to repo
Category
Visualization & Analytics


Background Infos

Description (long)
Show details

The Logstash Integration extension provides comprehensive integration between CKAN and the Elasticsearch Logstash pipeline, enabling advanced logging, real-time monitoring, and sophisticated analytics through structured log data processing and centralized log management for enhanced system observability and performance analysis. This essential extension automatically forwards CKAN application logs, user activity data, and system metrics to Logstash for processing, enrichment, and forwarding to Elasticsearch or other analytics platforms for comprehensive monitoring and analysis. The system supports structured logging with customizable log formats, automatic log enrichment with contextual metadata, and real-time log streaming for immediate monitoring and alerting capabilities. Advanced features include user activity tracking, API usage analytics, performance metrics collection, and security event logging with configurable filtering and routing rules for different log types and severity levels. The extension provides integration with popular monitoring stacks including the ELK (Elasticsearch, Logstash, Kibana) stack, Elastic Cloud, and other log analysis platforms through flexible output configuration options. Administrative tools include log configuration management, performance monitoring for log processing, and integration with alerting systems for automated incident response. Integration capabilities extend to external monitoring services, SIEM platforms, and business intelligence systems through standardized log formats and API integration. The system supports custom log parsing rules, field extraction and transformation, and integration with organizational logging standards for consistent monitoring across infrastructure components. Performance optimizations ensure efficient log processing with minimal application overhead, buffered log transmission, and failover capabilities for reliable log delivery. Essential for production CKAN deployments requiring comprehensive monitoring, enterprise environments with centralized logging infrastructure, organizations implementing security monitoring and compliance, and installations where system observability, performance analysis, and operational intelligence are critical for maintaining reliable service delivery and proactive issue resolution.

Version
Latest
Version release date
2019-10-17
Contact name
Datopian Team
Contakt email
Contact Url
(not set)


Installation Guide

Configuration hints

Integrates with Logstash for advanced logging and monitoring.

Plugins to configure (ckan.ini)
logstash
CKAN Settings (ckan.ini)
# ckanext.logstash.host = localhost # ckanext.logstash.port = 5044 # ckanext.logstash.protocol = tcp # ckanext.logstash.enable_user_tracking = true # ckanext.logstash.enable_api_logging = true # ckanext.logstash.log_level = INFO # ckanext.logstash.buffer_size = 1000
DB migration to be executed
(not set)
<< back to Extensions