Logstash Engineer


• Design, implement, and maintain Logstash pipelines to aggregate, parse, and
forward logs from various sources (servers, applications, databases).
• Develop Logstash configurations to handle data ingestion, transformation, and
enrichment for real-time and batch data processing.
• Collaborate with teams using Elasticsearch, Kibana, and other tools to provide
effective data visualizations and reporting solutions.
• Monitor and troubleshoot Logstash performance, optimizing throughput and
minimizing latency.
• Integrate Logstash with different input/output plugins (Kafka, RabbitMQ, HTTP, File,
Beats, etc.).
• Work closely with DevOps and Data Engineering teams to ensure the log
management infrastructure is aligned with the broader platform architecture.
• Stay updated with the latest features and updates in Logstash, recommending
upgrades and enhancements to the system.
• Document all Logstash pipelines and processes to ensure maintainability and
scalability.