docker-logstash

This project is not aimed at public consumption. It exists to serve as a single endpoint for SICZ containers.

Logstash is an advanced open source ETL processor.

Contents

This images only contains essential components:

• sicz/openjdk:8-jre-centos as a base image.
• Logstash is an advanced open source ETL processor.
• Logstash X-Pack plugin adds monitoring to Logstash.

Getting started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Installing

Clone the GitHub repository into your working directory:

git clone https://github.com/sicz/docker-logstash

Usage

The project contains Docker image version directories:

• x.y.z - Logstash
• x.y.z/x-pack - Logstash with X-Pack plugin
• x.y.z/dev - Logstash with X-Pack plugin, Java JDK and Ruby development tools

Use the command make in the project directory:

make all                      # Build and test all Docker images
make build                    # Build all Docker images
make rebuild                  # Rebuild all Docker images
make clean                    # Remove all containers and clean work files
make docker-pull              # Pull all images from Docker Registry
make docker-pull-baseimage    # Pull the base image from the Docker Registry
make docker-pull-dependencies # Pull all image dependencies from Docker Registry
make docker-pull-image        # Pull all project images from Docker Registry
make docker-pull-testimage    # Pull all project images from Docker Registry
make docker-push              # Push all project images to Docker Registry

Use the command make in the image version directories:

make all                      # Build a new image and run the tests
make ci                       # Build a new image and run the tests
make build                    # Build a new image
make rebuild                  # Build a new image without using the Docker layer caching
make config-file              # Display the configuration file for the current configuration
make vars                     # Display the make variables for the current configuration
make up                       # Remove the containers and then run them fresh
make create                   # Create the containers
make start                    # Start the containers
make stop                     # Stop the containers
make restart                  # Restart the containers
make rm                       # Remove the containers
make wait                     # Wait for the start of the containers
make ps                       # Display running containers
make logs                     # Display the container logs
make logs-tail                # Follow the container logs
make shell                    # Run the shell in the container
make test                     # Run the tests
make test-shell               # Run the shell in the test container
make clean                    # Remove all containers and work files
make docker-pull              # Pull all images from the Docker Registry
make docker-pull-baseimage    # Pull the base image from the Docker Registry
make docker-pull-dependencies # Pull the project image dependencies from the Docker Registry
make docker-pull-image        # Pull the project image from the Docker Registry
make docker-pull-testimage    # Pull the test image from the Docker Registry
make docker-push              # Push the project image into the Docker Registry

The logstash container requires a pipeline configuration, otherwise it can not be run.

Deployment

You can start with this sample docker-compose.yml file:

services:
  logstash:
    image: sicz/logstash
    command: -f pipeline
    ports:
      - 514:514/udp
      - 514:514/tcp
      - 5044:5044/tcp
    volumes:
      - ./config:/usr/share/logstash/pipeline
      - logstash_data:/usr/share/logstash/data
volumes:
  logstash_data:

Authors

• Petr Řehoř - Initial work.

See also the list of contributors who participated in this project.

License

This project is licensed under the Apache License, Version 2.0 - see the LICENSE file for details.