-
Notifications
You must be signed in to change notification settings - Fork 1
Logstash Configurator Generator
roxmer edited this page Apr 28, 2017
·
8 revisions
This program is a jar file in the server that automates the process of creating the configuration files for each client in the federation. The configuration files are processed by Logstash to temporarily store the beats data in the database and then to create the index in ElasticSearch to be visualized and explored in Kibana. The logstash-configuration-generator program should be located in the server of the federation.
- Each new member of the federation will map its data to the standard of the federation and provide the management of the federation with the results from the mapping.
- A server administrator will run the logstash-configuration-generator for each new member. the result of the data will be automatically placed in the configuration folders used by Logstash.
- A notification should be sent to the member to start the local Filebeat in the client to start listening to the data repository where the data to be shared is located.
- In the server, 2 instances of Logstash are runing together with one instance of ElasticSearch to procese the beat data and create the index. Kibana is runing as a web service to visualice the index.
logstash-configuration-generator < port >,< path-entity >,< prefix >,< path-mapping >,< type >,< deep >,< path-mysql >,< dbname >,< dbuser >,< dbpassword >
- port: port used by filebeat in the clients (5066)
- path-entity: Complete path to the standard definition entity.json in the the server (C:\workspace\LogstashConfigurationGenerator\resources\entity\entity.json)
- prefix: unique prefix used to merge with the key filed in the data to make it uniquely identify documents (rows) (KIBB)
- path-mapping: path to the folder where mapping results are stored for the given client (C:\workspace\LogstashConfigurationGenerator\resources\logstashtestfiles)
- type: Type given to the organization to configure the local filebeat file (ki_data)
- deep: deep of the local repository of the client (3)
- path-mysql: Path to the MySQL connector in java (C:/logstash-5.0.1/mysql-connector-java-5.1.40-bin.jar)
- dbname: name of the database (miabis-federation)
- dbuser: root name for the database (root)
- dbpassword: password for the root of the database (********)