Fluentd output plugin for Site24x7

With Site24x7 plugin for Fluentd, you can parse and send logs directly from Fluentd, without having to use a separate log shipper.

Installation

To add the plugin to your fluentd agent, use the following command:

$ gem install fluent-plugin-site24x7

If you have installed the td-agent instead

$ /usr/sbin/td-agent-gem install fluent-plugin-site24x7

Usage

Configure the output plugin

To match events and send them to Site24x7, add the following code to your configuration file.

# Match events tagged with "site24x7.**" and send them to Site24x7
<match site24x7.**>

  @type site24x7
  @id site24x7_agent
  log_type_config <your_log_type_config>

  # Optional parameters
  max_retry '3'
  retry_interval '2'
  http_idle_timeout '5'
  http_read_timeout '30'
  
  # Optional http proxy
  http_proxy 'http://user:[email protected]:proxy.port'

  <buffer>
          @type memory
          flush_thread_count 4
          flush_interval 3s
          chunk_limit_size 5m
          chunk_limit_records 500
  </buffer>

</match>

After restarting FluentD, any events tagged with site24x7 are shipped to Site24x7 platform.

Parameters

As fluent-plugin-site24x7 is an output_buffer, you can set all the output_buffer properties like it's described in the fluentd documentation.

Property	Description	Default Value
log_type_config	log_type_config of your configured log type in site24x7	nil
max_retry	Number of times to resend failed uploads. Set to -1 for unlimited retries	-1
retry_interval	Time interval to sleep initially between retries, exponential step-off	2 seconds
maxretry_interval	Maximum interval to wait between sending retries	60 seconds
retry_timeout	Time after which the data is going to be dropped	24 hours
http_idle_timeout	Timeout (in seconds) for which http persistent connection will stay open without traffic	5 seconds
http_read_timeout	Timeout (in seconds) when the socket connects until the connection breaks	30 secods
http_proxy	Your proxy uri	nil

Release Notes

• 0.1.7 - Sending stop signal to Fluentd for unrecoverable errors
• 0.1.6 - chunk unique id added for each upload and unlimited retry support
• 0.1.5 - Retry handled for empty upload-id
• 0.1.4 - Multi-line log, masking, hasing and derived fields support added
• 0.1.3 - JSON log parsing issue fixed
• 0.1.2 - Timezone parsing issue fixed
• 0.1.1 - Minor changes
• 0.1.0 - Initial Release