1.1.0

Metrics

This release adds metrics to the loader.

Each time the loader performs a load into Redshift (after reading a message from SQS), these metrics are exported :

• latency_collector_to_load_min: delay between maximum collector timestamp and load timestamp in seconds
• latency_collector_to_load_max: delay between minimum collector timestamp and load timestamp in seconds
• latency_shredder_start_to_load: delay between start of shredder and load timestamp in seconds
• latency_shredder_end_to_load: delay between end of shredder and load timestamp in seconds
• count_good: number of good events loaded

These metrics can be exported to 2 different places (possibly at the same time):

• A statsd server
• In the logs, with one line per metric

This can be configured with this new part of the configuration file.

Under the hood

• The loader now uses slf4j for logging. For instance it's now possible to set the log level by adding -Dorg.slf4j.simpleLogger.defaultLogLevel=ERROR to JAVA_OPTS when running the Docker image.
• The jars are now automatically attached to a release on Github.