Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zstd: introduce zstd compression support in Fluent Bit #9830

Closed
wants to merge 19 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
70a8c67
lib: zstd: add v1.5.6
robskillington Jan 13, 2025
c168031
zstd: add new compress/uncompress zstd interface
edsiper Jan 13, 2025
7348ccb
tests: internal: add unit test for zstd interface
edsiper Jan 13, 2025
a745400
build: link to zstd
edsiper Jan 13, 2025
fab6bdc
http_common: implement zstd wrapers
robskillington Jan 13, 2025
d5dca8f
out_opentelemetry: add support for zstd compression
edsiper Jan 14, 2025
753303c
http_client: add api to set zstd content-encoding
edsiper Jan 14, 2025
0360731
http_common: fix return value for zstd uncompress
edsiper Jan 14, 2025
58382e2
out_opentelemetry: set proper content encoding for HTTP/1.x
edsiper Jan 14, 2025
60d9103
workflows: macos: Build Intel Mac packages by macos-14-large runner
cosmo0920 Jan 15, 2025
aca2295
hash_table: added optional case insensitive mode
leonardo-albertovich Jan 17, 2025
a95f939
http_client: moved additional headers after the standard header set
leonardo-albertovich Jan 17, 2025
dd006bd
http_common: updated to use the hash table in caseless mode
leonardo-albertovich Jan 17, 2025
a691f5e
hash_table: add missing header to build on macOS
edsiper Jan 17, 2025
a565b0d
lib: monkey: upgrade to v1.8.2
edsiper Jan 17, 2025
56567e5
in_opentelemetry: adjust error log messages
edsiper Jan 17, 2025
f37d4cc
out_opentelemetry: set grpc flag when paylaod is compressed
edsiper Jan 17, 2025
391ce85
out_opentelemetry: do not set gRPC compression flag
edsiper Jan 21, 2025
6d9071f
in_opentelemetry: add missing group footer when processing protobuf
edsiper Jan 21, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
in_opentelemetry: add missing group footer when processing protobuf
Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
  • Loading branch information
edsiper committed Jan 21, 2025
commit 6d9071f69dabc06ddbf22996ba4344ba3b0bbeb0
6 changes: 4 additions & 2 deletions plugins/in_opentelemetry/opentelemetry_prot.c
Original file line number Diff line number Diff line change
Expand Up @@ -589,6 +589,7 @@ static int binary_payload_to_msgpack(struct flb_opentelemetry *ctx,
msgpack_pack_str(&mp_pck, 8);
msgpack_pack_str_body(&mp_pck, "resource", 8);

/* resource header content */
flb_mp_map_header_init(&mh_tmp, &mp_pck);

/* look for OTel resource attributes */
Expand All @@ -612,7 +613,7 @@ static int binary_payload_to_msgpack(struct flb_opentelemetry *ctx,
msgpack_pack_uint64(&mp_pck, resource->dropped_attributes_count);
}


flb_mp_map_header_end(&mh_tmp);

if (resource_log->schema_url) {
flb_mp_map_header_append(&mh);
Expand Down Expand Up @@ -1819,13 +1820,14 @@ static int process_payload_logs(struct flb_opentelemetry *ctx, struct http_conn
struct mk_http_request *request)
{
struct flb_log_event_encoder *encoder;
int ret;
int ret = -1;

encoder = flb_log_event_encoder_create(FLB_LOG_EVENT_FORMAT_FLUENT_BIT_V2);
if (encoder == NULL) {
return -1;
}


/* Check if the incoming payload is a valid JSON message and convert it to msgpack */
if (strncasecmp(request->content_type.data,
"application/json",
Expand Down
Loading