Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLIP-481][FLINK-37426] Introduce Event Reporting #26316

Open
wants to merge 12 commits into
base: master
Choose a base branch
from

Conversation

pnowojski
Copy link
Contributor

What is the purpose of the change

https://cwiki.apache.org/confluence/display/FLINK/FLIP-481%3A+Introduce+Event+Reporting

Brief change log

Please check the individual commit mesages.

Verifying this change

Refactoring is covered by the existing tests. For Events reporting this adds bunch of new tests, including an ITCase integrating with Otel container.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
  • The serializers: (yes / no / don't know)
  • The runtime per-record code paths (performance sensitive): (yes / no / don't know)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
  • The S3 file system connector: (yes / no / don't know)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@flinkbot
Copy link
Collaborator

flinkbot commented Mar 18, 2025

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

<td><h5>events.reporter.&lt;name&gt;.filter.includes</h5></td>
<td style="word-wrap: break-word;">"*:*:*"</td>
<td>List&lt;String&gt;</td>
<td>The events that should be included for the reporter named &lt;name&gt;. Filters are specified as a list, with each filter following this format:<br /><code class="highlighter-rouge">&lt;scope&gt;[:&lt;name&gt;[,&lt;name&gt;]]</code><br />An event matches a filter if the scope pattern and at least one of the name patterns match.<br /><ul><li>scope: Filters based on the logical scope.<br />Specified as a pattern where <code class="highlighter-rouge">*</code> matches any sequence of characters and <code class="highlighter-rouge">.</code> separates scope components.<br /><br />For example:<br /> "<code class="highlighter-rouge">jobmanager.job</code>" matches any job-related events on the JobManager,<br /> "<code class="highlighter-rouge">*.job</code>" matches all job-related events and<br /> "<code class="highlighter-rouge">*.job.*</code>" matches all events below the job-level (i.e., task/operator events etc.).<br /><br /></li><li>name: Filters based on the event name.<br />Specified as a comma-separate list of patterns where <code class="highlighter-rouge">*</code> matches any sequence of characters.<br /><br />For example, "<code class="highlighter-rouge">*Records*,*Bytes*</code>" matches any event where the name contains <code class="highlighter-rouge">"Records" or "Bytes"</code>.</li></ul></td>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: comma-separate -> comma separated

Copy link
Contributor

@davidradl davidradl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I notice that we are using open telemetry libraries. Can we promote in the docs how we are using open telemetry with this Flip and how it might ease Flink open telemetry adoption.

Copy link
Contributor

@StefanRRichter StefanRRichter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants