Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Github runner add benchmark #1599

Merged
merged 103 commits into from
Oct 25, 2024
Merged

Github runner add benchmark #1599

merged 103 commits into from
Oct 25, 2024

Conversation

Assassin718
Copy link
Contributor

@Assassin718 Assassin718 commented Jul 10, 2024 •
edited
Loading

  • 为test/engine新增了benchmark docker-compose启动流程：基于e2e docker-compose启动流程做出修改，去除掉默认启动ilogtail、goc-server容器，新增默认启动cadvisor容器（可以在benchmark时监控容器资源占用）
  • 为test/engine新增了setup/monitor：通过访问cadvisor容器，记录benchmark过程中对应容器的资源占用（目前主要记录了CPU、内存占用的最大值和平均值），统计数据，在benchmark结束后将数据输出到文件中
  • 新增benchmark testcases：添加了ilogtail、filebeat、fluentbit、vector在速率为10MB/s的文件输入、json解析的benchmark testcase，为避免下游接收程序对吞吐量的影响，在flusher侧设置了抛弃所有事件
    benmark CI workflow：在pull request时触发，执行所有benchmark testcase后记录数据，在action中输出benmark结果
  • 以下是可视化结果：
    1846d83df8f11ee6fc37ad3f6531cc70
    ea3928557bccbbbc0a72d7ae3dcf19ca

@CLAassistant
Copy link

CLAassistant commented Jul 10, 2024 •
edited
Loading

CLA assistant check
All committers have signed the CLA.

@Assassin718 Assassin718 reopened this Jul 10, 2024
@Abingcbc Abingcbc marked this pull request as draft July 10, 2024 09:16
@Abingcbc Abingcbc closed this Jul 10, 2024
@Abingcbc Abingcbc reopened this Jul 10, 2024
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch from b17ae40 to 5d85ef1 Compare July 10, 2024 14:16
@Assassin718 Assassin718 marked this pull request as ready for review July 11, 2024 02:16
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch from 5d85ef1 to c690141 Compare July 11, 2024 04:18
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch from c690141 to 88ebf59 Compare July 11, 2024 04:31
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch 10 times, most recently from 09dc837 to 73af851 Compare July 17, 2024 12:47
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch from 73af851 to 6078a37 Compare July 18, 2024 01:26
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch 2 times, most recently from f269180 to cb5545d Compare July 21, 2024 08:37
@Assassin718 Assassin718 force-pushed the e2e-performance-test branch from cb5545d to 49812f9 Compare July 21, 2024 08:39
@Abingcbc Abingcbc changed the title WIP: e2e performance test add benchmark compared with other agent Jul 23, 2024
@messixukejia messixukejia merged commit 05864b7 into alibaba:main Oct 25, 2024
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Abingcbc Abingcbc Abingcbc approved these changes

@messixukejia messixukejia messixukejia approved these changes

@yyuuttaaoo yyuuttaaoo yyuuttaaoo approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@Assassin718 @CLAassistant @yyuuttaaoo @messixukejia @Abingcbc