Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Patch 8 - check but is redundant? #8

Open
wants to merge 54 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
5cc5dad
rmw_fastrtps_cpp report 2021 (#44)
IkerLuengo Oct 5, 2021
ed10fb7
Change ROS2 -> ROS 2 in the eProsima Humble report. (#60)
clalancette Oct 5, 2021
526a461
Remove trailing whitespace from eProsima report. (#61)
clalancette Oct 5, 2021
78a7049
In the eProsima report, change cycloneDDS -> Cyclone DDS (#62)
clalancette Oct 5, 2021
f8a7eef
Fix up image rendering in the eProsima response. (#63)
clalancette Oct 5, 2021
a5ef75d
Fix the links to the eProsima images. (#64)
clalancette Oct 5, 2021
3ecc957
Fix a number of very minor typos in the eProsima part of the report. …
clalancette Oct 5, 2021
4b919f5
The Humble report for Eclipse Cyclone DDS (#66)
clalancette Oct 7, 2021
e2edf23
Remove trailing whitespace from Cyclone DDS report.
clalancette Oct 6, 2021
2f61a6e
Remove width=50% from images in Cyclone DDS report.
clalancette Oct 6, 2021
18e2814
Get the report skeleton in place. (#68)
clalancette Oct 7, 2021
1504969
Fix cyclone typos and fix quality link (#69)
paudrow Oct 7, 2021
4a67e9c
Minor fixes to links in eProsima response. (#70)
clalancette Oct 8, 2021
7cea742
Try to fix the table formatting for REP-2004. (#71)
clalancette Oct 8, 2021
14c8052
Add in a discussion for the REP-2004 table. (#72)
clalancette Oct 8, 2021
57450b4
Rerun the objective measurements for Humble (#73)
clalancette Oct 8, 2021
d09ffe2
change link caption for Fast DDS response (#74)
IkerLuengo Oct 11, 2021
cb5ec42
Write large pieces of the Humble report.
clalancette Oct 8, 2021
b333231
Typos and formatting changes
paudrow Oct 12, 2021
1e7ecee
Exec summary + number sections
paudrow Oct 12, 2021
cd45b25
Add an Appendix and do some editing.
clalancette Oct 12, 2021
a6ec342
Updated dates on data to correct date, made nb easier to change date,…
kscottz Oct 12, 2021
2267687
Merge pull request #76 from osrf/humble-additions
kscottz Oct 12, 2021
39ff434
Early redacted data, will update later.
kscottz Oct 12, 2021
c369466
plots for new data.
kscottz Oct 12, 2021
6290e66
Merge pull request #77 from osrf/humble-additions
kscottz Oct 12, 2021
44fc7f7
A few more minor edits. (#78)
clalancette Oct 13, 2021
301bc85
Final Data
kscottz Oct 13, 2021
7fdb873
Last plot tweaks.
kscottz Oct 13, 2021
2f4c9cf
Rough plots.
kscottz Oct 13, 2021
3ce0db9
Merge pull request #80 from osrf/humble-additions
kscottz Oct 13, 2021
81dcf96
fixed typos and minor omissions (#79)
joespeed Oct 13, 2021
b7cc5d8
Adding the text to go with plots and quotes.
kscottz Oct 13, 2021
5194a66
Merge pull request #81 from osrf/humble-additions
kscottz Oct 13, 2021
bb548d9
Formatting fix.
kscottz Oct 13, 2021
eb8bde2
Merge pull request #82 from osrf/humble-additions
kscottz Oct 13, 2021
94907d9
Formatting test.
kscottz Oct 13, 2021
adcea34
Merge pull request #83 from osrf/humble-additions
kscottz Oct 13, 2021
795ec30
Proof reading, formatting, consistency.
kscottz Oct 13, 2021
9ba7f44
Merge pull request #84 from osrf/humble-additions
kscottz Oct 13, 2021
aba75d2
Uhg, open quote fix.
kscottz Oct 13, 2021
5375d50
Merge pull request #85 from osrf/humble-additions
kscottz Oct 13, 2021
bbc6314
Adding more quotes.
kscottz Oct 13, 2021
1a5e777
Merge pull request #86 from osrf/humble-additions
kscottz Oct 13, 2021
ef6e9d9
Fill in executive summary, Fast DDS to Fast RTPS
kscottz Oct 13, 2021
b73088c
Merge branch 'main' into humble-additions
kscottz Oct 13, 2021
3ca2132
Merge pull request #87 from osrf/humble-additions
kscottz Oct 13, 2021
8cea2dc
"manual and nightly performance testing"
joespeed Oct 14, 2021
f3230bc
Update README.md
joespeed Oct 14, 2021
cad6299
Update README.md
joespeed Oct 14, 2021
97eeaaa
Update README.md
joespeed Oct 14, 2021
2800974
Update README.md
joespeed Oct 14, 2021
d8a9a54
Update README.md
joespeed Oct 14, 2021
d5dd864
OR build farm nightly performance testing
joespeed Oct 14, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
11 changes: 11 additions & 0 deletions humble/APPENDIX.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
# Appendices and Supporting Materials

## <a id="appendix_a"></a> Appendix A: Full Build Farm Plots

For completeness we have provided all data available on the build farm; this includes data from Cyclone DDS, Connext DDS, and four variants of FastRTPS available on the buildfarm. The four available variants of Cyclone DDS include both dynamic and static memory variants along with two asynchronous and synchronous variants. Not all tests included all variants but we have included what data was available. These plots compare the four variants of FastRTPS were used during testing, dynamic C++ asynchronous (abbreviated DCA), C++ static (abbreviated CS), dynamic C++ synchronous (abbreviated DCS), and asynchronous C++ (abbreviate CA). One variant of Cyclone RMW was tested, which is the C++ static version.

![Build Farm CPU Consumption](./notebooks/plots/BuildFarmRMWCPUConsumptionFULL.png )

![Build Farm Memory Consumption](./notebooks/plots/BuildFarmRMWMemoryConsumptionFULL.png)

![Build Farm performance by message type](./notebooks/plots/PerfTestVsMsgSizeFULL.png)
496 changes: 492 additions & 4 deletions humble/README.md

Large diffs are not rendered by default.

557 changes: 557 additions & 0 deletions humble/eProsima-response.md

Large diffs are not rendered by default.

463 changes: 463 additions & 0 deletions humble/eclipse-cyclonedds-report.md

Large diffs are not rendered by default.

43 changes: 43 additions & 0 deletions humble/eclipse-cyclonedds-report/configurations/conf-images.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
{
"multiprocess": {
"runtime": {
"max": 30,
"ignore": 5,
"cooldown": 5
},
"matrix": {
"topics": [
"PointCloud1m",
"PointCloud4m",
"PointCloud8m"
],
"rates": [
30
],
"subs": [
1,
3,
10
],
"reliability": [
"",
"--reliable"
],
"durability": [
""
],
"keep_last": [
"--keep-last --history-depth 100"
],
"rmw": [
"rmw_cyclonedds_cpp",
"rmw_fastrtps_cpp"
],
"extra_args": [
"",
"--zero-copy"
]
},
"exclude": []
}
}
244 changes: 244 additions & 0 deletions humble/eclipse-cyclonedds-report/configurations/conf-main.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,244 @@
{
"singleprocess": {
"runtime": {
"max": 30,
"ignore": 5,
"cooldown": 5
},
"matrix": {
"topics": [
"Array16k",
"Array2m",
"Struct32k",
"Struct16",
"PointCloud1m",
"PointCloud4m"
],
"rates": [
0,
20,
100,
500
],
"subs": [
1,
3,
10
],
"reliability": [
"",
"--reliable"
],
"durability": [
""
],
"keep_last": [
"--keep-last --history-depth 100"
],
"rmw": [
"rmw_cyclonedds_cpp",
"rmw_fastrtps_cpp"
]
},
"exclude": [
{
"topic": "Array2m",
"subs": 10
},
{
"topic": "PointCloud4m",
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"reliability": "--reliable",
"durability": "--transient",
"subs": 1
},
{
"topic": "PointCloud1m",
"rate": 500,
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"subs": 3
},
{
"topic": "Array2m",
"rate": "500",
"subs": "3",
"reliability": "--reliable"
},
{
"topic": "Struct32k",
"subs": 10,
"rate": 500
}
]
},
"multiprocess": {
"runtime": {
"max": 30,
"ignore": 5,
"cooldown": 5
},
"matrix": {
"topics": [
"Array16k",
"Array2m",
"Struct32k",
"Struct16",
"PointCloud1m",
"PointCloud4m"
],
"rates": [
0,
20,
100,
500
],
"subs": [
1,
3,
10
],
"reliability": [
"",
"--reliable"
],
"durability": [
""
],
"keep_last": [
"--keep-last --history-depth 100"
],
"rmw": [
"rmw_cyclonedds_cpp",
"rmw_fastrtps_cpp"
]
},
"exclude": [
{
"topic": "Array2m",
"subs": 10
},
{
"topic": "PointCloud4m",
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"reliability": "--reliable",
"durability": "--transient",
"subs": 1
},
{
"topic": "PointCloud1m",
"rate": 500,
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"subs": 3
},
{
"topic": "Array2m",
"rate": "500",
"subs": "3",
"reliability": "--reliable"
},
{
"topic": "Struct32k",
"subs": 10,
"rate": 500
}
]
},
"scaling": [
{
"prefix": "cyclone_nodes_",
"runtime": {
"max": 40,
"ignore": 5,
"cooldown": 15
},
"topic": "Struct16",
"type": "nodes",
"nodes": {
"min": 1,
"max": 61,
"step": 3
},
"rate": 500,
"reliability": "",
"durability": "",
"keep_last": "--keep-last --history-depth 100",
"rmw": "rmw_cyclonedds_cpp"
},
{
"prefix": "fast_nodes_",
"runtime": {
"max": 40,
"ignore": 5,
"cooldown": 15
},
"topic": "Struct16",
"type": "nodes",
"nodes": {
"min": 1,
"max": 61,
"step": 3
},
"rate": 500,
"reliability": "",
"durability": "",
"keep_last": "--keep-last --history-depth 100",
"rmw": "rmw_fastrtps_cpp"
},
{
"prefix": "cyclone_topics_",
"runtime": {
"max": 40,
"ignore": 5,
"cooldown": 15
},
"topic": "Struct16",
"type": "topics",
"nodes": {
"min": 1,
"max": 61,
"step": 3
},
"rate": 500,
"reliability": "",
"durability": "",
"keep_last": "--keep-last --history-depth 100",
"rmw": "rmw_cyclonedds_cpp"
},
{
"prefix": "fast_topics_",
"runtime": {
"max": 40,
"ignore": 5,
"cooldown": 15
},
"topic": "Struct16",
"type": "topics",
"nodes": {
"min": 1,
"max": 61,
"step": 3
},
"rate": 500,
"reliability": "",
"durability": "",
"keep_last": "--keep-last --history-depth 100",
"rmw": "rmw_fastrtps_cpp"
}
]
}
82 changes: 82 additions & 0 deletions humble/eclipse-cyclonedds-report/configurations/conf-zerocopy.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,82 @@
{
"multiprocess": {
"runtime": {
"max": 30,
"ignore": 5,
"cooldown": 5
},
"matrix": {
"topics": [
"Array16k",
"Array2m",
"Struct32k",
"Struct16",
"PointCloud1m",
"PointCloud4m"
],
"rates": [
20,
100,
500
],
"subs": [
1,
3,
10
],
"reliability": [
"--reliable"
],
"durability": [
""
],
"keep_last": [
"--keep-last --history-depth 16"
],
"rmw": [
"rmw_cyclonedds_cpp"
],
"extra_args": [
"--zero-copy"
]
},
"exclude": [
{
"topic": "Array2m",
"subs": 10
},
{
"topic": "PointCloud4m",
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"reliability": "--reliable",
"durability": "--transient",
"subs": 1
},
{
"topic": "PointCloud1m",
"rate": 500,
"subs": 10
},
{
"topic": "PointCloud4m",
"rate": 500,
"subs": 3
},
{
"topic": "Array2m",
"rate": "500",
"subs": "3",
"reliability": "--reliable"
},
{
"topic": "Struct32k",
"subs": 10,
"rate": 500
}
]
}
}
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
from .__main__ import main
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
from .main import main


if __name__ == "__main__":
main()
Loading