From 272b1cd37de0aa435e8463b42075af20b20349f0 Mon Sep 17 00:00:00 2001 From: Johannes Deml Date: Fri, 30 Oct 2020 19:36:27 +0100 Subject: [PATCH] =?UTF-8?q?Update=20to=200.3.1=20=F0=9F=94=AC?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- Benchmarks/ubuntu-0.3.1.md | 21 +++++++++++++++++++ ...kBenchmark.PredefinedBenchmark-barplot.png | 3 +++ Docs/benchmark.png | 3 --- .../NetCoreNetworkBenchmark.csproj | 4 ++-- README.md | 18 ++++++++-------- 5 files changed, 35 insertions(+), 14 deletions(-) create mode 100644 Benchmarks/ubuntu-0.3.1.md create mode 100644 Docs/NetCoreNetworkBenchmark.PredefinedBenchmark-barplot.png delete mode 100644 Docs/benchmark.png diff --git a/Benchmarks/ubuntu-0.3.1.md b/Benchmarks/ubuntu-0.3.1.md new file mode 100644 index 0000000..9eef607 --- /dev/null +++ b/Benchmarks/ubuntu-0.3.1.md @@ -0,0 +1,21 @@ +``` ini + +BenchmarkDotNet=v0.12.1, OS=ubuntu 20.04 +Intel Core i5-3570K CPU 3.40GHz (Ivy Bridge), 1 CPU, 4 logical and 4 physical cores +.NET Core SDK=3.1.403 + [Host] : .NET Core 3.1.9 (CoreCLR 4.700.20.47201, CoreFX 4.700.20.47203), X64 RyuJIT + Job-WOXISK : .NET Core 3.1.9 (CoreCLR 4.700.20.47201, CoreFX 4.700.20.47203), X64 RyuJIT + +Concurrent=False Server=True InvocationCount=1 +IterationCount=10 LaunchCount=1 UnrollFactor=1 +WarmupCount=1 + +``` +| Method | Library | Mean | Error | StdDev | +|----------- |-------------- |------------:|----------:|----------:| +| **Benchmark1** | **ENet** | **5,270.0 ms** | **171.39 ms** | **101.99 ms** | +| Benchmark2 | ENet | 908.3 ms | 84.13 ms | 55.64 ms | +| **Benchmark1** | **NetCoreServer** | **8,826.7 ms** | **272.59 ms** | **180.30 ms** | +| Benchmark2 | NetCoreServer | 9,389.2 ms | 236.10 ms | 140.50 ms | +| **Benchmark1** | **LiteNetLib** | **13,276.9 ms** | **290.76 ms** | **192.32 ms** | +| Benchmark2 | LiteNetLib | 2,985.0 ms | 33.39 ms | 22.09 ms | diff --git a/Docs/NetCoreNetworkBenchmark.PredefinedBenchmark-barplot.png b/Docs/NetCoreNetworkBenchmark.PredefinedBenchmark-barplot.png new file mode 100644 index 0000000..41e96c6 --- /dev/null +++ b/Docs/NetCoreNetworkBenchmark.PredefinedBenchmark-barplot.png @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4927974f5b627bc142f139bec7dd1b069fd3f78e9c2829f1f713d04d4571bca6 +size 88109 diff --git a/Docs/benchmark.png b/Docs/benchmark.png deleted file mode 100644 index 28b6fb4..0000000 --- a/Docs/benchmark.png +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:497b91fcd86ca4e20574117593723f3aef2eb71da0c340b48c1397ef84896a54 -size 85017 diff --git a/NetCoreNetworkBenchmark/NetCoreNetworkBenchmark.csproj b/NetCoreNetworkBenchmark/NetCoreNetworkBenchmark.csproj index d1ffe60..3f38d6d 100644 --- a/NetCoreNetworkBenchmark/NetCoreNetworkBenchmark.csproj +++ b/NetCoreNetworkBenchmark/NetCoreNetworkBenchmark.csproj @@ -7,8 +7,8 @@ Johannes Deml Johannes Deml DotNetCoreNetworkingBenchmark - 0.3.0 - 0.3.0 + 0.3.1 + 0.3.1 en-US Debug;Release AnyCPU;x64 diff --git a/README.md b/README.md index 710873a..52392a2 100644 --- a/README.md +++ b/README.md @@ -39,7 +39,7 @@ BenchmarkDotNet=v0.12.1, OS=ubuntu 20.04 Intel Core i5-3570K CPU 3.40GHz (Ivy Bridge), 1 CPU, 4 logical and 4 physical cores .NET Core SDK=3.1.403 [Host] : .NET Core 3.1.9 (CoreCLR 4.700.20.47201, CoreFX 4.700.20.47203), X64 RyuJIT - Job-MXHSPZ : .NET Core 3.1.9 (CoreCLR 4.700.20.47201, CoreFX 4.700.20.47203), X64 RyuJIT + Job-WOXISK : .NET Core 3.1.9 (CoreCLR 4.700.20.47201, CoreFX 4.700.20.47203), X64 RyuJIT Concurrent=False Server=True InvocationCount=1 IterationCount=10 LaunchCount=1 UnrollFactor=1 @@ -48,14 +48,14 @@ WarmupCount=1 ``` | Method | Library | Mean | Error | StdDev | |----------- |-------------- |------------:|----------:|----------:| -| **Benchmark1** | **ENet** | **5,304.1 ms** | **120.23 ms** | **71.55 ms** | -| Benchmark2 | ENet | 898.7 ms | 77.05 ms | 50.97 ms | -| **Benchmark1** | **NetCoreServer** | **8,490.2 ms** | **46.09 ms** | **30.49 ms** | -| Benchmark2 | NetCoreServer | 8,683.1 ms | 37.25 ms | 24.64 ms | -| **Benchmark1** | **LiteNetLib** | **13,248.2 ms** | **240.54 ms** | **143.14 ms** | -| Benchmark2 | LiteNetLib | 2,961.5 ms | 49.71 ms | 32.88 ms | - -![Benchmark Results](./Docs/benchmark.png) +| **Benchmark1** | **ENet** | **5,270.0 ms** | **171.39 ms** | **101.99 ms** | +| Benchmark2 | ENet | 908.3 ms | 84.13 ms | 55.64 ms | +| **Benchmark1** | **NetCoreServer** | **8,826.7 ms** | **272.59 ms** | **180.30 ms** | +| Benchmark2 | NetCoreServer | 9,389.2 ms | 236.10 ms | 140.50 ms | +| **Benchmark1** | **LiteNetLib** | **13,276.9 ms** | **290.76 ms** | **192.32 ms** | +| Benchmark2 | LiteNetLib | 2,985.0 ms | 33.39 ms | 22.09 ms | + +![Benchmark Results](./Docs/NetCoreNetworkBenchmark.PredefinedBenchmark-barplot.png) ### Benchmark 1 Runs the PingPong Test with t with **1,000** clients, which pingpong **1 message** each with the server. The benchmark runs until a total of **1 million** messages are sent to the server and back to the clients. Message size is **32 bytes**.