From b8aa4135fbdb257c278163809d3b5072b7fe46ca Mon Sep 17 00:00:00 2001 From: Dennis Zhuang Date: Mon, 5 Aug 2024 21:23:57 -0700 Subject: [PATCH 1/8] docs: add greptimedb_vs_influxdb_manual.md --- docs/greptimedb_vs_influxdb_manual.md | 241 ++++++++++++++++++++++++++ 1 file changed, 241 insertions(+) create mode 100644 docs/greptimedb_vs_influxdb_manual.md diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md new file mode 100644 index 000000000..82520abb0 --- /dev/null +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -0,0 +1,241 @@ +GreptimeDB vs. InfluxDB TSBS Testing Manual + +This manual helps developers reproduce the test results from the "GreptimeDB vs. InfluxDB Performance Test Report". For detailed results, please read the report. + +### Testing Tools + +GreptimeDB fork branch, which adds support for GreptimeDB and InfluxDB v2 compared to the official version: +[https://github.com/GreptimeTeam/tsbs](https://github.com/GreptimeTeam/tsbs) + +### Test Environment + +**Hardware Environment:** +- **Instance Type:** c5d.2xlarge +- **Processor Specifications:** 8 cores +- **Memory:** 16 GB +- **Disk:** 100GB (GP3) +- **Operating System:** Ubuntu Server 24.04 LTS + +**Software Version:** +- **Database:** + - **GreptimeDB:** v0.9.1 + - **InfluxDB:** v2.7.7 + +Except for GreptimeDB being set up with local caching for S3 testing, all other parameter configurations remain default without special adjustments. + +### Software Installation + +#### Installing Go + +Download link: +[https://go.dev/dl/go1.22.5.linux-amd64.tar.gz](https://go.dev/dl/go1.22.5.linux-amd64.tar.gz) + +Commands: +```sh +wget https://go.dev/dl/go1.22.5.linux-amd64.tar.gz +sudo tar -C /usr/local -xzf go1.22.5.linux-amd64.tar.gz +export PATH=$PATH:/usr/local/go/bin +go version +``` + +#### Installing InfluxDB + +Create influxdb2 directory: +```sh +mkdir influxdb2 +cd influxdb2 +``` + +Download InfluxDB: +```sh +wget https://dl.influxdata.com/influxdb/releases/influxdb2-2.7.7_linux_amd64.tar.gz +tar xvfz influxdb2-2.7.7_linux_amd64.tar.gz +``` + +Additionally, install CLI: +```sh +wget https://download.influxdata.com/influxdb/releases/influxdb2-client-2.7.5-linux-amd64.tar.gz +``` + +Start the server: +```sh +./influxdb2-2.7.7/usr/bin/influxd +``` + +Output: +```sh +2024-07-17T09:13:21.202512Z info Welcome to InfluxDB {"log_id": "0qR~KSCW000", "version": "v2.7.7", "commit": "e9e0f744fa", "build_date": "2024-07-11T18:45:02Z", "log_level": "info"} +...(trimmed for brevity)... +``` + +#### Installing GreptimeDB + +Refer to the official documentation for installing GreptimeDB: + +Create greptime directory in the home directory: +```sh +mkdir greptime +cd greptime +``` + +Download: +```sh +wget https://github.com/GreptimeTeam/greptimedb/releases/download/v0.9.1/greptime-linux-amd64-v0.9.1.tar.gz +tar xvfz greptime-linux-amd64-v0.9.1.tar.gz +``` + +Run GreptimeDB with the following command, specifying the data directory via command-line parameters: +```sh +./greptime-linux-amd64-v0.9.1/greptime standalone start --data-home /path/to/greptime/data +``` + +Alternatively, you can configure additional parameters via a configuration file. Assuming the configuration file is named `config.toml`, you can start it with: +```sh +./greptime-linux-amd64-v0.9.1/greptime standalone start --config-file /path/to/config.toml +``` + +### Test Execution + +#### InfluxDB + +Initialize: +After the first installation, InfluxDB needs to be initialized to obtain a token for requests. If you already have a token, you can skip this part. + +Initialize InfluxDB: +```sh +./influx setup \ + --username test \ + --password 12345678 \ + --token test-token \ + --org test-org \ + --bucket test-bucket \ + --force +``` + +Output: +``` +User Organization Bucket +test test-org test-bucket +``` + +Create token: +```sh +./influx auth create \ + --org test-org \ + --all-access +``` + +Output: +``` +ID Description Token User Name User ID Permissions +0d5c027a74259000 VTw2gBvdrgqQLpR2drSfiVgaVy-W4LLnJ1JiyLIAHgYhKYJdj9eW3Z26pnjelCiC7Q-dBGHvpZpGykjE_WqIgQ== test 0d5c0275c5e59000 ... +``` + +Export the token for subsequent requests: +```sh +export INFLUX2_TOKEN="VTw2gBvdrgqQLpR2drSfiVgaVy-W4LLnJ1JiyLIAHgYhKYJdj9eW3Z26pnjelCiC7Q-dBGHvpZpGykjE_WqIgQ==" +``` + +Data Import: +To import data in the `tsbs` directory, run the following command: +```sh +./bin/tsbs_load_influx2 \ + --urls=http://localhost:8086 \ + --file=./bench-data/influx-data.lp \ + --do-create-db=false \ + --org-id=test-org \ + --db-name=test-bucket \ + --batch-size=3000 \ + --workers=8 \ + --auth-token=$INFLUX2_TOKEN +``` + +Queries: +Run the queries in the `tsbs` directory: +```sh +./bin/tsbs_run_queries_influx --file=./bench-data/influx-queries-cpu-max-all-1.dat --db-name=test-bucket --is-v2=true --auth-token=$INFLUX2_TOKEN --urls="http://localhost:8086" +...(repeat for all queries)... +``` + +#### GreptimeDB + +GreptimeDB was tested with both local disk and S3-based object storage. Configurations for both are as follows: + +**Local Disk (EBS):** +Configuration file used for testing: +```toml +[http] +addr = "0.0.0.0:4000" + +[logging] +dir = "/home/ubuntu/greptime/logs" + +[storage] +data_home = "/home/ubuntu/greptime/data-local" +``` + +Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v0.9.1/greptime` and the config file path is `/home/ubuntu/greptime/config-local.toml`: +```sh +./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-local.toml +``` + +**S3 Object Storage:** +When using S3, additional S3 configurations are required. Example configuration during testing with local disk cache enabled: +```toml +[http] +addr = "0.0.0.0:4000" + +[logging] +dir = "/home/ubuntu/greptime/logs" + +[storage] +data_home = "/home/ubuntu/greptime/data-s3" +type = "S3" +bucket = "test-bucket" +root = "tsbs-data-write" +access_key_id = "****" +secret_access_key = "****" +endpoint = "https://s3-endpoint/" +region = "ap-southeast-1" +cache_path = "/home/ubuntu/greptime/s3cache" +cache_capacity = "20G" + +[[region_engine]] +[region_engine.mito] +enable_experimental_write_cache = true +experimental_write_cache_size = "20G" +``` + +Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v0.9.1/greptime` and the config file path is `/home/ubuntu/greptime/config-s3.toml`: +```sh +./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-s3.toml +``` + +Data Import: +To import data in the `tsbs` directory, run the following command: +```sh +./bin/tsbs_load_greptime \ + --urls=http://localhost:4000 \ + --file=./bench-data/influx-data.lp \ + --batch-size=3000 \ + --gzip=false \ + --workers=6 +``` + +Queries: +Run the queries in the `tsbs` directory: +```sh +./bin/tsbs_run_queries_influx --file=./bench-data/greptime-queries-cpu-max-all-1.dat --db-name=benchmark --urls="http://localhost:4000" +...(repeat for all queries)... +``` + +### References + +- [InfluxData Downloads](https://www.influxdata.com/downloads/) +- [InfluxDB Installation](https://docs.influxdata.com/influxdb/v2/install/#start-influxdb) +- [InfluxDB CLI Tools](https://docs.influxdata.com/influxdb/v2/tools/influx-cli/?t=Linux) +- [InfluxDB Setup](https://docs.influxdata.com/influxdb/v2/get-started/setup/?t=Set+up+with+the+CLI) +- [Greptime Team TSBS](https://github.com/GreptimeTeam/tsbs) +- TSBS v0.9 vs InfluxDB + +--- From f788b7da0bde7f7405fdf1f568d14f264d8366e5 Mon Sep 17 00:00:00 2001 From: Dennis Zhuang Date: Mon, 5 Aug 2024 21:29:26 -0700 Subject: [PATCH 2/8] chore: style --- docs/greptimedb_vs_influxdb_manual.md | 36 +++++++++++++-------------- 1 file changed, 18 insertions(+), 18 deletions(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index 82520abb0..b319b723e 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -1,13 +1,13 @@ -GreptimeDB vs. InfluxDB TSBS Testing Manual +# GreptimeDB vs. InfluxDB TSBS Testing Manual This manual helps developers reproduce the test results from the "GreptimeDB vs. InfluxDB Performance Test Report". For detailed results, please read the report. -### Testing Tools +## Testing Tools GreptimeDB fork branch, which adds support for GreptimeDB and InfluxDB v2 compared to the official version: [https://github.com/GreptimeTeam/tsbs](https://github.com/GreptimeTeam/tsbs) -### Test Environment +## Test Environment **Hardware Environment:** - **Instance Type:** c5d.2xlarge @@ -23,9 +23,9 @@ GreptimeDB fork branch, which adds support for GreptimeDB and InfluxDB v2 compar Except for GreptimeDB being set up with local caching for S3 testing, all other parameter configurations remain default without special adjustments. -### Software Installation +## Software Installation -#### Installing Go +### Installing Go Download link: [https://go.dev/dl/go1.22.5.linux-amd64.tar.gz](https://go.dev/dl/go1.22.5.linux-amd64.tar.gz) @@ -38,7 +38,7 @@ export PATH=$PATH:/usr/local/go/bin go version ``` -#### Installing InfluxDB +### Installing InfluxDB Create influxdb2 directory: ```sh @@ -68,7 +68,7 @@ Output: ...(trimmed for brevity)... ``` -#### Installing GreptimeDB +### Installing GreptimeDB Refer to the official documentation for installing GreptimeDB: @@ -94,11 +94,11 @@ Alternatively, you can configure additional parameters via a configuration file. ./greptime-linux-amd64-v0.9.1/greptime standalone start --config-file /path/to/config.toml ``` -### Test Execution +## Test Execution -#### InfluxDB +### InfluxDB -Initialize: +#### Initialize After the first installation, InfluxDB needs to be initialized to obtain a token for requests. If you already have a token, you can skip this part. Initialize InfluxDB: @@ -136,7 +136,7 @@ Export the token for subsequent requests: export INFLUX2_TOKEN="VTw2gBvdrgqQLpR2drSfiVgaVy-W4LLnJ1JiyLIAHgYhKYJdj9eW3Z26pnjelCiC7Q-dBGHvpZpGykjE_WqIgQ==" ``` -Data Import: +### Data Import To import data in the `tsbs` directory, run the following command: ```sh ./bin/tsbs_load_influx2 \ @@ -150,18 +150,18 @@ To import data in the `tsbs` directory, run the following command: --auth-token=$INFLUX2_TOKEN ``` -Queries: +#### Queries Run the queries in the `tsbs` directory: ```sh ./bin/tsbs_run_queries_influx --file=./bench-data/influx-queries-cpu-max-all-1.dat --db-name=test-bucket --is-v2=true --auth-token=$INFLUX2_TOKEN --urls="http://localhost:8086" ...(repeat for all queries)... ``` -#### GreptimeDB +### GreptimeDB GreptimeDB was tested with both local disk and S3-based object storage. Configurations for both are as follows: -**Local Disk (EBS):** +#### Local Disk (EBS) Configuration file used for testing: ```toml [http] @@ -179,7 +179,7 @@ Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v ./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-local.toml ``` -**S3 Object Storage:** +#### S3 Object Storage When using S3, additional S3 configurations are required. Example configuration during testing with local disk cache enabled: ```toml [http] @@ -211,7 +211,7 @@ Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v ./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-s3.toml ``` -Data Import: +#### Data Import To import data in the `tsbs` directory, run the following command: ```sh ./bin/tsbs_load_greptime \ @@ -222,14 +222,14 @@ To import data in the `tsbs` directory, run the following command: --workers=6 ``` -Queries: +#### Queries Run the queries in the `tsbs` directory: ```sh ./bin/tsbs_run_queries_influx --file=./bench-data/greptime-queries-cpu-max-all-1.dat --db-name=benchmark --urls="http://localhost:4000" ...(repeat for all queries)... ``` -### References +## References - [InfluxData Downloads](https://www.influxdata.com/downloads/) - [InfluxDB Installation](https://docs.influxdata.com/influxdb/v2/install/#start-influxdb) From 89c0e489dc95d4a9734f065bcc80d82f3a32d119 Mon Sep 17 00:00:00 2001 From: Dennis Zhuang Date: Mon, 5 Aug 2024 21:31:13 -0700 Subject: [PATCH 3/8] chore: style --- docs/greptimedb_vs_influxdb_manual.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index b319b723e..a103f6df0 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -136,7 +136,7 @@ Export the token for subsequent requests: export INFLUX2_TOKEN="VTw2gBvdrgqQLpR2drSfiVgaVy-W4LLnJ1JiyLIAHgYhKYJdj9eW3Z26pnjelCiC7Q-dBGHvpZpGykjE_WqIgQ==" ``` -### Data Import +#### Data Import To import data in the `tsbs` directory, run the following command: ```sh ./bin/tsbs_load_influx2 \ From 873f0f9d2b8324c4e6011aeb27d2477ec751928e Mon Sep 17 00:00:00 2001 From: Dennis Zhuang Date: Mon, 5 Aug 2024 21:41:56 -0700 Subject: [PATCH 4/8] chore: style --- docs/greptimedb_vs_influxdb_manual.md | 1 - 1 file changed, 1 deletion(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index a103f6df0..fba414771 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -238,4 +238,3 @@ Run the queries in the `tsbs` directory: - [Greptime Team TSBS](https://github.com/GreptimeTeam/tsbs) - TSBS v0.9 vs InfluxDB ---- From d6574d783ee24713a58854f14fcec46574a42d9e Mon Sep 17 00:00:00 2001 From: Dennis Zhuang Date: Mon, 5 Aug 2024 21:55:01 -0700 Subject: [PATCH 5/8] feat: adds data generation --- docs/greptimedb_vs_influxdb_manual.md | 83 +++++++++++++++++++++++++++ 1 file changed, 83 insertions(+) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index fba414771..c64a0e424 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -96,6 +96,89 @@ Alternatively, you can configure additional parameters via a configuration file. ## Test Execution +### Test Data Generation + +**TSBS** [Time Series Benchmark Suite] does not provide precompiled binaries, so it needs to be compiled manually. Compiling **TSBS** requires **Go** to be installed beforehand. You can refer to https://go.dev/doc/install for specific details. The version used this time is **1.22.5**. + +After installing **Go**, you can clone TSBS to the current directory: +```bash +git clone https://github.com/GreptimeTeam/tsbs.git +``` + +If **make** is not available, you need to install **make** first: +```bash +sudo apt install make +``` + +Navigate to the **tsbs** directory and run **make** to compile TSBS. The first time you compile, it might take a while as some dependencies are downloaded: +```bash +cd tsbs +make +``` + +Once the compilation is successful, you should see many binaries generated under the **bin** directory, although we will only use a part of them: +```bash +$ ls ./bin/ +tsbs_generate_data tsbs_load_influx2 tsbs_run_queries_clickhouse +tsbs_generate_queries tsbs_load_mongo tsbs_run_queries_cratedb +tsbs_load tsbs_load_prometheus tsbs_run_queries_influx +tsbs_load_akumuli tsbs_load_questdb tsbs_run_queries_mongo +tsbs_load_cassandra tsbs_load_siridb tsbs_run_queries_questdb +tsbs_load_clickhouse tsbs_load_timescaledb tsbs_run_queries_siridb +tsbs_load_cratedb tsbs_load_victoriametrics tsbs_run_queries_timescaledb +tsbs_load_greptime tsbs_run_queries_akumuli tsbs_run_queries_timestream +tsbs_load_influx tsbs_run_queries_cassandra tsbs_run_queries_victoriametrics +``` + +To generate a directory to store the generated data, you can create a new directory within the **tsbs** directory: +```bash +mkdir bench-data +``` + +Run the data generation command, where `influx-data.lp` is the generated test data file, which will be used for single-machine testing: +```bash +./bin/tsbs_generate_data --use-case="cpu-only" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:00Z" --log-interval="10s" --format="influx" > ./bench-data/influx-data.lp +``` + +Execute the following commands to generate queries for **InfluxDB**: +```bash +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type cpu-max-all-1 --format="influx" > ./bench-data/influx-queries-cpu-max-all-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type cpu-max-all-8 --format="influx" > ./bench-data/influx-queries-cpu-max-all-8.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-1 --format="influx" > ./bench-data/influx-queries-double-groupby-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-5 --format="influx" > ./bench-data/influx-queries-double-groupby-5.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-all --format="influx" > ./bench-data/influx-queries-double-groupby-all.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type groupby-orderby-limit --format="influx" > ./bench-data/influx-queries-groupby-orderby-limit.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type high-cpu-1 --format="influx" > ./bench-data/influx-queries-high-cpu-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type high-cpu-all --format="influx" > ./bench-data/influx-queries-high-cpu-all.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=10 --query-type lastpoint --format="influx" > ./bench-data/influx-queries-lastpoint.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-1-1 --format="influx" > ./bench-data/influx-queries-single-groupby-1-1-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-1-12 --format="influx" > ./bench-data/influx-queries-single-groupby-1-1-12.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-8-1 --format="influx" > ./bench-data/influx-queries-single-groupby-1-8-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-1-1 --format="influx" > ./bench-data/influx-queries-single-groupby-5-1-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-1-12 --format="influx" > ./bench-data/influx-queries-single-groupby-5-1-12.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-8-1 --format="influx" > ./bench-data/influx-queries-single-groupby-5-8-1.dat +``` + +Execute the following commands to generate queries for **GreptimeDB**: +```bash +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type cpu-max-all-1 --format="greptime" > ./bench-data/greptime-queries-cpu-max-all-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type cpu-max-all-8 --format="greptime" > ./bench-data/greptime-queries-cpu-max-all-8.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-1 --format="greptime" > ./bench-data/greptime-queries-double-groupby-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-5 --format="greptime" > ./bench-data/greptime-queries-double-groupby-5.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type double-groupby-all --format="greptime" > ./bench-data/greptime-queries-double-groupby-all.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type groupby-orderby-limit --format="greptime" > ./bench-data/greptime-queries-groupby-orderby-limit.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type high-cpu-1 --format="greptime" > ./bench-data/greptime-queries-high-cpu-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=50 --query-type high-cpu-all --format="greptime" > ./bench-data/greptime-queries-high-cpu-all.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=10 --query-type lastpoint --format="greptime" > ./bench-data/greptime-queries-lastpoint.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-1-1 --format="greptime" > ./bench-data/greptime-queries-single-groupby-1-1-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-1-12 --format="greptime" > ./bench-data/greptime-queries-single-groupby-1-1-12.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-1-8-1 --format="greptime" > ./bench-data/greptime-queries-single-groupby-1-8-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-1-1 --format="greptime" > ./bench-data/greptime-queries-single-groupby-5-1-1.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-1-12 --format="greptime" > ./bench-data/greptime-queries-single-groupby-5-1-12.dat +./bin/tsbs_generate_queries --use-case="devops" --seed=123 --scale=4000 --timestamp-start="2023-06-11T00:00:00Z" --timestamp-end="2023-06-14T00:00:01Z" --queries=100 --query-type single-groupby-5-8-1 --format="greptime" > ./bench-data/greptime-queries-single-groupby-5-8-1.dat +``` + + ### InfluxDB #### Initialize From f88b6dd597d45b1d4b844faa31f14f8aaec21d48 Mon Sep 17 00:00:00 2001 From: dennis zhuang Date: Tue, 6 Aug 2024 00:07:29 -0700 Subject: [PATCH 6/8] chore: update s3 config Co-authored-by: Yingwen Signed-off-by: dennis zhuang --- docs/greptimedb_vs_influxdb_manual.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index c64a0e424..0e6fcf1d7 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -274,12 +274,12 @@ dir = "/home/ubuntu/greptime/logs" [storage] data_home = "/home/ubuntu/greptime/data-s3" type = "S3" -bucket = "test-bucket" -root = "tsbs-data-write" +bucket = "your-bucket" +root = "tsbs-data-s3" access_key_id = "****" secret_access_key = "****" endpoint = "https://s3-endpoint/" -region = "ap-southeast-1" +region = "your-region" cache_path = "/home/ubuntu/greptime/s3cache" cache_capacity = "20G" From 6d893df7a1d364250d2aaf093a0729e3749481d4 Mon Sep 17 00:00:00 2001 From: dennis zhuang Date: Tue, 6 Aug 2024 00:07:54 -0700 Subject: [PATCH 7/8] chore: remove version Co-authored-by: Yingwen Signed-off-by: dennis zhuang --- docs/greptimedb_vs_influxdb_manual.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index 0e6fcf1d7..3eb9dc869 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -257,9 +257,9 @@ dir = "/home/ubuntu/greptime/logs" data_home = "/home/ubuntu/greptime/data-local" ``` -Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v0.9.1/greptime` and the config file path is `/home/ubuntu/greptime/config-local.toml`: +Startup command assuming the GreptimeDB binary path is `./greptime` and the config file path is `/home/ubuntu/greptime/config-local.toml`: ```sh -./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-local.toml +./greptime standalone start --config /home/ubuntu/greptime/config-local.toml ``` #### S3 Object Storage From c07c782ec6bf603b26ee32a3f8f98821c68fed86 Mon Sep 17 00:00:00 2001 From: dennis zhuang Date: Tue, 6 Aug 2024 00:08:00 -0700 Subject: [PATCH 8/8] chore: remove version Co-authored-by: Yingwen Signed-off-by: dennis zhuang --- docs/greptimedb_vs_influxdb_manual.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/greptimedb_vs_influxdb_manual.md b/docs/greptimedb_vs_influxdb_manual.md index 3eb9dc869..9577ee7d1 100644 --- a/docs/greptimedb_vs_influxdb_manual.md +++ b/docs/greptimedb_vs_influxdb_manual.md @@ -289,9 +289,9 @@ enable_experimental_write_cache = true experimental_write_cache_size = "20G" ``` -Startup command assuming the GreptimeDB binary path is `./greptime-linux-amd64-v0.9.1/greptime` and the config file path is `/home/ubuntu/greptime/config-s3.toml`: +Startup command assuming the GreptimeDB binary path is `./greptime` and the config file path is `/home/ubuntu/greptime/config-s3.toml`: ```sh -./greptime-linux-amd64-v0.9.1/greptime standalone start --config /home/ubuntu/greptime/config-s3.toml +./greptime standalone start --config /home/ubuntu/greptime/config-s3.toml ``` #### Data Import