Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[loki-distributed] Update Loki to 3.0.0 #3130

Closed
wants to merge 1 commit into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions charts/loki-distributed/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@ apiVersion: v2
name: loki-distributed
description: Helm chart for Grafana Loki in microservices mode
type: application
appVersion: 2.9.6
version: 0.79.0
appVersion: 3.0.0
version: 0.80.0
home: https://grafana.github.io/helm-charts
sources:
- https://github.com/grafana/loki
Expand Down
27 changes: 22 additions & 5 deletions charts/loki-distributed/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# loki-distributed

![Version: 0.79.0](https://img.shields.io/badge/Version-0.79.0-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) ![AppVersion: 2.9.6](https://img.shields.io/badge/AppVersion-2.9.6-informational?style=flat-square)
![Version: 0.80.0](https://img.shields.io/badge/Version-0.80.0-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) ![AppVersion: 3.0.0](https://img.shields.io/badge/AppVersion-3.0.0-informational?style=flat-square)

Helm chart for Grafana Loki in microservices mode

Expand All @@ -24,6 +24,26 @@ helm repo add grafana https://grafana.github.io/helm-charts

Major version upgrades listed here indicate that there is an incompatible breaking change needing manual actions.

### Frome 0.79.x to 0.80.0
This version allows setting a constant prefix for all created keys in Chunk storage(S3)
```yaml
loki:
storage_config:
object_prefix: loki-logs
```

Removed `store.max-look-back-period` flag. Use. Use `querier.max-query-lookback` config instead.

Removed `ingester.max-transfer-retries` configuration option. The Write Ahead Log (WAL) supersedes the chunk transfer feature.

Removed `shared_store` and `shared_store_key_prefix` from index shipper and compactor configs and their corresponding CLI flags. `object_store` setting in the `period_config` (which already configured the store for chunks) will be used to configure store for the index.

And the newly added path_prefix option under the index key in period_config will configure the path under which index tables are stored.

Deprecated `write_dedupe_cache_config` config section along with legacy index types (aws, aws-dynamo, bigtable, bigtable-hashed, cassandra, gcp, gcp-columnkey, grpc-store). Consider using TSDB index which does not require a write dedupe cache.

Refactored `default` block for `runtime_config`. The `default` block was removed and instead a top level config now exists in the standard Loki config called `operational_config`, you can set default values here for runtime configs.

### From 0.78.x to 0.79.0
Removed the hardcoded, deprecated `boltdb.shipper.compactor.working-directory` flag in the Compactor Deployment template, so that it can be set with `.Values.compactor.extraArgs` and the `compactor.working-directory` flag if necessary.

Expand Down Expand Up @@ -358,7 +378,7 @@ kubectl delete statefulset RELEASE_NAME-loki-distributed-querier -n LOKI_NAMESPA
| loki.schemaConfig | object | `{"configs":[{"from":"2020-09-07","index":{"period":"24h","prefix":"loki_index_"},"object_store":"filesystem","schema":"v11","store":"boltdb-shipper"}]}` | Check https://grafana.com/docs/loki/latest/configuration/#schema_config for more info on how to configure schemas |
| loki.server.http_listen_port | int | `3100` | HTTP server listen port |
| loki.serviceAnnotations | object | `{}` | Common annotations for all loki services |
| loki.storageConfig | object | `{"boltdb_shipper":{"active_index_directory":"/var/loki/index","cache_location":"/var/loki/cache","cache_ttl":"168h","shared_store":"filesystem"},"filesystem":{"directory":"/var/loki/chunks"}}` | Check https://grafana.com/docs/loki/latest/configuration/#storage_config for more info on how to configure storages |
| loki.storageConfig | object | `{"boltdb_shipper":{"active_index_directory":"/var/loki/index","cache_location":"/var/loki/cache","cache_ttl":"168h"},"filesystem":{"directory":"/var/loki/chunks"}}` | Check https://grafana.com/docs/loki/latest/configuration/#storage_config for more info on how to configure storages |
| loki.structuredConfig | object | `{}` | Structured loki configuration, takes precedence over `loki.config`, `loki.schemaConfig`, `loki.storageConfig` |
| memcached.appProtocol | string | `""` | Adds the appProtocol field to the memcached services. This allows memcached to work with istio protocol selection. Ex: "http" or "tcp" |
| memcached.containerSecurityContext | object | `{"allowPrivilegeEscalation":false,"capabilities":{"drop":["ALL"]},"readOnlyRootFilesystem":true}` | The SecurityContext for memcached containers |
Expand Down Expand Up @@ -717,16 +737,13 @@ loki:
ingester:
# Disable chunk transfer which is not possible with statefulsets
# and unnecessary for boltdb-shipper
max_transfer_retries: 0
chunk_idle_period: 1h
chunk_target_size: 1536000
max_chunk_age: 1h
storage_config:
aws:
s3: s3://eu-central-1
bucketnames: my-loki-s3-bucket
boltdb_shipper:
shared_store: s3
schema_config:
configs:
- from: 2020-09-07
Expand Down
3 changes: 0 additions & 3 deletions charts/loki-distributed/README.md.gotmpl
Original file line number Diff line number Diff line change
Expand Up @@ -147,16 +147,13 @@ loki:
ingester:
# Disable chunk transfer which is not possible with statefulsets
# and unnecessary for boltdb-shipper
max_transfer_retries: 0
chunk_idle_period: 1h
chunk_target_size: 1536000
max_chunk_age: 1h
storage_config:
aws:
s3: s3://eu-central-1
bucketnames: my-loki-s3-bucket
boltdb_shipper:
shared_store: s3
schema_config:
configs:
- from: 2020-09-07
Expand Down
2 changes: 0 additions & 2 deletions charts/loki-distributed/ci/cache-values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,6 @@ loki:
chunk_idle_period: 30m
chunk_block_size: 262144
chunk_retain_period: 1m
max_transfer_retries: 0
wal:
dir: /var/loki/wal

Expand All @@ -50,7 +49,6 @@ loki:

storage_config:
boltdb_shipper:
shared_store: filesystem
active_index_directory: /var/loki/index
cache_location: /var/loki/cache
cache_ttl: 168h
Expand Down
8 changes: 6 additions & 2 deletions charts/loki-distributed/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,6 @@ loki:
chunk_block_size: 262144
chunk_encoding: snappy
chunk_retain_period: 1m
max_transfer_retries: 0
wal:
dir: /var/loki/wal

Expand Down Expand Up @@ -157,6 +156,12 @@ loki:

runtime_config:
file: /var/{{ include "loki.name" . }}-runtime/runtime.yaml

operational_config:
log_stream_creation: false
log_push_request: false
log_push_request_streams: false:
limited_log_push_errors: true

chunk_store_config:
max_look_back_period: 0s
Expand Down Expand Up @@ -240,7 +245,6 @@ loki:
# -- Check https://grafana.com/docs/loki/latest/configuration/#storage_config for more info on how to configure storages
storageConfig:
boltdb_shipper:
shared_store: filesystem
active_index_directory: /var/loki/index
cache_location: /var/loki/cache
cache_ttl: 168h
Expand Down