Multiple sidecar have set "prefix", how set store to read all of them?

[X-Mars]

sidecar 1

type: ALIYUNOSS
    config:
      endpoint: "oss-cn-hangzhou-internal.aliyuncs.com"
      bucket: "thanos-dev"
      access_key_id: "2222"
      access_key_secret: "2222"
    prefix: "sidecar1"

sidecar 2

type: ALIYUNOSS
    config:
      endpoint: "oss-cn-hangzhou-internal.aliyuncs.com"
      bucket: "thanos-dev"
      access_key_id: "2222"
      access_key_secret: "2222"
    prefix: "sidecar2"

store

type: ALIYUNOSS
config:
  endpoint: "oss-cn-hangzhou-internal.aliyuncs.com"
  bucket: "thanos-dev"
  access_key_id: "2222"
  access_key_secret: "2222"
prefix: ""

Thank you !

[rozek1997]

@X-Mars did you found a solution to this?

[X-Mars]

I didn't find a good solution。。。

[yeya24]

Do you plan to use one store to read from multiple prefixes?
As far as I know, store can only configure one bucket prefix so you need multiple stores per prefix

[rozek1997]

So if I don't specify the prefix it didn't mean that the Store Gataway will scan all folders recursively from bucket root, right?

[yeya24]

You mean not specify prefix at Store Gateway? That's an interesting idea. I never tried that but I guess in theory it could work. Idk what will happen if there are blocks with the same ID under two prefixes.

[rozek1997]

Yes excatly, not specify prefix at Store Gateway, only point out bucket name. In that case the Store Gateway should read from all folders/prefixes in bucket.

[k24dizzle]

+1, I think this would be useful
So only one thanos store would have to exist to process a bucket and all its prefixes (instead of one store per prefix)

[Khagesh16]

yes this would be helpful. Setting pointing to s3 root for in thanos store does not work we just tried that.