akhq 0.25.1 cannot read data from topic

[vasili439]

Hi! We faced with the issue when we try to browse topic data. For some kafka clusters I get 503/504 and for some time to getting data increased compare to 0.24.0. No errors in browser's console. No errors when I enable trace logs. Everything what helped us to resolve the issue is rollback to 0.25.0. Can we investigate the root cause?

[nirousseau]

I have also experienced the same issue, rolled back to 0.25.0 and it works like charm.
0.25.1 somehow introduced a regression.

[AlexisSouquiere]

@vasili439, @nirousseau is it possible for you to try again by changing this setting ? Try to put a low value like 5000

akhq:
  clients-defaults:
    consumer:
      properties:
        max.poll.records: 25000

For the higher response time I think it comes from this one:

akhq:
  topic-data:
    poll-timeout: 10000

Basically with the default configuration, AKHQ tries to fetch 25K records for each poll and if there are less than 25k, waits 10s until the timeout

[vasili439]

Just tried that with no result. Still can't fetch data from topic

[AlexisSouquiere]

If you getting an HTTP 504, it means that you are reaching a timeout. By checking the changes between 0.25.0 and 0.25.1, the issue probably comes from #1843.
Can you update again the config with the value from 0.25.0 ? max.poll.records to 50 and poll-timeout to 1000.

Also please check in the logs the duration of the query that retrieve data from the topic (with and without the config update). It will help to understand the issue. For instance:
[Duration: 1824 ms] [Url: GET /api/cluster/topic/your_topic/data] [Status: 200]

[vasili439]

it made the trick and finally I can get data from topic but I think in 3-4 times slower 0.25.1 vs 0.25.0