How to set state.backend.rocksdb.latency-track-enabled

[Chen-Che Huang]

Hi,

The 1.13 release note (https://flink.apache.org/news/2021/05/03/release-1.13.0.html) mentions that we can set state.backend.rocksdb.latency-track-enabled to obtain some rockdb metrics with a marginal impact. However, I couldn't see state.backend.rocksdb.latency-track-enabled in https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/. Based on this PR (https://github.com/apache/flink/pull/15091), it seems that state.backend.rocksdb.latency-track-enabled is related to state.backend.latency-track.keyed-state-enable? Or which option I should set for metrics with a marginal impact. However, I couldn't see. Thanks.

Best wishes,
Chen-Che Huang

[Yangze Guo]

Hi, Chen-Che,

IIUC, the "state.backend.rocksdb.latency-track-enabled" is just a
reject alternative and has been incorrectly written to the release
note. You can refer to the [1] instead.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/#state-backends-latency-tracking-options

Best,
Yangze Guo

On Fri, Jun 18, 2021 at 3:39 PM Chen-Che Huang <[hidden email]> wrote:
>
> Hi,
>
> The 1.13 release note (https://flink.apache.org/news/2021/05/03/release-1.13.0.html) mentions that we can set state.backend.rocksdb.latency-track-enabled to obtain some rockdb metrics with a marginal impact. However, I couldn't see state.backend.rocksdb.latency-track-enabled in https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/. Based on this PR (https://github.com/apache/flink/pull/15091), it seems that state.backend.rocksdb.latency-track-enabled is related to state.backend.latency-track.keyed-state-enable? Or which option I should set for metrics with a marginal impact. However, I couldn't see. Thanks.
>
> Best wishes,
> Chen-Che Huang

[Chen-Che Huang]

Hi Yangze,

Got it. I'll evaluate to enable this feature and see whether I can gain some insights. Many thanks for your reply.

On 2021/06/18 07:52:53, Yangze Guo <[hidden email]> wrote:

> Hi, Chen-Che,
>
> IIUC, the "state.backend.rocksdb.latency-track-enabled" is just a
> reject alternative and has been incorrectly written to the release
> note. You can refer to the [1] instead.
>
> [1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/#state-backends-latency-tracking-options
>
> Best,
> Yangze Guo
>
> On Fri, Jun 18, 2021 at 3:39 PM Chen-Che Huang <[hidden email]> wrote:
> >
> > Hi,
> >
> > The 1.13 release note (https://flink.apache.org/news/2021/05/03/release-1.13.0.html) mentions that we can set state.backend.rocksdb.latency-track-enabled to obtain some rockdb metrics with a marginal impact. However, I couldn't see state.backend.rocksdb.latency-track-enabled in https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/. Based on this PR (https://github.com/apache/flink/pull/15091), it seems that state.backend.rocksdb.latency-track-enabled is related to state.backend.latency-track.keyed-state-enable? Or which option I should set for metrics with a marginal impact. Thanks.
> >
> > Best wishes,
> > Chen-Che Huang
>

[Yun Tang]

Hi Chen-Che,

The PR-16177 [1] is the documentation for state access latency tracking, thought it has not been merged, you could still refer it for more details.

[1] https://github.com/apache/flink/pull/16177

Best

Yun Tang

---

From: Chen-Che Huang <[hidden email]>
Sent: Friday, June 18, 2021 16:21
To: [hidden email] <[hidden email]>
Subject: Re: How to set state.backend.rocksdb.latency-track-enabled

 

Hi Yangze,

Got it. I'll evaluate to enable this feature and see whether I can gain some insights. Many thanks for your reply.

On 2021/06/18 07:52:53, Yangze Guo <[hidden email]> wrote:
> Hi, Chen-Che,
>
> IIUC, the "state.backend.rocksdb.latency-track-enabled" is just a
> reject alternative and has been incorrectly written to the release
> note. You can refer to the [1] instead.
>
> [1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/#state-backends-latency-tracking-options
>
> Best,
> Yangze Guo
>
> On Fri, Jun 18, 2021 at 3:39 PM Chen-Che Huang <[hidden email]> wrote:
> >
> > Hi,
> >
> > The 1.13 release note (https://flink.apache.org/news/2021/05/03/release-1.13.0.html) mentions that we can set state.backend.rocksdb.latency-track-enabled to obtain some rockdb metrics with a marginal impact. However, I couldn't see state.backend.rocksdb.latency-track-enabled in https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/config/. Based on this PR (https://github.com/apache/flink/pull/15091), it seems that state.backend.rocksdb.latency-track-enabled is related to state.backend.latency-track.keyed-state-enable? Or which option I should set for metrics with a marginal impact. Thanks.
> >
> > Best wishes,
> > Chen-Che Huang
>