QueryableStateClient configurations

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

QueryableStateClient configurations

mmziyad
Dear all,

QueryableStateClient class is modified a little in the latest flink release (1.3.1), and I'm having difficulty to understand some of the options. Can someone explain the below options?

1. How do I set the below options in QueryableStateClient ?

  • query.client.network-threads
  • query.client.lookup.num-retries
  • query.client.lookup.retry-delay
2. 
final HighAvailabilityServices highAvailabilityServices =
      HighAvailabilityServicesUtils.createHighAvailabilityServices(
           config,
           Executors.newSingleThreadScheduledExecutor(),
           HighAvailabilityServicesUtils.AddressResolution.TRY_ADDRESS_RESOLUTION);
QueryableStateClient client = new QueryableStateClient(config, highAvailabilityServices);

How does specifying an Executor here works with the server configuration 'query.server.network-threads' ?

Thanks in advance

Best
Ziyad
Reply | Threaded
Open this post in threaded view
|

Re: QueryableStateClient configurations

Aljoscha Krettek
Hi Ziyad,

You should be able to set the options in the Configuration that you hand to the constructor of QueryableStateClient, i.e.:

Configuration config = new Configuration();
config.setInteger(QueryableStateOptions.CLIENT_NETWORK_THREADS, 5);

The executor that you specify when creating the HighAvailabilityServices is actually never used in the code paths that the QueryableStateClient uses so it should not matter what you pass here. It’s also independent from the server configuration for the number of network threads, which you must set in the configuration of your cluster before starting the cluster.

Best,
Aljoscha

On 4. Jul 2017, at 17:07, Ziyad Muhammed <[hidden email]> wrote:

Dear all,

QueryableStateClient class is modified a little in the latest flink release (1.3.1), and I'm having difficulty to understand some of the options. Can someone explain the below options?

1. How do I set the below options in QueryableStateClient ?

  • query.client.network-threads
  • query.client.lookup.num-retries
  • query.client.lookup.retry-delay
2. 
final HighAvailabilityServices highAvailabilityServices =
      HighAvailabilityServicesUtils.createHighAvailabilityServices(
           config,
           Executors.newSingleThreadScheduledExecutor(),
           HighAvailabilityServicesUtils.AddressResolution.TRY_ADDRESS_RESOLUTION);
QueryableStateClient client = new QueryableStateClient(config, highAvailabilityServices);

How does specifying an Executor here works with the server configuration 'query.server.network-threads' ?

Thanks in advance

Best
Ziyad