Flik typesafe configuration

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flik typesafe configuration

Georg Heiler
Starting out with flint from a scala background I would like to use the Typesafe configuration like: https://github.com/pureconfig/pureconfig, however, https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/best_practices.html link recommends to setup: 
env.getConfig().setGlobalJobParameters(parameters);
which is not fully compatible with a case class - what is the recommended approach here?

Best,
Georg
Reply | Threaded
Open this post in threaded view
|

Re: Flik typesafe configuration

Fabian Hueske-2
Hi Georg,

The recommended approach to configure user functions is to pass parameters as (typesafe) arguments to the constructor.
Flink serializes users function objects using Java serialization and distributes them to the workers. Hence, the configuration during plan construction is preserved.

Best, Fabian

2017-11-30 8:10 GMT+01:00 Georg Heiler <[hidden email]>:
Starting out with flint from a scala background I would like to use the Typesafe configuration like: https://github.com/pureconfig/pureconfig, however, https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/best_practices.html link recommends to setup: 
env.getConfig().setGlobalJobParameters(parameters);
which is not fully compatible with a case class - what is the recommended approach here?

Best,
Georg