(DEPRECATED) Apache Flink User Mailing List archive.

Flink 1.5.0 no more allow multiple program argument?

classic Classic list List threaded Threaded
♦
♦
 3 messages Options
Siew Wai Yow
Reply | Threaded
Open this post in threaded view
♦
♦
|

Flink 1.5.0 no more allow multiple program argument?

Siew Wai Yow

Hi,


I get the following error when upgrade flink from 1.3.2 to 1.5.0 when using REST api to upload and run a jar.


{"errors":["Expected only one value [--KAFKA_IN PREBLN_O@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_PREBLN_O_124 --KAFKA_OUT FX_AGGR_ASCII@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGR_ASCII_181;FX_AGGREGATED@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGREGATED_181 --KAFKA_REJECT INVALID@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_INVALID_181 --KAFKA_AUDIT AUDIT@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_AUDIT_181 --KAFKA_REPROCESS REPROCESS@192.168.56.120:9092, 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_REPROCESS_181 --OPTION --JOB_NAME POC_BHARTI_FLINK_AGGR  --AUDIT_WINDOWS_INTERVAL_MS 5000 --STATSD_URL 192.168.56.200:8127  --STATSD_SAMPLING_DURATION 1000 --CHECK_POINT_INTERVAL 20000 --NODEID 181 --LS_SERVER LsServer --LS_TABLES Table1, Table2 --ZK_POLLING 30 --ZK_URL 192.168.56.130, 192.168.56.131, 192.168.56.132 --LS_HOSTNAME  --LS_ENABLE 0 --ZK_RETRY_COUNT 0 --ZK_RETRY_INTERVAL 0 --LS_ABORT_ON_RELOAD_FAILURE 1 --ZK_SESSION_TIMEOUT 60000 --ZK_KEEP_CONN_ALIVE 1]."]}


Seems the program-argument no more allow multiple parameter? But the document tell different story,


"From the command line arguments"

https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html

Any advice please? thank you.


Regards,

Yow
Chesnay Schepler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink 1.5.0 no more allow multiple program argument?

Chesnay Schepler
For now you'll have to replace all commas with some other delimiter.

On 19.06.2018 04:15, Siew Wai Yow wrote:

Hi,


I get the following error when upgrade flink from 1.3.2 to 1.5.0 when using REST api to upload and run a jar.


{"errors":["Expected only one value [--KAFKA_IN [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_PREBLN_O_124 --KAFKA_OUT [hidden email], 192.168.56.121:9092, [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGREGATED_181 --KAFKA_REJECT [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_INVALID_181 --KAFKA_AUDIT [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_AUDIT_181 --KAFKA_REPROCESS [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_REPROCESS_181 --OPTION --JOB_NAME POC_BHARTI_FLINK_AGGR  --AUDIT_WINDOWS_INTERVAL_MS 5000 --STATSD_URL 192.168.56.200:8127  --STATSD_SAMPLING_DURATION 1000 --CHECK_POINT_INTERVAL 20000 --NODEID 181 --LS_SERVER LsServer --LS_TABLES Table1, Table2 --ZK_POLLING 30 --ZK_URL 192.168.56.130, 192.168.56.131, 192.168.56.132 --LS_HOSTNAME  --LS_ENABLE 0 --ZK_RETRY_COUNT 0 --ZK_RETRY_INTERVAL 0 --LS_ABORT_ON_RELOAD_FAILURE 1 --ZK_SESSION_TIMEOUT 60000 --ZK_KEEP_CONN_ALIVE 1]."]}


Seems the program-argument no more allow multiple parameter? But the document tell different story,


"From the command line arguments"

https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html

Any advice please? thank you.


Regards,

Yow
Siew Wai Yow
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink 1.5.0 no more allow multiple program argument?

Siew Wai Yow

Thanks Chesnay! I guess it is related to StringJoiner(",") used in Flink 1.5 :(


From: Chesnay Schepler <[hidden email]>
Sent: Tuesday, June 19, 2018 1:44 PM
To: [hidden email]
Subject: Re: Flink 1.5.0 no more allow multiple program argument?
 
For now you'll have to replace all commas with some other delimiter.

On 19.06.2018 04:15, Siew Wai Yow wrote:

Hi,


I get the following error when upgrade flink from 1.3.2 to 1.5.0 when using REST api to upload and run a jar.


{"errors":["Expected only one value [--KAFKA_IN [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_PREBLN_O_124 --KAFKA_OUT [hidden email], 192.168.56.121:9092, [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_FX_AGGREGATED_181 --KAFKA_REJECT [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_INVALID_181 --KAFKA_AUDIT [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_AUDIT_181 --KAFKA_REPROCESS [hidden email], 192.168.56.121:9092, 192.168.56.122:9092/BHARTI_FL_REPROCESS_181 --OPTION --JOB_NAME POC_BHARTI_FLINK_AGGR  --AUDIT_WINDOWS_INTERVAL_MS 5000 --STATSD_URL 192.168.56.200:8127  --STATSD_SAMPLING_DURATION 1000 --CHECK_POINT_INTERVAL 20000 --NODEID 181 --LS_SERVER LsServer --LS_TABLES Table1, Table2 --ZK_POLLING 30 --ZK_URL 192.168.56.130, 192.168.56.131, 192.168.56.132 --LS_HOSTNAME  --LS_ENABLE 0 --ZK_RETRY_COUNT 0 --ZK_RETRY_INTERVAL 0 --LS_ABORT_ON_RELOAD_FAILURE 1 --ZK_SESSION_TIMEOUT 60000 --ZK_KEEP_CONN_ALIVE 1]."]}


Seems the program-argument no more allow multiple parameter? But the document tell different story,


"From the command line arguments"

https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/best_practices.html

ci.apache.org
Almost all Flink applications, both batch and streaming, rely on external configuration parameters. They are used to specify input and output sources (like paths or addresses), system parameters (parallelism, runtime configuration), and application specific parameters (typically used within user ...
Any advice please? thank you.


Regards,

Yow
Free forum by Nabble Edit this page