Re: Job manager URI rpc address:port

Posted by Zahid Rahman on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Job-manager-URI-rpc-address-port-tp34437p34440.html

Hi Tison,

I think I may have found what I want in example 22.

https://www.programcreek.com/java-api-examples/?api=org.apache.flink.configuration.Configuration

I need to create Configuration object first as shown .

Also I think  flink-conf.yaml file may contain configuration for client rather than  server. So before starting is irrelevant. 

I am going to play around and see but if the Configuration class allows me to set configuration programmatically and overrides the yaml file then that would be great. 

On Sun, 19 Apr 2020, 11:35 Som Lima, <[hidden email]> wrote:

Thanks.

flink-conf.yaml does allow me to do what I need to do without making any changes to client source code.

But

RemoteStreamEnvironment constructor  expects a jar file as the third parameter also.

RemoteStreamEnvironment(String host, int port, String... jarFiles)

Creates a new RemoteStreamEnvironment that points to the master (JobManager) described by the given host name and port.

On Sun, 19 Apr 2020, 11:02 tison, <[hidden email]> wrote:

You can change flink-conf.yaml "jobmanager.address" or "jobmanager.port" options before run the program or take a look at RemoteStreamEnvironment which enables configuring host and port.

Som Lima <[hidden email]> 于2020年4月19日周日 下午5:58写道：

Hi,

After running 

$ ./bin/start-cluster.sh

The following line of code defaults jobmanager  to localhost:6123 

final  ExecutionEnvironment env = Environment.getExecutionEnvironment();

which is same on spark.

val spark = SparkSession.builder.master(local[*]).appname("anapp").getOrCreate

However if I wish to run the servers on a different physical computer.

Then in Spark I can do it this way using the spark URI in my IDE.

Conf =  SparkConf().setMaster("spark://<hostip>:<port>").setAppName("anapp")

Can you please tell me the equivalent change to make so I can run my servers and my IDE from different physical computers.