Programatically collect taskmanagers details from Job Manager

[Sreejith S]

Hi All,

Is there any programmatic way to get the taskmanager details from a flink clluster ?

At least the IP of taskmanagers ?

Thanks,

--

[Stephan Ewen]

You should be able to call the Monitor handler of the JobManager:   http://jobmanagerhost:8081/taskmanagers

That gives you a JSON response like this: 

{ "taskmanagers [   

  { "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",

    "path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",

    "dataPort" : 56199,

    "timeSinceLastHeartbeat" : 1472461577563,

    "slotsNumber" : 4,

    ....},

  { "id " :"460bfbf8b540bf28befd616cbc9ea532",

    "path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",

    "dataPort" : 39233,

    "timeSinceLastHeartbeat" : 1472461577967,

    "slotsNumber":4,

    ....}

]

}

That should have the hostname/IP in the TaskManager URL:

Hope that helps

Stephan

On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <[hidden email]> wrote:

Hi All,

Is there any programmatic way to get the taskmanager details from a flink clluster ?

At least the IP of taskmanagers ?

Thanks,

--

[Sreejith S]

Thank you Stephen ! That helps,

Is it possible to get the JMX_PORT kind of details from taskmanagers ?

My program will connect to Job Manager and get all taskmaneger IP's and JMX Port and create a JMX_URL automatically. This is what i am trying to achieve.

Is it possible ?

Thanks,

On Mon, Aug 29, 2016 at 2:38 PM, Stephan Ewen <[hidden email]> wrote:

You should be able to call the Monitor handler of the JobManager:   http://jobmanagerhost:8081/taskmanagers

That gives you a JSON response like this: 

{ "taskmanagers [   

  { "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",

    "path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",

    "dataPort" : 56199,

    "timeSinceLastHeartbeat" : 1472461577563,

    "slotsNumber" : 4,

    ....},

  { "id " :"460bfbf8b540bf28befd616cbc9ea532",

    "path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",

    "dataPort" : 39233,

    "timeSinceLastHeartbeat" : 1472461577967,

    "slotsNumber":4,

    ....}

]

}

That should have the hostname/IP in the TaskManager URL:

Hope that helps

Stephan

On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <[hidden email]> wrote:

Hi All,

Is there any programmatic way to get the taskmanager details from a flink clluster ?

At least the IP of taskmanagers ?

Thanks,

--

--

[rmetzger0]

Hi,

I think the JMX port is logged, but not accessible through the REST interface of the JobManager.

I think its a useful feature. If you want, you can file a JIRA for it.

On Mon, Aug 29, 2016 at 12:14 PM, Sreejith S <[hidden email]> wrote:

Thank you Stephen ! That helps,

Is it possible to get the JMX_PORT kind of details from taskmanagers ?

My program will connect to Job Manager and get all taskmaneger IP's and JMX Port and create a JMX_URL automatically. This is what i am trying to achieve.

Is it possible ?

Thanks,

On Mon, Aug 29, 2016 at 2:38 PM, Stephan Ewen <[hidden email]> wrote:

You should be able to call the Monitor handler of the JobManager:   http://jobmanagerhost:8081/taskmanagers

That gives you a JSON response like this: 

{ "taskmanagers [   

  { "id" : "7c8835b89acf533cb8a5119dbcaf4b4f",

    "path" : "akka.tcp://flink@127.0.1.1:56343/user/taskmanager",

    "dataPort" : 56199,

    "timeSinceLastHeartbeat" : 1472461577563,

    "slotsNumber" : 4,

    ....},

  { "id " :"460bfbf8b540bf28befd616cbc9ea532",

    "path" : "akka.tcp://flink@127.0.1.1:58404/user/taskmanager",

    "dataPort" : 39233,

    "timeSinceLastHeartbeat" : 1472461577967,

    "slotsNumber":4,

    ....}

]

}

That should have the hostname/IP in the TaskManager URL:

Hope that helps

Stephan

On Sun, Aug 28, 2016 at 3:03 PM, Sreejith S <[hidden email]> wrote:

Hi All,

Is there any programmatic way to get the taskmanager details from a flink clluster ?

At least the IP of taskmanagers ?

Thanks,

--

--