Get JobId and JobManager RPC Address in RichMapFunction executed in TaskManager

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Get JobId and JobManager RPC Address in RichMapFunction executed in TaskManager

Sandeep khanzode
Hello,

I am deploying a standalone-job cluster (cluster with a single Job and Task Manager instance instantiated with a —job-classname and —job-id).

I have map/flatmap/process functions being executed in the various stream functions in the Taskmanager for which I need access to the Job Id and the JobManager RPC address. How can I get access to these variables? What in-built environment/context/configuration functions exist for this purpose?

I need these two variables for queryable-state.

Thanks
Reply | Threaded
Open this post in threaded view
|

Re: Get JobId and JobManager RPC Address in RichMapFunction executed in TaskManager

Matthias
Hi Sandeep,
thanks for reaching out to the community. Unfortunately, the information you're looking for is not exposed in a way that you could access it from within your RichMapFunction. Could you elaborate a bit more on what you're trying to achieve? Maybe, we can find another solution for your problem.

Best,
Matthias

On Thu, Feb 25, 2021 at 7:43 AM Sandeep khanzode <[hidden email]> wrote:
Hello,

I am deploying a standalone-job cluster (cluster with a single Job and Task Manager instance instantiated with a —job-classname and —job-id).

I have map/flatmap/process functions being executed in the various stream functions in the Taskmanager for which I need access to the Job Id and the JobManager RPC address. How can I get access to these variables? What in-built environment/context/configuration functions exist for this purpose?

I need these two variables for queryable-state.

Thanks