JobManager Dashboard and YARN execution

[Andrea Sella]

Hi,
I am experimenting the integration between Apache Flink and YARN.

When I am running a Flink job using yarn-cluster, is the Dashboard available to monitor the execution? Is it also available for long running session?

Is it possibile retrieve logs from the dashboard or I have to pass via yarn application logs?

Thank you,
Andrea

[Maximilian Michels]

Hi Andrea,

The dashboard is available in both cases. It only shows the job
manager logs. For the task manager, you will have to use the Yarn
commands.

Cheers,
Max

On Wed, Mar 9, 2016 at 12:47 PM, Andrea Sella
<[hidden email]> wrote:

> Hi,
> I am experimenting the integration between Apache Flink and YARN.
>
> When I am running a Flink job using yarn-cluster, is the Dashboard available
> to monitor the execution? Is it also available for long running session?
>
> Is it possibile retrieve logs from the dashboard or I have to pass via yarn
> application logs?
>
> Thank you,
> Andrea

[Stephan Ewen]

Hi!

Yes, the dashboard is available in both cases. It is proxied through the Yarn UI, you can find the link from there...

You can always access JobManager logs through the UI.

Stephan

On Wed, Mar 9, 2016 at 12:47 PM, Andrea Sella <[hidden email]> wrote:

Hi,
I am experimenting the integration between Apache Flink and YARN.

When I am running a Flink job using yarn-cluster, is the Dashboard available to monitor the execution? Is it also available for long running session?

Is it possibile retrieve logs from the dashboard or I have to pass via yarn application logs?

Thank you,
Andrea

[Till Rohrmann]

Hi Andrea,

there is also a PR [1] which will allow you to access the TaskManager logs via the UI.

[1] https://github.com/apache/flink/pull/1790

Cheers,

Till

On Wed, Mar 9, 2016 at 1:58 PM, Stephan Ewen <[hidden email]> wrote:

Hi!

Yes, the dashboard is available in both cases. It is proxied through the Yarn UI, you can find the link from there...

You can always access JobManager logs through the UI.

Stephan

On Wed, Mar 9, 2016 at 12:47 PM, Andrea Sella <[hidden email]> wrote:

Hi,
I am experimenting the integration between Apache Flink and YARN.

When I am running a Flink job using yarn-cluster, is the Dashboard available to monitor the execution? Is it also available for long running session?

Is it possibile retrieve logs from the dashboard or I have to pass via yarn application logs?

Thank you,
Andrea

... [show rest of quote]

[Andrea Sella]

Thanks Till for the update.

BR,
Andrea

2016-03-15 17:16 GMT+01:00 Till Rohrmann <[hidden email]>:

Hi Andrea,

there is also a PR [1] which will allow you to access the TaskManager logs via the UI.

[1] https://github.com/apache/flink/pull/1790

Cheers,

Till

On Wed, Mar 9, 2016 at 1:58 PM, Stephan Ewen <[hidden email]> wrote:

Hi!

Yes, the dashboard is available in both cases. It is proxied through the Yarn UI, you can find the link from there...

You can always access JobManager logs through the UI.

Stephan

On Wed, Mar 9, 2016 at 12:47 PM, Andrea Sella <[hidden email]> wrote:

Hi,
I am experimenting the integration between Apache Flink and YARN.

When I am running a Flink job using yarn-cluster, is the Dashboard available to monitor the execution? Is it also available for long running session?

Is it possibile retrieve logs from the dashboard or I have to pass via yarn application logs?

Thank you,
Andrea

... [show rest of quote]

... [show rest of quote]