verbose console

[Michele Bertoni]

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Maximilian Michels]

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:
> Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
> Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work
>
>
> thanks
> michele

[Michele Bertoni]

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Till Rohrmann]

Can it be that you confuse the logback configuration file with the log4j configuration file? The log4j.properties file should look like

log4j.rootLogger=INFO, console

# Log all infos in the given file
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{HH:mm:ss,SSS} %-5p %-60c %x - %m%n

# suppress the irrelevant (wrong) warnings from the netty channel handler
log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, console

Cheers,
Till

​

On Wed, Sep 2, 2015 at 4:33 PM, Michele Bertoni <[hidden email]> wrote:

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Michele Bertoni]

Totally, it is the first time i am using them and I thought they were the same

I will try it asap

thanks

Il giorno 02/set/2015, alle ore 16:41, Till Rohrmann <[hidden email]> ha scritto:

Can it be that you confuse the logback configuration file with the log4j configuration file? The log4j.properties file should look like

log4j.rootLogger=INFO, console

# Log all infos in the given file
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{HH:mm:ss,SSS} %-5p %-60c %x - %m%n

# suppress the irrelevant (wrong) warnings from the netty channel handler
log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, console

Cheers,
Till

​

On Wed, Sep 2, 2015 at 4:33 PM, Michele Bertoni <[hidden email]> wrote:

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Michele Bertoni]

Hi!
Ok i solved it partially but is there a way to remove also all the lines referring to operators executed?
i.e. Filter(Filter at package.class)(x/y) switched to finish

I don't really want them in my console output

Thanks!

Il giorno 02/set/2015, alle ore 16:49, Michele Bertoni <[hidden email]> ha scritto:

Totally, it is the first time i am using them and I thought they were the same

I will try it asap

thanks

Il giorno 02/set/2015, alle ore 16:41, Till Rohrmann <[hidden email]> ha scritto:

Can it be that you confuse the logback configuration file with the log4j configuration file? The log4j.properties file should look like

log4j.rootLogger=INFO, console

# Log all infos in the given file
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{HH:mm:ss,SSS} %-5p %-60c %x - %m%n

# suppress the irrelevant (wrong) warnings from the netty channel handler
log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, console

Cheers,
Till

​

On Wed, Sep 2, 2015 at 4:33 PM, Michele Bertoni <[hidden email]> wrote:

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Stephan Ewen]

Hi!

Inside your program, you can do the following:

"environment.getExecutionConfig().disableSysoutLogging()"

That should suppress all these outputs. Hope that helps...

Stephan

On Fri, Sep 11, 2015 at 11:17 PM, Michele Bertoni <[hidden email]> wrote:

Hi!
Ok i solved it partially but is there a way to remove also all the lines referring to operators executed?
i.e. Filter(Filter at package.class)(x/y) switched to finish

I don't really want them in my console output

Thanks!

Il giorno 02/set/2015, alle ore 16:49, Michele Bertoni <[hidden email]> ha scritto:

Totally, it is the first time i am using them and I thought they were the same

I will try it asap

thanks

Il giorno 02/set/2015, alle ore 16:41, Till Rohrmann <[hidden email]> ha scritto:

Can it be that you confuse the logback configuration file with the log4j configuration file? The log4j.properties file should look like

log4j.rootLogger=INFO, console

# Log all infos in the given file
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{HH:mm:ss,SSS} %-5p %-60c %x - %m%n

# suppress the irrelevant (wrong) warnings from the netty channel handler
log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, console

Cheers,
Till

​

On Wed, Sep 2, 2015 at 4:33 PM, Michele Bertoni <[hidden email]> wrote:

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele

[Michele Bertoni]

that’s exactly what I needed

thanks

Il giorno 12/set/2015, alle ore 16:12, Stephan Ewen <[hidden email]> ha scritto:

Hi!

Inside your program, you can do the following:

"environment.getExecutionConfig().disableSysoutLogging()"

That should suppress all these outputs. Hope that helps...

Stephan

On Fri, Sep 11, 2015 at 11:17 PM, Michele Bertoni <[hidden email]> wrote:

Hi!
Ok i solved it partially but is there a way to remove also all the lines referring to operators executed?
i.e. Filter(Filter at package.class)(x/y) switched to finish

I don't really want them in my console output

Thanks!

Il giorno 02/set/2015, alle ore 16:49, Michele Bertoni <[hidden email]> ha scritto:

Totally, it is the first time i am using them and I thought they were the same

I will try it asap

thanks

Il giorno 02/set/2015, alle ore 16:41, Till Rohrmann <[hidden email]> ha scritto:

Can it be that you confuse the logback configuration file with the log4j configuration file? The log4j.properties file should look like

log4j.rootLogger=INFO, console

# Log all infos in the given file
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{HH:mm:ss,SSS} %-5p %-60c %x - %m%n

# suppress the irrelevant (wrong) warnings from the netty channel handler
log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, console

Cheers,
Till

​

On Wed, Sep 2, 2015 at 4:33 PM, Michele Bertoni <[hidden email]> wrote:

thanks for answering,

yes I did it, in fact it is working for my logger, but I don’t know how to limit flink logger using the log4j property

if i use this line

<logger name="org.apache.flink.runtime.jobgraph.JobGraph" level="DEBUG"/>

as suggested by doc, i get a compilation error of the log4j property document: level should not be in that position

instead doing something like this is accepted

<logger name=“org.apache.flink.runtime.jobgraph.JobGraph”>

<level=“ERROR”/>

</logger>

but is not doing anything

Il giorno 02/set/2015, alle ore 16:09, Maximilian Michels <[hidden email]> ha scritto:

Hi Michele,

Please supply a log4j.properties file path as a Java VM property like
so: -Dlog4j.configuration=/path/to/log4j.properties

Your IDE should have an option to adjust VM arguments.

Cheers,
Max

On Wed, Sep 2, 2015 at 9:10 AM, Michele Bertoni
<[hidden email]> wrote:

Hi everybody, I just found that in version 0.9.1 it is possibile to disable that verbose console, can you please explain how to do it both in IDE and local environment?
Especially in IDE I am able to set property of log4j for my logger, but everything I try for flink internal one does not work


thanks
michele