how to specify the log level?

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

how to specify the log level?

Attila Bernáth
Dear Developers!

I clone the incubator-flink from github and import it as a maven
project in my eclipse.
I then run some example, like
org.apache.flink.spargel.java.examples.SpargelConnectedComponents
and I get a lot of log on the console. How to change that?
I tried changing some log4j.properties and logback.xml files,
according to the documentation, but I did not find the right one.
Thanks in advance.

Attila
Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Stephan Ewen
Hi!

If you use the quickstarts, you find a log4j.properties file in src/main/resources. If you make this file empty, it will suppress the log output.

In general, a log4j.properties file in the classpath if the way to configure logging.

Stephan


On Thu, Nov 6, 2014 at 5:31 PM, Attila Bernáth <[hidden email]> wrote:
Dear Developers!

I clone the incubator-flink from github and import it as a maven
project in my eclipse.
I then run some example, like
org.apache.flink.spargel.java.examples.SpargelConnectedComponents
and I get a lot of log on the console. How to change that?
I tried changing some log4j.properties and logback.xml files,
according to the documentation, but I did not find the right one.
Thanks in advance.

Attila

Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Attila Bernáth
Dear Stephan,

Assume I stand in the root directory of the incubator-flink repo.

I did not find a log4j.properties file in that directory (I am not
completely sure what you meant, I looked in
flink-quickstart/flink-quickstart-java/src/main/resources
)
Putting an empty file there did not change anything.

The log4j.properties files I have here are:
sudocker@314a9613c340:~/git/incubator-flink$ find -name log4j.properties
./flink-dist/target/flink-0.7-incubating-SNAPSHOT-bin/flink-yarn-0.7-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/target/flink-0.7-incubating-SNAPSHOT-bin/flink-0.7-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/target/flink-0.8-incubating-SNAPSHOT-bin/flink-0.8-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/src/main/flink-bin/conf/log4j.properties

All of these contain something like
log4j.rootLogger=WARN, file

Attila


2014-11-06 18:02 GMT+01:00 Stephan Ewen <[hidden email]>:

> Hi!
>
> If you use the quickstarts, you find a log4j.properties file in
> src/main/resources. If you make this file empty, it will suppress the log
> output.
>
> In general, a log4j.properties file in the classpath if the way to configure
> logging.
>
> Stephan
>
>
> On Thu, Nov 6, 2014 at 5:31 PM, Attila Bernáth <[hidden email]>
> wrote:
>>
>> Dear Developers!
>>
>> I clone the incubator-flink from github and import it as a maven
>> project in my eclipse.
>> I then run some example, like
>> org.apache.flink.spargel.java.examples.SpargelConnectedComponents
>> and I get a lot of log on the console. How to change that?
>> I tried changing some log4j.properties and logback.xml files,
>> according to the documentation, but I did not find the right one.
>> Thanks in advance.
>>
>> Attila
>
>
Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Stephan Ewen
Hi!

How are you running your programs? Command line, IDE, web interface?


If you run programs from the command line (after building Flink, or downloading a binary version), you should not get any log output, only progress messages. These are not configurable by log, but you can pipe that output away if it bothers you.
For the created log files, the log4j.properties in "conf" defines the logging.


If you run examples or other programs from within the IDE, the system will look for the log4j.properties in the classpath.

Greetings,
Stephan


On Fri, Nov 7, 2014 at 11:48 AM, Attila Bernáth <[hidden email]> wrote:
Dear Stephan,

Assume I stand in the root directory of the incubator-flink repo.

I did not find a log4j.properties file in that directory (I am not
completely sure what you meant, I looked in
flink-quickstart/flink-quickstart-java/src/main/resources
)
Putting an empty file there did not change anything.

The log4j.properties files I have here are:
sudocker@314a9613c340:~/git/incubator-flink$ find -name log4j.properties
./flink-dist/target/flink-0.7-incubating-SNAPSHOT-bin/flink-yarn-0.7-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/target/flink-0.7-incubating-SNAPSHOT-bin/flink-0.7-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/target/flink-0.8-incubating-SNAPSHOT-bin/flink-0.8-incubating-SNAPSHOT/conf/log4j.properties
./flink-dist/src/main/flink-bin/conf/log4j.properties

All of these contain something like
log4j.rootLogger=WARN, file

Attila


2014-11-06 18:02 GMT+01:00 Stephan Ewen <[hidden email]>:
> Hi!
>
> If you use the quickstarts, you find a log4j.properties file in
> src/main/resources. If you make this file empty, it will suppress the log
> output.
>
> In general, a log4j.properties file in the classpath if the way to configure
> logging.
>
> Stephan
>
>
> On Thu, Nov 6, 2014 at 5:31 PM, Attila Bernáth <[hidden email]>
> wrote:
>>
>> Dear Developers!
>>
>> I clone the incubator-flink from github and import it as a maven
>> project in my eclipse.
>> I then run some example, like
>> org.apache.flink.spargel.java.examples.SpargelConnectedComponents
>> and I get a lot of log on the console. How to change that?
>> I tried changing some log4j.properties and logback.xml files,
>> according to the documentation, but I did not find the right one.
>> Thanks in advance.
>>
>> Attila
>
>

Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Attila Bernáth
In reply to this post by Attila Bernáth
I have a solution.

> Assume I stand in the root directory of the incubator-flink repo.

mkdir flink-addons/flink-spargel/src/main/resources
cp ./flink-examples/flink-java-examples/src/main/resources/log4j.properties
flink-addons/flink-spargel/src/main/resources/

(This file contains 1 line:
log4j.rootLogger=OFF
)

This prevents any log outputs.

However, if I also set the JVM argument (in eclipse
Run/Configurations/Arguments/VM arguments):
-Dlog4j.configuration="/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties"
then I get the warning:
log4j:WARN No appenders could be found for logger
(org.apache.flink.runtime.blob.BlobServer).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
for more info.


Attila
Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Attila Bernáth
Sorry to bother about this again: what do I miss here?

If I also set the JVM argument (in eclipse
Run/Configurations/Arguments/VM arguments):
-Dlog4j.configuration="/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties"
then I get the warning:
***************
log4j:WARN No appenders could be found for logger
(org.apache.flink.runtime.blob.BlobServer).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
for more info.
***************
The file contains one line:
log4j.rootLogger=OFF

Attila



2014-11-07 14:29 GMT+01:00 Attila Bernáth <[hidden email]>:

> I have a solution.
>
>> Assume I stand in the root directory of the incubator-flink repo.
>
> mkdir flink-addons/flink-spargel/src/main/resources
> cp ./flink-examples/flink-java-examples/src/main/resources/log4j.properties
> flink-addons/flink-spargel/src/main/resources/
>
> (This file contains 1 line:
> log4j.rootLogger=OFF
> )
>
> This prevents any log outputs.
>
> However, if I also set the JVM argument (in eclipse
> Run/Configurations/Arguments/VM arguments):
> -Dlog4j.configuration="/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties"
> then I get the warning:
> log4j:WARN No appenders could be found for logger
> (org.apache.flink.runtime.blob.BlobServer).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for more info.
>
>
> Attila
Reply | Threaded
Open this post in threaded view
|

Re: how to specify the log level?

Till Rohrmann-2
Hi Attila,

if you want to reference a file outside of the jar, you usually have
to specify the complete URI with the "file:" schema. So try
-Dlog4j.configuration=file:/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties.
I hope this solves your problem.

Cheers,

Till

On Mon, Nov 10, 2014 at 11:10 AM, Attila Bernáth
<[hidden email]> wrote:

> Sorry to bother about this again: what do I miss here?
>
> If I also set the JVM argument (in eclipse
> Run/Configurations/Arguments/VM arguments):
> -Dlog4j.configuration="/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties"
> then I get the warning:
> ***************
> log4j:WARN No appenders could be found for logger
> (org.apache.flink.runtime.blob.BlobServer).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for more info.
> ***************
> The file contains one line:
> log4j.rootLogger=OFF
>
> Attila
>
>
>
> 2014-11-07 14:29 GMT+01:00 Attila Bernáth <[hidden email]>:
>> I have a solution.
>>
>>> Assume I stand in the root directory of the incubator-flink repo.
>>
>> mkdir flink-addons/flink-spargel/src/main/resources
>> cp ./flink-examples/flink-java-examples/src/main/resources/log4j.properties
>> flink-addons/flink-spargel/src/main/resources/
>>
>> (This file contains 1 line:
>> log4j.rootLogger=OFF
>> )
>>
>> This prevents any log outputs.
>>
>> However, if I also set the JVM argument (in eclipse
>> Run/Configurations/Arguments/VM arguments):
>> -Dlog4j.configuration="/home/sudocker/git/incubator-flink/flink-addons/flink-spargel/src/main/resources/log4j.properties"
>> then I get the warning:
>> log4j:WARN No appenders could be found for logger
>> (org.apache.flink.runtime.blob.BlobServer).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
>> for more info.
>>
>>
>> Attila