RideCleansing example

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

RideCleansing example

Serkan Taş
Hi,

I am working on lectures and examples to get used to on flink. 

For the RideCleansing example, in intelliJ it is working as expected. But after packaging submitting to local flink, there is no output.

is it normal ?

Here is the console

01/01/2016 19:55:31     Job execution switched to status RUNNING.
01/01/2016 19:55:31     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to SCHEDULED
01/01/2016 19:55:31     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to DEPLOYING
01/01/2016 19:55:32     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to RUNNING

and the web screen

(not-set) Source : Custom Source -> Filter -> Sink: Unnamed

thanx in advance


Serkan Taş
Mobil : +90 532 250 07 71
Likya Bilgi Teknolojileri
ve İletişim Hiz. Ltd. Şti.
 
--------------------------------------
Bu elektronik posta ve onunla iletilen bütün dosyalar gizlidir. Sadece yukarıda isimleri belirtilen kişiler arasında özel haberleşme amacını taşımaktadır. Size yanlışlıkla ulaşmışsa bu elektonik postanın içeriğini açıklamanız, kopyalamanız, yönlendirmeniz ve kullanmanız kesinlikle yasaktır. Lütfen mesajı geri gönderiniz ve sisteminizden siliniz. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. bu mesajın içeriği ile ilgili olarak hiç bir hukuksal sorumluluğu kabul etmez.
 
This electronic mail and any files transmitted with it are intended for the private use of  the persons named above. If you received this message in error, forwarding, copying or use of any of the information is strictly prohibited. Please immediately notify the sender and delete it from your system. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. does not accept legal responsibility for the contents of this message.
--------------------------------------







P
Bu e-postayı yazdırmadan önce, çevreye olan sorumluluğunuzu tekrar düşünün.
Please consider your environmental responsibility before printing this e-mail.
 

Reply | Threaded
Open this post in threaded view
|

Re: RideCleansing example

Fabian Hueske-2
Hi Serkan,

yes this is expected. The reference implementations use DataStream.print() to emit the resulting data stream to the standard output. If the program is executed in an IDE, the standard output is goes to the IDE's console. If you start Flink in a local (or cluster) setup, the standard output is redirected to a .out file in the ./log folder. For local setups, this will be the *-jobmanager-*.out file, for cluster setups the individual *-taskmanager-*.out files.

Note that the behavior of .print() differs for the DataStream and the DataSet API. For DataSet, the output of the task manager (worker) processes is collected by the job manager (master) process and is shipped to the client process that submitted the program and printed there. For DataStream, the output is directly emitted by the task manager processes and written to their .out log files.

Best,
Fabian

2016-01-01 19:06 GMT+01:00 Serkan Taş <[hidden email]>:
Hi,

I am working on lectures and examples to get used to on flink. 

For the RideCleansing example, in intelliJ it is working as expected. But after packaging submitting to local flink, there is no output.

is it normal ?

Here is the console

01/01/2016 19:55:31     Job execution switched to status RUNNING.
01/01/2016 19:55:31     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to SCHEDULED
01/01/2016 19:55:31     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to DEPLOYING
01/01/2016 19:55:32     Source: Custom Source -> Filter -> Sink: Unnamed(1/1) sw
itched to RUNNING

and the web screen

(not-set) Source : Custom Source -> Filter -> Sink: Unnamed

thanx in advance


Serkan Taş
Mobil : <a href="tel:%2B90%20532%20250%2007%2071" target="_blank" value="+905322500771">+90 532 250 07 71
Likya Bilgi Teknolojileri
ve İletişim Hiz. Ltd. Şti.
 
--------------------------------------
Bu elektronik posta ve onunla iletilen bütün dosyalar gizlidir. Sadece yukarıda isimleri belirtilen kişiler arasında özel haberleşme amacını taşımaktadır. Size yanlışlıkla ulaşmışsa bu elektonik postanın içeriğini açıklamanız, kopyalamanız, yönlendirmeniz ve kullanmanız kesinlikle yasaktır. Lütfen mesajı geri gönderiniz ve sisteminizden siliniz. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. bu mesajın içeriği ile ilgili olarak hiç bir hukuksal sorumluluğu kabul etmez.
 
This electronic mail and any files transmitted with it are intended for the private use of  the persons named above. If you received this message in error, forwarding, copying or use of any of the information is strictly prohibited. Please immediately notify the sender and delete it from your system. Likya Bilgi Teknolojileri ve İletişim Hiz. Ltd. Şti. does not accept legal responsibility for the contents of this message.
--------------------------------------







P
Bu e-postayı yazdırmadan önce, çevreye olan sorumluluğunuzu tekrar düşünün.
Please consider your environmental responsibility before printing this e-mail.