Parallelizing openCV libraries in Flink

[Debaditya Roy]

Hello users,

I am currently doing a project in image processing with Open CV library. Have anyone here faced any issue with parallelizing the library in flink? I have written a code which is running fine on local environment, however when I try to run it in distributed environment it writes (it was supposed to write some result) in the sink files. I suspect that it is having problem with reading the video file which I have supplied the source directory.

Any comments and similar experience will be extremely helpful.

Warm Regards,

Debaditya

[Till Rohrmann]

Hi Debaditya,

you can see in the web interface how much data each source has sent to the downstream tasks and how much data was consumed by the sinks. This should tell you whether your sources have actually read some data. You can also check the log files whether you find anything suspicious there.

Cheers,

Till

On Tue, Jul 19, 2016 at 10:33 AM, Debaditya Roy <[hidden email]> wrote:

Hello users,

I am currently doing a project in image processing with Open CV library. Have anyone here faced any issue with parallelizing the library in flink? I have written a code which is running fine on local environment, however when I try to run it in distributed environment it writes (it was supposed to write some result) in the sink files. I suspect that it is having problem with reading the video file which I have supplied the source directory.

Any comments and similar experience will be extremely helpful.

Warm Regards,

Debaditya

[Debaditya Roy]

Hello,

I cannot have an access to the web interface from the nodes I am using. However I will check the logs for anything suspicious and get back.

Thanks :-)

Regards,

Debaditya

On Tue, Jul 19, 2016 at 4:46 PM, Till Rohrmann <[hidden email]> wrote:

Hi Debaditya,

you can see in the web interface how much data each source has sent to the downstream tasks and how much data was consumed by the sinks. This should tell you whether your sources have actually read some data. You can also check the log files whether you find anything suspicious there.

Cheers,

Till

On Tue, Jul 19, 2016 at 10:33 AM, Debaditya Roy <[hidden email]> wrote:

Hello users,

I am currently doing a project in image processing with Open CV library. Have anyone here faced any issue with parallelizing the library in flink? I have written a code which is running fine on local environment, however when I try to run it in distributed environment it writes (it was supposed to write some result) in the sink files. I suspect that it is having problem with reading the video file which I have supplied the source directory.

Any comments and similar experience will be extremely helpful.

Warm Regards,

Debaditya