Re: Batch Cascade application

Posted by Puneet Kinra-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Batch-Cascade-application-tp18260p18263.html

Hi Till

I have 2 kind of data

a) read the data from database put into the memory and nosql database so have 1 source & custom sink operator

Job1 ------>Source--->NoSQL Sink-->status 

b) once the  data is updated into the memory i need to run the second job so i am checking the status return by the first job so have another source where some historical data is coming  so have 1 source & 1 flatmap

and output sink

Job2 ------>Source2-->Check in cache  built from first job --> if exist execute rules ---> dump to file

so if(Job1==true)

{

      execute Job2

}  

On Fri, Feb 9, 2018 at 3:23 PM, Till Rohrmann <[hidden email]> wrote:

Hi Puneet,

without more information about the job you're running (ideally code), it's hard to help you.

Cheers,

Till

On Fri, Feb 9, 2018 at 10:43 AM, Puneet Kinra <[hidden email]> wrote:

Hi

I am working on batch application i which once the data is get loaded into the Memory 

second job should only run once first job is finished.

boolean contactHistoryLoading=bonusPointBatch.contactHistoryLoading(jsonFileReader,cache);

if(contactHistoryLoading)

{

bonusPointBatch.transcationLoading(jsonFileReader, cache);

}

but in the plan it is show only two operators ideally it show 4 operators

2 from each job.

--

--