Batch Cascade application

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Batch Cascade application

Puneet Kinra-2
Hi

I am working on batch application i which once the data is get loaded into the Memory 
second job should only run once first job is finished.



boolean contactHistoryLoading=bonusPointBatch.contactHistoryLoading(jsonFileReader,cache);
if(contactHistoryLoading)
{
bonusPointBatch.transcationLoading(jsonFileReader, cache);
}


but in the plan it is show only two operators ideally it show 4 operators
2 from each job.


Inline image 1

--
Cheers 

Puneet Kinra

Mobile:+918800167808 | Skype : [hidden email]

e-mail :[hidden email]


Reply | Threaded
Open this post in threaded view
|

Re: Batch Cascade application

Till Rohrmann
Hi Puneet,

without more information about the job you're running (ideally code), it's hard to help you.

Cheers,
Till

On Fri, Feb 9, 2018 at 10:43 AM, Puneet Kinra <[hidden email]> wrote:
Hi

I am working on batch application i which once the data is get loaded into the Memory 
second job should only run once first job is finished.



boolean contactHistoryLoading=bonusPointBatch.contactHistoryLoading(jsonFileReader,cache);
if(contactHistoryLoading)
{
bonusPointBatch.transcationLoading(jsonFileReader, cache);
}


but in the plan it is show only two operators ideally it show 4 operators
2 from each job.


Inline image 1

--
Cheers 

Puneet Kinra

Mobile:<a href="tel:+91%2088001%2067808" value="+918800167808" target="_blank">+918800167808 | Skype : [hidden email]

e-mail :[hidden email]



Reply | Threaded
Open this post in threaded view
|

Re: Batch Cascade application

Puneet Kinra-2
Hi Till

I have 2 kind of data

a) read the data from database put into the memory and nosql database so have 1 source & custom sink operator
Job1 ------>Source--->NoSQL Sink-->status 

b) once the  data is updated into the memory i need to run the second job so i am checking the status return by the first job so have another source where some historical data is coming  so have 1 source & 1 flatmap
and output sink

Job2 ------>Source2-->Check in cache  built from first job --> if exist execute rules ---> dump to file

so if(Job1==true)
{
      execute Job2
}  


On Fri, Feb 9, 2018 at 3:23 PM, Till Rohrmann <[hidden email]> wrote:
Hi Puneet,

without more information about the job you're running (ideally code), it's hard to help you.

Cheers,
Till

On Fri, Feb 9, 2018 at 10:43 AM, Puneet Kinra <[hidden email]> wrote:
Hi

I am working on batch application i which once the data is get loaded into the Memory 
second job should only run once first job is finished.



boolean contactHistoryLoading=bonusPointBatch.contactHistoryLoading(jsonFileReader,cache);
if(contactHistoryLoading)
{
bonusPointBatch.transcationLoading(jsonFileReader, cache);
}


but in the plan it is show only two operators ideally it show 4 operators
2 from each job.


Inline image 1

--
Cheers 

Puneet Kinra

Mobile:<a href="tel:+91%2088001%2067808" value="+918800167808" target="_blank">+918800167808 | Skype : [hidden email]

e-mail :[hidden email]






--
Cheers 

Puneet Kinra

Mobile:+918800167808 | Skype : [hidden email]

e-mail :[hidden email]