Share Spring Application context among operators

[Swapnil Dharane]

Hello,

Is there any way with which I can pass my spring ApplicationContext object as parameter to flink operators? I understand I need to serialize this object.Is there any existing serialization mechanism that I can use? 

Thanks in advance.

[Gordon Weakliem]

The WHOLE Spring ApplicationContext? This sounds like a bad idea. Most of that stuff isn't applicable outside a Spring application. Can't you cut it down to a smaller subset that your Flink app actually needs?

On Fri, Feb 9, 2018 at 9:15 PM, Swapnil Dharane <[hidden email]> wrote:

Hello,

Is there any way with which I can pass my spring ApplicationContext object as parameter to flink operators? I understand I need to serialize this object.Is there any existing serialization mechanism that I can use? 

Thanks in advance.

--

[Swapnil Dharane]

Hello Gordon,

Thanks for the reply.

I do have an alternative to share BasicDataSource(from apache commons dbcp library) Object. I thought that it might be best if we leave db connection pooling outside of the actual business flow so I confiured it as a spring bean. With this way , only one class can deal with Spring context loading. However, just like ApplicationContext, It is not serializable . 

Do you think that I should serialize  BasicDataSource  object and share it across flink operators as needed ? If that is the case, then I should either use an existing custom serializer or write one myself. 

Thanks in advance ,

On Sun, Feb 11, 2018 at 10:09 PM, Gordon Weakliem <[hidden email]> wrote:

The WHOLE Spring ApplicationContext? This sounds like a bad idea. Most of that stuff isn't applicable outside a Spring application. Can't you cut it down to a smaller subset that your Flink app actually needs?

On Fri, Feb 9, 2018 at 9:15 PM, Swapnil Dharane <[hidden email]> wrote:

Hello,

Is there any way with which I can pass my spring ApplicationContext object as parameter to flink operators? I understand I need to serialize this object.Is there any existing serialization mechanism that I can use? 

Thanks in advance.

--

[Gordon Weakliem]

I don't understand your execution model - do you have a Spring app that launches Flink embedded? What container is running the Flink application?

On Sun, Feb 11, 2018 at 9:44 PM, Swapnil Dharane <[hidden email]> wrote:

Hello Gordon,

Thanks for the reply.

I do have an alternative to share BasicDataSource(from apache commons dbcp library) Object. I thought that it might be best if we leave db connection pooling outside of the actual business flow so I confiured it as a spring bean. With this way , only one class can deal with Spring context loading. However, just like ApplicationContext, It is not serializable . 

Do you think that I should serialize  BasicDataSource  object and share it across flink operators as needed ? If that is the case, then I should either use an existing custom serializer or write one myself. 

Thanks in advance ,

On Sun, Feb 11, 2018 at 10:09 PM, Gordon Weakliem <[hidden email]> wrote:

The WHOLE Spring ApplicationContext? This sounds like a bad idea. Most of that stuff isn't applicable outside a Spring application. Can't you cut it down to a smaller subset that your Flink app actually needs?

On Fri, Feb 9, 2018 at 9:15 PM, Swapnil Dharane <[hidden email]> wrote:

Hello,

Is there any way with which I can pass my spring ApplicationContext object as parameter to flink operators? I understand I need to serialize this object.Is there any existing serialization mechanism that I can use? 

Thanks in advance.

--

--