AWS S3 and Reshift

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

AWS S3 and Reshift

sunny patel
Hi Guys,

We are in the process of creating Proof of concept., 
I am looking for the sample project - Flink scala or java which can load data from database to database or 
CSV to relational database(any).


CSV ----------> S3  ----------> AWS Redshift

could you please some one advise me on that..

Cheers
sunny
Reply | Threaded
Open this post in threaded view
|

Re: AWS S3 and Reshift

Maximilian Michels
I think there have been multiple threads like this one.

Please see the thread "Flink scala or Java - Dataload from CSV to database"

On Wed, Oct 5, 2016 at 8:15 AM, sunny patel <[hidden email]> wrote:

> Hi Guys,
>
> We are in the process of creating Proof of concept.,
> I am looking for the sample project - Flink scala or java which can load
> data from database to database or
> CSV to relational database(any).
>
>
> CSV ----------> S3  ----------> AWS Redshift
>
> could you please some one advise me on that..
>
> Cheers
> sunny
Reply | Threaded
Open this post in threaded view
|

Re: AWS S3 and Reshift

sunny patel

 I have check the forum; I couldn’t find the stuffs that i am looking for long time on how to write the data from CSV to database in fink Scala.

 

I have tried the Rich/sink function it appears not working

Literally we are anticipating for the code how to sink the data into database or any supported rich function.

 

I hope you guys can help me on that..thanks

 


On Thu, Oct 6, 2016 at 9:56 AM, Maximilian Michels <[hidden email]> wrote:
I think there have been multiple threads like this one.

Please see the thread "Flink scala or Java - Dataload from CSV to database"

On Wed, Oct 5, 2016 at 8:15 AM, sunny patel <[hidden email]> wrote:
> Hi Guys,
>
> We are in the process of creating Proof of concept.,
> I am looking for the sample project - Flink scala or java which can load
> data from database to database or
> CSV to relational database(any).
>
>
> CSV ----------> S3  ----------> AWS Redshift
>
> could you please some one advise me on that..
>
> Cheers
> sunny

Reply | Threaded
Open this post in threaded view
|

Re: AWS S3 and Reshift

Maximilian Michels
Flink has built-in CSV support. Please check the documentation. There
is not Redshift connector in Flink. You will have to use JDBC or
create your own connector.

-Max


On Thu, Oct 6, 2016 at 11:14 AM, sunny patel <[hidden email]> wrote:

>  I have check the forum; I couldn’t find the stuffs that i am looking for
> long time on how to write the data from CSV to database in fink Scala.
>
>
>
> I have tried the Rich/sink function it appears not working
>
> Literally we are anticipating for the code how to sink the data into
> database or any supported rich function.
>
>
>
> I hope you guys can help me on that..thanks
>
>
>
>
> On Thu, Oct 6, 2016 at 9:56 AM, Maximilian Michels <[hidden email]> wrote:
>>
>> I think there have been multiple threads like this one.
>>
>> Please see the thread "Flink scala or Java - Dataload from CSV to
>> database"
>>
>> On Wed, Oct 5, 2016 at 8:15 AM, sunny patel <[hidden email]> wrote:
>> > Hi Guys,
>> >
>> > We are in the process of creating Proof of concept.,
>> > I am looking for the sample project - Flink scala or java which can load
>> > data from database to database or
>> > CSV to relational database(any).
>> >
>> >
>> > CSV ----------> S3  ----------> AWS Redshift
>> >
>> > could you please some one advise me on that..
>> >
>> > Cheers
>> > sunny
>
>