Re: CKAN inputFormat (batch)

Posted by vino yang on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/CKAN-inputFormat-batch-tp24900p24909.html

Hi Flavio,

I can not open the first link[1] you provided.

And what is your purpose? Introduce your CKAN input format to the community?

Thanks, vino.

[1]: https://ckan.org/about/instances/

Flavio Pompermaier <[hidden email]> 于2018年12月4日周二 上午1:09写道：

Hi to all,
we've just published an example of a simple CKAN input format that downloads a CKAN resource (in parallel) from a CKAN catalog and produce a DataSet<Row>.
This can be very helpful in setting up a Flink demo using an OpenData dataset available online (see [1] for a list of available catalogs).

An example of its usage can be found here: [2].

Best,
Flavio

[1] https://ckan.org/about/instances/

[2] https://github.com/okkam-it/flink-examples/blob/master/src/main/java/it/okkam/flink/CkanDatasetImporter.java