HadoopInputFormat

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

HadoopInputFormat

Dominik Wosiński
Hey,
I wanted to ask if the HadoopInputFormat does currently support some custom partitioning scheme ? Say I have 200 files in HDFS each having the partitioning key in name, can we ATM use HadoopInputFormat to distribute reading to multiple TaskManagers using the key ??


Best Regards,
Dom.