Is that possible to specify join algorithm hint in Flink SQL

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Is that possible to specify join algorithm hint in Flink SQL

yinhua.dai
Hi team,

I know we can specify the join algorithm hint with dataset API
https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/batch/dataset_transformations.html#join-algorithm-hints

But wondering if this is possible to support with the SQL API?
We have market data with a currency id(a big data set), and we tried to join
a very small data set(currency id to currency name conversion) to get the
name, but it always very slow because of data skew(most of currency is USD).

Seems flink didn't choose the broadcast forward ship strategy, so I'm
wondering whether we can provide a hint for it, or how can I solve the
problem?

Thanks.



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/