flink sql-client read hive orc table no result

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

flink sql-client read hive orc table no result

wanglei2@geekplus.com.cn
Hive table store as orc format: 
 CREATE  TABLE `robot_tr`(`robot_id` int,  `robot_time` bigint, `linear_velocity` double, `track_side_error` int) 
 partitioned by (warehouseid STRING) clustered by (robot_id) into 3 buckets 
 stored as orc tblproperties("transactional"='true');

Under hive client,  insert into one record and then select there will be the result to the console.

But under flink sql-client, when select * from  robot_tr, there's no result? 

Any insight on this?

Thanks,
Lei 


Reply | Threaded
Open this post in threaded view
|

Re: flink sql-client read hive orc table no result

Kurt Young
My guess is we haven't support hive bucket table yet.
cc Rui Li for confirmation.

Best,
Kurt


On Wed, Mar 18, 2020 at 5:19 PM [hidden email] <[hidden email]> wrote:
Hive table store as orc format: 
 CREATE  TABLE `robot_tr`(`robot_id` int,  `robot_time` bigint, `linear_velocity` double, `track_side_error` int) 
 partitioned by (warehouseid STRING) clustered by (robot_id) into 3 buckets 
 stored as orc tblproperties("transactional"='true');

Under hive client,  insert into one record and then select there will be the result to the console.

But under flink sql-client, when select * from  robot_tr, there's no result? 

Any insight on this?

Thanks,
Lei 


Reply | Threaded
Open this post in threaded view
|

Re: Re: flink sql-client read hive orc table no result

wanglei2@geekplus.com.cn

Tried again. Even i  remove the "clustered by (robot_id) into 3 buckets"  statement, no result from flink sql-client

Thanks,
Lei 


Date: 2020-03-18 17:41
Subject: Re: flink sql-client read hive orc table no result
My guess is we haven't support hive bucket table yet.
cc Rui Li for confirmation.

Best,
Kurt


On Wed, Mar 18, 2020 at 5:19 PM [hidden email] <[hidden email]> wrote:
Hive table store as orc format: 
 CREATE  TABLE `robot_tr`(`robot_id` int,  `robot_time` bigint, `linear_velocity` double, `track_side_error` int) 
 partitioned by (warehouseid STRING) clustered by (robot_id) into 3 buckets 
 stored as orc tblproperties("transactional"='true');

Under hive client,  insert into one record and then select there will be the result to the console.

But under flink sql-client, when select * from  robot_tr, there's no result? 

Any insight on this?

Thanks,
Lei 


Reply | Threaded
Open this post in threaded view
|

Re: Re: flink sql-client read hive orc table no result

Kurt Young
also try to remove "transactional"='true'?

Best,
Kurt


On Wed, Mar 18, 2020 at 5:54 PM [hidden email] <[hidden email]> wrote:

Tried again. Even i  remove the "clustered by (robot_id) into 3 buckets"  statement, no result from flink sql-client

Thanks,
Lei 


Date: 2020-03-18 17:41
Subject: Re: flink sql-client read hive orc table no result
My guess is we haven't support hive bucket table yet.
cc Rui Li for confirmation.

Best,
Kurt


On Wed, Mar 18, 2020 at 5:19 PM [hidden email] <[hidden email]> wrote:
Hive table store as orc format: 
 CREATE  TABLE `robot_tr`(`robot_id` int,  `robot_time` bigint, `linear_velocity` double, `track_side_error` int) 
 partitioned by (warehouseid STRING) clustered by (robot_id) into 3 buckets 
 stored as orc tblproperties("transactional"='true');

Under hive client,  insert into one record and then select there will be the result to the console.

But under flink sql-client, when select * from  robot_tr, there's no result? 

Any insight on this?

Thanks,
Lei 


Reply | Threaded
Open this post in threaded view
|

Re: Re: flink sql-client read hive orc table no result

wanglei2@geekplus.com.cn

Seems the root cause is  "transactional"='true'. 
After remove this,the table can be queryed from flink sql-client,even i add  "clustered by (robot_id) into 3 buckets" again.

Thanks,
Lei

 
Date: 2020-03-18 18:04
Subject: Re: Re: flink sql-client read hive orc table no result
also try to remove "transactional"='true'?

Best,
Kurt


On Wed, Mar 18, 2020 at 5:54 PM [hidden email] <[hidden email]> wrote:

Tried again. Even i  remove the "clustered by (robot_id) into 3 buckets"  statement, no result from flink sql-client

Thanks,
Lei 


Date: 2020-03-18 17:41
Subject: Re: flink sql-client read hive orc table no result
My guess is we haven't support hive bucket table yet.
cc Rui Li for confirmation.

Best,
Kurt


On Wed, Mar 18, 2020 at 5:19 PM [hidden email] <[hidden email]> wrote:
Hive table store as orc format: 
 CREATE  TABLE `robot_tr`(`robot_id` int,  `robot_time` bigint, `linear_velocity` double, `track_side_error` int) 
 partitioned by (warehouseid STRING) clustered by (robot_id) into 3 buckets 
 stored as orc tblproperties("transactional"='true');

Under hive client,  insert into one record and then select there will be the result to the console.

But under flink sql-client, when select * from  robot_tr, there's no result? 

Any insight on this?

Thanks,
Lei