(DEPRECATED) Apache Flink User Mailing List archive.

question

classic Classic list List threaded Threaded
♦
♦
 5 messages Options
圣眼之翼
Reply | Threaded
Open this post in threaded view
♦
♦
|

question

圣眼之翼
How do you do:
My problem is flink table format and table schema mapping.
The input data is similar to the following json format：
{ "id": "123", "serial": "6b0c2d26", "msg": { "f1": "5677" } } The format code for TableSource is as follows: new Json().schema(Types.ROW(new String[] { "id", "serial", "msg" }, new TypeInformation << ? > [] { Types.STRING(), Types.STRING(), Types.ROW(new String[] { "f1" }, new TypeInformation << ? > [] { Types.STRING() }) }));

The schema part of TableSource is as follows:
Schema schema = new Schema(); schema.field("id", Types.STRING()); schema.field("serial", Types.STRING());

I don't know how to define the f1 field of msg in the schema. I tried schema.field("f1", Types.STRING()) before; but I will report an error. What is the correct method?
The following SQL can be run correctly:
select id,serial,f1 from table;

My flink version is 1.8.1,use flink table & SQL API

thanks;
JingsongLee
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re:question

JingsongLee
should be schema.field(“msg”, Types.ROW(...))?
And you should select msg.f1 from table.

Best
Jingsong Lee




------------------Original Mail ------------------
From:圣眼之翼 <[hidden email]>
Date:2019-09-03 09:22:41
Recipient:user <[hidden email]>
Subject:question
How do you do:
My problem is flink table format and table schema mapping.
The input data is similar to the following json format：
{ "id": "123", "serial": "6b0c2d26", "msg": { "f1": "5677" } } The format code for TableSource is as follows: new Json().schema(Types.ROW(new String[] { "id", "serial", "msg" }, new TypeInformation << ? > [] { Types.STRING(), Types.STRING(), Types.ROW(new String[] { "f1" }, new TypeInformation << ? > [] { Types.STRING() }) }));

The schema part of TableSource is as follows:
Schema schema = new Schema(); schema.field("id", Types.STRING()); schema.field("serial", Types.STRING());

I don't know how to define the f1 field of msg in the schema. I tried schema.field("f1", Types.STRING()) before; but I will report an error. What is the correct method?
The following SQL can be run correctly:
select id,serial,f1 from table;

My flink version is 1.8.1,use flink table & SQL API

thanks;
圣眼之翼
Reply | Threaded
Open this post in threaded view
♦
♦
|

回复：question

圣眼之翼
thank you！
Let me try。

------------------ 原始邮件 ------------------
发件人: "JingsongLee"<[hidden email]>;
发送时间: 2019年9月3日(星期二) 晚上7:53
收件人: "圣眼之翼"<[hidden email]>;"user"<[hidden email]>;
主题: Re:question

should be schema.field(“msg”, Types.ROW(...))?
And you should select msg.f1 from table.

Best
Jingsong Lee




------------------Original Mail ------------------
From:圣眼之翼 <[hidden email]>
Date:2019-09-03 09:22:41
Recipient:user <[hidden email]>
Subject:question
How do you do:
My problem is flink table format and table schema mapping.
The input data is similar to the following json format：
{ "id": "123", "serial": "6b0c2d26", "msg": { "f1": "5677" } } The format code for TableSource is as follows: new Json().schema(Types.ROW(new String[] { "id", "serial", "msg" }, new TypeInformation << ? > [] { Types.STRING(), Types.STRING(), Types.ROW(new String[] { "f1" }, new TypeInformation << ? > [] { Types.STRING() }) }));

The schema part of TableSource is as follows:
Schema schema = new Schema(); schema.field("id", Types.STRING()); schema.field("serial", Types.STRING());

I don't know how to define the f1 field of msg in the schema. I tried schema.field("f1", Types.STRING()) before; but I will report an error. What is the correct method?
The following SQL can be run correctly:
select id,serial,f1 from table;

My flink version is 1.8.1,use flink table & SQL API

thanks;
圣眼之翼
Reply | Threaded
Open this post in threaded view
♦
♦
|

回复：question

圣眼之翼
I want to output the query results to kafka, json format is as follows：
{
 "id": "123",
 "serial": "6b0c2d26",
 "msg": {
  "f1": "5677"
 }
}
How to define the format and schema of kafka sink？
thanks!

------------------ 原始邮件 ------------------
发件人: "圣眼之翼"<[hidden email]>;
发送时间: 2019年9月3日(星期二) 晚上8:18
收件人: "JingsongLee"<[hidden email]>;"user"<[hidden email]>;
主题: 回复：question

thank you！
Let me try。

------------------ 原始邮件 ------------------
发件人: "JingsongLee"<[hidden email]>;
发送时间: 2019年9月3日(星期二) 晚上7:53
收件人: "圣眼之翼"<[hidden email]>;"user"<[hidden email]>;
主题: Re:question

should be schema.field(“msg”, Types.ROW(...))?
And you should select msg.f1 from table.

Best
Jingsong Lee




------------------Original Mail ------------------
From:圣眼之翼 <[hidden email]>
Date:2019-09-03 09:22:41
Recipient:user <[hidden email]>
Subject:question
How do you do:
My problem is flink table format and table schema mapping.
The input data is similar to the following json format：
{ "id": "123", "serial": "6b0c2d26", "msg": { "f1": "5677" } } The format code for TableSource is as follows: new Json().schema(Types.ROW(new String[] { "id", "serial", "msg" }, new TypeInformation << ? > [] { Types.STRING(), Types.STRING(), Types.ROW(new String[] { "f1" }, new TypeInformation << ? > [] { Types.STRING() }) }));

The schema part of TableSource is as follows:
Schema schema = new Schema(); schema.field("id", Types.STRING()); schema.field("serial", Types.STRING());

I don't know how to define the f1 field of msg in the schema. I tried schema.field("f1", Types.STRING()) before; but I will report an error. What is the correct method?
The following SQL can be run correctly:
select id,serial,f1 from table;

My flink version is 1.8.1,use flink table & SQL API

thanks;
圣眼之翼
Reply | Threaded
Open this post in threaded view
♦
♦
|

回复：question

圣眼之翼
I have found a way，
select row(msg.f1) from table.

------------------ 原始邮件 ------------------
发件人: "圣眼之翼"<[hidden email]>;
发送时间: 2019年9月4日(星期三) 上午10:57
收件人: "圣眼之翼"<[hidden email]>;"JingsongLee"<[hidden email]>;"user"<[hidden email]>;
主题: 回复：question

I want to output the query results to kafka, json format is as follows：
{
 "id": "123",
 "serial": "6b0c2d26",
 "msg": {
  "f1": "5677"
 }
}
How to define the format and schema of kafka sink？
thanks!

------------------ 原始邮件 ------------------
发件人: "圣眼之翼"<[hidden email]>;
发送时间: 2019年9月3日(星期二) 晚上8:18
收件人: "JingsongLee"<[hidden email]>;"user"<[hidden email]>;
主题: 回复：question

thank you！
Let me try。

------------------ 原始邮件 ------------------
发件人: "JingsongLee"<[hidden email]>;
发送时间: 2019年9月3日(星期二) 晚上7:53
收件人: "圣眼之翼"<[hidden email]>;"user"<[hidden email]>;
主题: Re:question

should be schema.field(“msg”, Types.ROW(...))?
And you should select msg.f1 from table.

Best
Jingsong Lee




------------------Original Mail ------------------
From:圣眼之翼 <[hidden email]>
Date:2019-09-03 09:22:41
Recipient:user <[hidden email]>
Subject:question
How do you do:
My problem is flink table format and table schema mapping.
The input data is similar to the following json format：
{ "id": "123", "serial": "6b0c2d26", "msg": { "f1": "5677" } } The format code for TableSource is as follows: new Json().schema(Types.ROW(new String[] { "id", "serial", "msg" }, new TypeInformation << ? > [] { Types.STRING(), Types.STRING(), Types.ROW(new String[] { "f1" }, new TypeInformation << ? > [] { Types.STRING() }) }));

The schema part of TableSource is as follows:
Schema schema = new Schema(); schema.field("id", Types.STRING()); schema.field("serial", Types.STRING());

I don't know how to define the f1 field of msg in the schema. I tried schema.field("f1", Types.STRING()) before; but I will report an error. What is the correct method?
The following SQL can be run correctly:
select id,serial,f1 from table;

My flink version is 1.8.1,use flink table & SQL API

thanks;
Free forum by Nabble Edit this page