some slots are not be available,when job is not running

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

some slots are not be available,when job is not running

pengchenglin@bonc.com.cn
Hi all,
some slots are not be available,when job is not running.
I get TM dump when job is not running,and analysis it with Eclipse Memory AnalyzerHere are some of the results which look useful:

  • <a href="mat://object/0x7f94420000c8" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f94420000c8
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f5, O_COMMENT) -> time attribute: (OVER_TIME) (2/8)2721,281,344org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f9442000000true
  • <a href="mat://object/0x7f9442f5a630" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f9442f5a630
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) (2/8)2721,274,312org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f9442f5a268true
  • <a href="mat://object/0x7f94f4f048a8" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f94f4f048a8
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (2/8)2721,274,184org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
  • <a href="mat://object/0x7f94441a1aa8" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f94441a1aa8
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, CEIL(MOD(O_CUSTKEY, EXTRACT(FLAG(MONTH), O_ORDERDATE))) AS $f4, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f6, O_COMMENT) (2/8)2721,263,416org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94441a1a00true
  • <a href="mat://object/0x7f91de001b78" style="text-decoration: none !important;">org.apache.kafka.common.utils.KafkaThread @ 0x7f91de001b78 »
kafka-producer-network-thread | producer-1184342,912org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91de000040true
  • <a href="mat://object/0x7f947a57d290" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a57d290
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_COMMENT, OVER_TIME) (1/8)272243,512org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a57c6d0true
  • <a href="mat://object/0x7f91e0da4c40" style="text-decoration: none !important;">akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread @ 0x7f91e0da4c40 »
flink-akka.remote.default-remote-dispatcher-23192143,160sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
  • <a href="mat://object/0x7f91bd044988" style="text-decoration: none !important;">akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread @ 0x7f91bd044988 »
flink-akka.remote.default-remote-dispatcher-38192142,712sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
  • <a href="mat://object/0x7f9233003d98" style="text-decoration: none !important;">akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread @ 0x7f9233003d98 »
flink-akka.remote.default-remote-dispatcher-19192133,624sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
  • <a href="mat://object/0x7f947a5c68c0" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a5c68c0
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<>(O_CLERK, _UTF-16LE'Clerk#000010377')), select: (O_CUSTKEY, O_ORDERSTATUS, O_ORDERPRIORITY, O_SHIPPRIORITY, CAST(O_ORDERKEY_INT) AS O_ORDERKEY_INT0) (6/8)272125,144org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a57c6d0true
  • <a href="mat://object/0x7f91bca9ae08" style="text-decoration: none !important;">akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread @ 0x7f91bca9ae08 »
flink-akka.remote.default-remote-dispatcher-6192124,856sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
  • <a href="mat://object/0x7f9442002288" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f9442002288
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f5, O_COMMENT) -> time attribute: (OVER_TIME) (3/8)272124,808org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94420079d8true
  • <a href="mat://object/0x7f91ec800568" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f91ec800568
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (1/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
  • <a href="mat://object/0x7f91e47ffff8" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f91e47ffff8
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (4/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
  • <a href="mat://object/0x7f91e4000000" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f91e4000000
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (6/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
  • <a href="mat://object/0x7f91ec000158" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f91ec000158
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (5/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91ec000000true
  • <a href="mat://object/0x7f94f5147840" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f94f5147840
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (8/8)272124,792org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
  • <a href="mat://object/0x7f94f5037268" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f94f5037268
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (6/8)272124,792org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
  • <a href="mat://object/0x7f947a5fea38" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a5fea38
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (4/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
  • <a href="mat://object/0x7f947a5c6f20" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a5c6f20
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (5/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
  • <a href="mat://object/0x7f947a57d4e0" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a57d4e0
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (6/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
  • <a href="mat://object/0x7f947a5f8ea8" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f947a5f8ea8
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (LIKE(O_ORDERPRIORITY, _UTF-16LE'%I%')), select: (O_ORDERKEY_DOUBLE, O_ORDERSTATUS, O_ORDERPRIORITY, O_CUSTKEY, OVER_TIME) (1/8)272124,328org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a571878true
  • <a href="mat://object/0x7f93fa000540" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f93fa000540
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (4/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
  • <a href="mat://object/0x7f93fa0002a0" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f93fa0002a0
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (5/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
  • <a href="mat://object/0x7f93fa000000" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f93fa000000
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (2/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
  • <a href="mat://object/0x7f91e0be5598" style="text-decoration: none !important;">org.apache.flink.streaming.connectors.kafka.internal.KafkaConsumerThread @ 0x7f91e0be5598
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Map -> where: (LIKE(C1, _UTF-16LE'22%')), select: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10) -> to: Row -> Map -> Sink: cirrostream_yy_job_38 (5/8)272121,232org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f987777d010true
  • <a href="mat://object/0x7f91bd02dd20" style="text-decoration: none !important;">akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread @ 0x7f91bd02dd20 »
flink-akka.remote.default-remote-dispatcher-50192115,720sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
  • <a href="mat://object/0x7f922c650cd8" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f922c650cd8 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f922a650a20" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f922a650a20 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f9227000540" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f9227000540 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f91c1001628" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f91c1001628 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f91bd04a4d8" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f91bd04a4d8 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f91eb000200" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f91eb000200 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200110,848sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f91bd039360" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f91bd039360 »
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200110,848sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
  • <a href="mat://object/0x7f91f84e9938" style="text-decoration: none !important;">sourcesink.kafka.consumer09.KafkaConsumerThread @ 0x7f91f84e9938
Kafka 0.9 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, CIRROSTREAM_YY_SINK_37) -> select: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20) -> to: Row -> Map -> Sink: cirrostream_yy_job_37_6 (8/8)272106,120org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91f8518d70true
  • <a href="mat://object/0x7f922c650b10" style="text-decoration: none !important;">org.apache.flink.streaming.runtime.io.StreamRecordWriter$OutputFlusher @ 0x7f922c650b10 »
OutputFlusher for Source: Custom Source -> Map -> Filter -> Map -> from: (\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211, ABC) -> where: (LIKE(\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211, _UTF-16LE'%117111')), select: (\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211) -> to: Row200103,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true





Reply | Threaded
Open this post in threaded view
|

Re: some slots are not be available,when job is not running

Xintong Song
Hi,

It would be good if you can provide the job manager and task manager log files, so that others can analysis the problem?

Thank you~

Xintong Song



On Mon, Aug 12, 2019 at 10:12 AM [hidden email] <[hidden email]> wrote:
Hi all,
some slots are not be available,when job is not running.
I get TM dump when job is not running,and analysis it with Eclipse Memory AnalyzerHere are some of the results which look useful:

Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f5, O_COMMENT) -> time attribute: (OVER_TIME) (2/8)2721,281,344org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f9442000000true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) (2/8)2721,274,312org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f9442f5a268true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (2/8)2721,274,184org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, CEIL(MOD(O_CUSTKEY, EXTRACT(FLAG(MONTH), O_ORDERDATE))) AS $f4, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f6, O_COMMENT) (2/8)2721,263,416org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94441a1a00true
kafka-producer-network-thread | producer-1184342,912org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91de000040true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_COMMENT, OVER_TIME) (1/8)272243,512org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a57c6d0true
flink-akka.remote.default-remote-dispatcher-23192143,160sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
flink-akka.remote.default-remote-dispatcher-38192142,712sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
flink-akka.remote.default-remote-dispatcher-19192133,624sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<>(O_CLERK, _UTF-16LE'Clerk#000010377')), select: (O_CUSTKEY, O_ORDERSTATUS, O_ORDERPRIORITY, O_SHIPPRIORITY, CAST(O_ORDERKEY_INT) AS O_ORDERKEY_INT0) (6/8)272125,144org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a57c6d0true
flink-akka.remote.default-remote-dispatcher-6192124,856sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'%M%'), <=(O_CLERK, _UTF-16LE'Clerk#000000144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'), =(O_ORDERSTATUS, _UTF-16LE'O'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'O') AS O_ORDERSTATUS, O_ORDERPRIORITY, OVER_TIME, EXTRACT(FLAG(MONTH), O_DATE) AS $f5, O_COMMENT) -> time attribute: (OVER_TIME) (3/8)272124,808org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94420079d8true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (1/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (4/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (6/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94eb800008true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(LIKE(O_ORDERPRIORITY, _UTF-16LE'3%'), =(O_ORDERSTATUS, _UTF-16LE'F'), <=(O_CLERK, _UTF-16LE'Clerk#000006144'), >=(O_CLERK, _UTF-16LE'Clerk#000000048'))), select: (O_CLERK, O_ORDERDATE, CAST(_UTF-16LE'F') AS O_ORDERSTATUS, OVER_TIME, EXTRACT(FLAG(MONTH), O_ORDERDATE) AS $f4, O_COMMENT, O_CUSTKEY) -> time attribute: (OVER_TIME) (5/8)272124,800org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91ec000000true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (8/8)272124,792org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (AND(IN(TRIM(FLAG(BOTH), _UTF-16LE' ', O_ORDERPRIORITY), _UTF-16LE'1-URGENT', _UTF-16LE'3-MEDIUM', _UTF-16LE'5-LOW'), >=(O_CLERK, _UTF-16LE'Clerk#000024400'), >(EXTRACT(FLAG(MONTH), O_ORDERDATE), 6), <>(O_ORDERSTATUS, _UTF-16LE'O'), <=(O_ORDERKEY_INT, 12889))), select: (O_ORDERKEY_INT, O_CUSTKEY, O_ORDERSTATUS, O_ORDERDATE, O_CLERK, O_DATE, OVER_TIME) (6/8)272124,792org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f94f4f04800true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (4/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (5/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (<=(O_ORDERKEY_INT, 188)), select: (O_ORDERKEY_INT AS A, O_ORDERKEY_LONG AS \u6c49\u5b57, O_CUSTKEY AS _AS, O_CLERK AS FRV, O_ORDERPRIORITY AS AHG, O_DATE AS SH567_7FGH\u54c8\u89e3\u6563_SH567_8FGH\u54c8\u89e3\u6563_SH567_9FGH\u54c8\u89e3\u6563_SH567_0FGH\u54c8\u89e3\u6563_SH567_1FGH\u54c8\u89e3\u6563_S) -> to: Row -> Map -> Sink: b26f1aec-47d2-4d4c-a9f2-fc1b10ae14be (6/8)272124,656org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a675c80true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (ORD_ID, O_ORDERKEY_INT, O_ORDERKEY_VARCHAR, O_ORDERKEY_LONG, O_ORDERKEY_DOUBLE, O_CUSTKEY, O_ORDERSTATUS, O_TOTALPRICE, O_ORDERDATE, O_ORDERPRIORITY, O_CLERK, O_SHIPPRIORITY, O_COMMENT, O_TIMESTAMP1, O_TIMESTAMP2, O_DATE, O_TIMESTAMP, O_DATE_EVENT, O_TIMESTAMP_EVENT, OVER_TIME) -> where: (LIKE(O_ORDERPRIORITY, _UTF-16LE'%I%')), select: (O_ORDERKEY_DOUBLE, O_ORDERSTATUS, O_ORDERPRIORITY, O_CUSTKEY, OVER_TIME) (1/8)272124,328org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f947a571878true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (4/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (5/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Timestamps/Watermarks -> from: (ORD_ID, PS_PARTKEY, PS_SUPPKEY, PS_AVAILQTY, PS_SUPPLYCOST, PS_COMMENT, PS_INT, PS_LONG, PS_DOUBLE8, PS_DOUBLE14, PS_DOUBLE15, PS_NUMBER1, PS_NUMBER2, PS_NUMBER3, PS_NUMBER4, PS_DATE, PS_TIMESTAMP, PS_DATE_EVENT, PS_TIMESTAMP_EVENT, OVER_TIME) -> select: (PS_PARTKEY, PS_SUPPKEY, PS_COMMENT, CAST(PS_PARTKEY) AS PS_PARTKEY0) (2/8)272124,208org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f93f98210f8true
Kafka 0.10 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> Map -> where: (LIKE(C1, _UTF-16LE'22%')), select: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10) -> to: Row -> Map -> Sink: cirrostream_yy_job_38 (5/8)272121,232org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f987777d010true
flink-akka.remote.default-remote-dispatcher-50192115,720sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0false
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200111,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200110,848sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
OutputFlusher for Map -> Filter -> Map -> Map -> where: (AND(>=(_C2, 50), <=(_C2, 60))), select: (_C1, _C2, _C3, _C4, _C5, _C6, _C7, _C8, _C9, _C10, _C11, _C12, _C13, _C14, _C15) -> to: Row200110,848sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true
Kafka 0.9 Fetcher for Source: Custom Source -> Map -> Filter -> Map -> from: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20, CIRROSTREAM_YY_SINK_37) -> select: (C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16, C17, C18, C19, C20) -> to: Row -> Map -> Sink: cirrostream_yy_job_37_6 (8/8)272106,120org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader @ 0x7f91f8518d70true
OutputFlusher for Source: Custom Source -> Map -> Filter -> Map -> from: (\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211, ABC) -> where: (LIKE(\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211, _UTF-16LE'%117111')), select: (\u6bd4__DH\u5b8c\u8d5bBUGJIBHBKAA\u4f60\u597dISDUIAAASDHUAHSH\u4e0d\u662fFFR\u6211\u7684\u54271232AA___AAAASWID___HAHAHAHA\u8c01\u53eb\u6211) -> to: Row200103,048sun.misc.Launcher$AppClassLoader @ 0x7f91bc253cb0true