Re: Illegal State in Bulk Iteration

Posted by Stephan Ewen on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Illegal-State-in-Bulk-Iteration-tp492p552.html

Hi Maximilian!

I have pushed a fix for bug you encountered in the current master. It way a tricky corner case, you are stressing the compiler quite a bit ;-)

Attached is a JSON dump of your program's plan. If you want to see what it looks like, paste it to the plan visualizer. It is huge !

Here are links to some screenshots:

 - https://dl.dropboxusercontent.com/u/109654984/screenshot1.png

 - https://dl.dropboxusercontent.com/u/109654984/screenshot2.png

 - https://dl.dropboxusercontent.com/u/109654984/screenshot3.png

 - https://dl.dropboxusercontent.com/u/109654984/screenshot4.png

 - https://dl.dropboxusercontent.com/u/109654984/screenshot5.png

Greetings,

Stephan

--------------

{

"nodes": [

{

"id": 8,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47) (org.apache.flink.api.java.io.TextInputFormat)",

"parallelism": "8",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "4.29 K" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "4.29 K" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "4.29 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 7,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)",

"parallelism": "8",

"predecessors": [

{"id": 8, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "4.29 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 6,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:48)",

"parallelism": "8",

"predecessors": [

{"id": 7, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "2.15 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 14,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:73) (org.apache.flink.api.java.io.CollectionInputFormat)",

"parallelism": "1",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 16,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:74) (org.apache.flink.api.java.io.CollectionInputFormat)",

"parallelism": "1",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 19,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49)",

"parallelism": "8",

"predecessors": [

{"id": 7, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "2.15 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 18,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]", "temp_mode": "PIPELINE_BREAKER"},

{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 17,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 18, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 15,

"type": "pact",

"pact": "Union",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 16, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 17, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"step_function": [

{

"id": 23,

"type": "pact",

"pact": "Workset",

"contents": "Workset Place Holder",

"parallelism": "8",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 22,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:83)",

"parallelism": "8",

"predecessors": [

{"id": 23, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 26,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:80)",

"parallelism": "8",

"predecessors": [

{"id": 23, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 28,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:77)",

"parallelism": "8",

"predecessors": [

{"id": 23, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 27,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",

"parallelism": "8",

"predecessors": [

{"id": 28, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 25,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 26, "side": "first", "ship_strategy": "Forward", "temp_mode": "PIPELINE_BREAKER"},

{"id": 27, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.VectorDataSet$.neutralize(util.scala:389))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 24,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.add(util.scala:346)",

"parallelism": "8",

"predecessors": [

{"id": 25, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 21,

"type": "pact",

"pact": "Union",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 22, "side": "first", "ship_strategy": "Forward"},

{"id": 24, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 20,

"type": "pact",

"pact": "No Op",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 21, "ship_strategy": "Forward"}

],

"driver_strategy": "No-Op",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 30,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:84)",

"parallelism": "8",

"predecessors": [

{"id": 24, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 29,

"type": "pact",

"pact": "Solution-Set Delta",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 30, "ship_strategy": "Hash Partition on [0]", "temp_mode": "PIPELINE_BREAKER"}

],

"driver_strategy": "No-Op",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

}

],

"workset": 23,

"solution_set": null,

"next_workset": 20,

"solution_delta": 29,

"id": 13,

"type": "workset_iteration",

"pact": "Workset Iteration",

"contents": "Unnamed Delta Iteration",

"parallelism": "8",

"predecessors": [

{"id": 14, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 15, "side": "second", "ship_strategy": "Forward"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 34,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 17, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 33,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 34, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 38,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50) (org.apache.flink.api.java.io.TextInputFormat)",

"parallelism": "8",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "1.50 K" },

{ "name": "Est. Cardinality", "value": "30.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "1.50 K" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "1.50 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 37,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)",

"parallelism": "8",

"predecessors": [

{"id": 38, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "30.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "1.50 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 36,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:71)",

"parallelism": "8",

"predecessors": [

{"id": 37, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "15.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "1.50 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 35,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",

"parallelism": "8",

"predecessors": [

{"id": 36, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "15.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "1.50 K" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 32,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 33, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 35, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.VectorDataSet$.neutralize(util.scala:389))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 31,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 32, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 12,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:90)",

"parallelism": "8",

"predecessors": [

{"id": 13, "side": "first", "ship_strategy": "Forward"},

{"id": 31, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 11,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:96)",

"parallelism": "8",

"predecessors": [

{"id": 12, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 10,

"type": "pact",

"pact": "GroupReduce",

"contents": "SUM(0)",

"parallelism": "8",

"predecessors": [

{"id": 11, "ship_strategy": "Forward"}

],

"driver_strategy": "Group Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 9,

"type": "pact",

"pact": "GroupReduce",

"contents": "SUM(0)",

"parallelism": "1",

"predecessors": [

{"id": 10, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Group Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 5,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:98)",

"parallelism": "8",

"predecessors": [

{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode": "PIPELINE_BREAKER"},

{"id": 9, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "50.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 4,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",

"parallelism": "8",

"predecessors": [

{"id": 5, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "50.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 3,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:62)",

"parallelism": "8",

"predecessors": [

{"id": 4, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "50.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 45,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181) (org.apache.flink.api.java.io.CollectionInputFormat)",

"parallelism": "1",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 44,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)",

"parallelism": "1",

"predecessors": [

{"id": 45, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 47,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182) (org.apache.flink.api.java.io.CollectionInputFormat)",

"parallelism": "1",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 46,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)",

"parallelism": "1",

"predecessors": [

{"id": 47, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 49,

"type": "source",

"pact": "Data Source",

"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183) (org.apache.flink.api.java.io.CollectionInputFormat)",

"parallelism": "1",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 48,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)",

"parallelism": "1",

"predecessors": [

{"id": 49, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 43,

"type": "pact",

"pact": "Union",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 44, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 46, "side": "second", "ship_strategy": "Hash Partition on [0]"},

{"id": 48, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"step_function": [

{

"id": 53,

"type": "pact",

"pact": "Bulk Partial Solution",

"contents": "Partial Solution",

"parallelism": "8",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 52,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:188)",

"parallelism": "8",

"predecessors": [

{"id": 53, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 55,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:189)",

"parallelism": "8",

"predecessors": [

{"id": 53, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 67,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:128)",

"parallelism": "8",

"predecessors": [

{"id": 52, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 66,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:131)",

"parallelism": "8",

"predecessors": [

{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode": "CACHING_PIPELINE_BREAKER"},

{"id": 4, "side": "second", "ship_strategy": "Broadcast"},

{"id": 67, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 69,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:124)",

"parallelism": "8",

"predecessors": [

{"id": 52, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 68,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",

"parallelism": "8",

"predecessors": [

{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode": "CACHING_PIPELINE_BREAKER"},

{"id": 4, "side": "second", "ship_strategy": "Broadcast"},

{"id": 69, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 65,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 66, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 64,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 65, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 80,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (CACHED) (build: Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 79,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 80, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 78,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 79, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 77,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 78, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 84,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]", "temp_mode": "PIPELINE_BREAKER"},

{"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 83,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 84, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 82,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 83, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 81,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 82, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 76,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 77, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 81, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 75,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",

"parallelism": "8",

"predecessors": [

{"id": 76, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 74,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",

"parallelism": "8",

"predecessors": [

{"id": 75, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 73,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 74, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 72,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 73, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 71,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 72, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (CACHED) (build: Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 70,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.subt(util.scala:347)",

"parallelism": "8",

"predecessors": [

{"id": 71, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 63,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 64, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 70, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.VectorDataSet$.subt(util.scala:347))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 62,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 63, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 61,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 62, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 60,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 61, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 85,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:368)",

"parallelism": "8",

"predecessors": [

{"id": 74, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 59,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 60, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 85, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.VectorDataSet$.mult(util.scala:368))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 58,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 59, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 86,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190)",

"parallelism": "8",

"predecessors": [

{"id": 53, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "0.0" },

{ "name": "Cumulative Disk I/O", "value": "0.0" },

{ "name": "Cumulative CPU", "value": "0.0" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 57,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 58, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 86, "side": "second", "ship_strategy": "Forward"}

],

"driver_strategy": "Hybrid Hash (build: Filter at bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 56,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 57, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 54,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:196)",

"parallelism": "8",

"predecessors": [

{"id": 55, "side": "first", "ship_strategy": "Forward", "temp_mode": "PIPELINE_BREAKER"},

{"id": 56, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 51,

"type": "pact",

"pact": "Union",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 52, "side": "first", "ship_strategy": "Forward"},

{"id": 54, "side": "second", "ship_strategy": "Hash Partition on [0]"},

{"id": 58, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 50,

"type": "pact",

"pact": "No Op",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 51, "ship_strategy": "Forward"}

],

"driver_strategy": "No-Op",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

}

],

"partial_solution": 53,

"next_partial_solution": 50,

"id": 42,

"type": "bulk_iteration",

"pact": "Bulk Iteration",

"contents": "Bulk Iteration",

"parallelism": "8",

"predecessors": [

{"id": 43, "ship_strategy": "Forward"}

],

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 41,

"type": "pact",

"pact": "Filter",

"contents": "Filter at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",

"parallelism": "8",

"predecessors": [

{"id": 42, "ship_strategy": "Forward"}

],

"driver_strategy": "FlatMap",

"global_properties": [

{ "name": "Partitioning", "value": "HASH_PARTITIONED" },

{ "name": "Partitioned on", "value": "[0]" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "0.0" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 40,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",

"parallelism": "8",

"predecessors": [

{"id": 41, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 39,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:63)",

"parallelism": "8",

"predecessors": [

{"id": 40, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "0.0" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 95,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",

"parallelism": "8",

"predecessors": [

{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode": "PIPELINE_BREAKER"},

{"id": 4, "side": "second", "ship_strategy": "Broadcast"},

{"id": 40, "side": "second", "ship_strategy": "Broadcast"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 94,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 93,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 94, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 92,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 93, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 91,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 92, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 99,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]", "temp_mode": "PIPELINE_BREAKER"},

{"id": 95, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Map at bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 98,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",

"parallelism": "8",

"predecessors": [

{"id": 99, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 97,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "8",

"predecessors": [

{"id": 98, "ship_strategy": "Forward"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "101.00" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 96,

"type": "pact",

"pact": "Reduce",

"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",

"parallelism": "1",

"predecessors": [

{"id": 97, "ship_strategy": "Redistribute"}

],

"driver_strategy": "Reduce All",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 90,

"type": "pact",

"pact": "Join",

"contents": "Join at org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",

"parallelism": "8",

"predecessors": [

{"id": 91, "side": "first", "ship_strategy": "Hash Partition on [0]"},

{"id": 96, "side": "second", "ship_strategy": "Hash Partition on [0]"}

],

"driver_strategy": "Hybrid Hash (build: Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375))",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "(unknown)" },

{ "name": "Disk I/O", "value": "(unknown)" },

{ "name": "CPU", "value": "(unknown)" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 89,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",

"parallelism": "8",

"predecessors": [

{"id": 90, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 88,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",

"parallelism": "8",

"predecessors": [

{"id": 89, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 87,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:64)",

"parallelism": "8",

"predecessors": [

{"id": 88, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 2,

"type": "pact",

"pact": "Union",

"contents": "",

"parallelism": "8",

"predecessors": [

{"id": 3, "side": "first", "ship_strategy": "Forward"},

{"id": 39, "side": "second", "ship_strategy": "Forward"},

{"id": 87, "side": "second", "ship_strategy": "Forward"}

],

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 1,

"type": "pact",

"pact": "Map",

"contents": "Map at bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:66)",

"parallelism": "8",

"predecessors": [

{"id": 2, "ship_strategy": "Forward"}

],

"driver_strategy": "Map",

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

},

{

"id": 0,

"type": "sink",

"pact": "Data Sink",

"contents": "TextOutputFormat (/tmp/bumpboosttest) - UTF-8",

"parallelism": "8",

"predecessors": [

{"id": 1, "ship_strategy": "Forward"}

],

"global_properties": [

{ "name": "Partitioning", "value": "RANDOM" },

{ "name": "Partitioning Order", "value": "(none)" },

{ "name": "Uniqueness", "value": "not unique" }

],

"local_properties": [

{ "name": "Order", "value": "(none)" },

{ "name": "Grouping", "value": "not grouped" },

{ "name": "Uniqueness", "value": "not unique" }

],

"estimates": [

{ "name": "Est. Output Size", "value": "(unknown)" },

{ "name": "Est. Cardinality", "value": "(unknown)" } ],

"costs": [

{ "name": "Network", "value": "0.0" },

{ "name": "Disk I/O", "value": "0.0" },

{ "name": "CPU", "value": "0.0" },

{ "name": "Cumulative Network", "value": "(unknown)" },

{ "name": "Cumulative Disk I/O", "value": "(unknown)" },

{ "name": "Cumulative CPU", "value": "(unknown)" }

],

"compiler_hints": [

{ "name": "Output Size (bytes)", "value": "(none)" },

{ "name": "Output Cardinality", "value": "(none)" },

{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },

{ "name": "Filter Factor", "value": "(none)" } ]

}

]

}

On Tue, Dec 9, 2014 at 9:31 AM, Maximilian Alber <[hidden email]> wrote:

Sorry! Sure! Please use the settings I posted above, I just saw in other cases I get other strange error messages...

On Mon, Dec 8, 2014 at 8:36 PM, Stephan Ewen <[hidden email]> wrote:

Hey!

Could you share the source code with us? It makes the debugging much much simpler ;-)

Stephan

On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <[hidden email]> wrote:

Could you reproduce the error now?

On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <[hidden email]> wrote:

Sure.

Those are the params (in_file and random_file need to be set, out_file you can choose a name.):

flink 'run', '-v', '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar', '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn', 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30', 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False', 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08', 'max_width_update=10'

On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <[hidden email]> wrote:

Hi!

I have been trying to re-implement the program you sent here (the code is incomplete), but I cannot trigger the exception. Can you send us the complete example?

Stephan

On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <[hidden email]> wrote:

Hi Flinksters!

I try to write a BulkIteration. Somehow I get a cryptic error message, at least I have no clue what's wrong:

Code:

var width = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * config.startWidth)) map {x => new Vector(0, x.values)}
var update = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map {x => new Vector(1, x.values)}
var lastGradient = env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x => new Vector(2, x.values)}

var stepSet = width union update union lastGradient
stepSet = stepSet.iterate(config.gradientDescentIterations){
    stepSet =>
    var width = stepSet filter {_.id == 0}
    var update = stepSet filter {_.id == 1}
    var lastGradient = stepSet filter {_.id == 2}

    val gradient = getGradient(X, residual, center, width)
    val term = gradient * lastGradient
    lastGradient = gradient

    update = update.map(new RichMapFunction[Vector, Vector]{
      var term: Vector = null
      val minWidthUpdate = 0.00000001F
      val maxWidthUpdate = 10.0F
      override def open(config: Configuration) = {
       term = getRuntimeContext.getBroadcastVariable("term").toList.head
    }

    def map(x: Vector) = {x.condMul(term.isLess(0), 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
    }).withBroadcastSet(term, "term")
    /*
    width = width.map(new RichMapFunction[Vector, Vector]{
      var update: Vector = null
      var gradient: Vector = null
      override def open(config: Configuration) = {
        update = getRuntimeContext.getBroadcastVariable("update").toList.head
       gradient = getRuntimeContext.getBroadcastVariable("gradient").toList.head
     }

    def map(x: Vector) = {(x + update * (gradient sign)).clip(config.minWidth, config.maxWidth)}
    }).withBroadcastSet(update, "update")withBroadcastSet(gradient, "gradient")
    */

    width union update union lastGradient
}

Error:

java.lang.IllegalStateException
at org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
at org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
at org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
at org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
at org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
at org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
at org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
at org.apache.flink.client.program.Client.run(Client.java:288)
at org.apache.flink.client.program.Client.run(Client.java:231)
at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)

Thanks!

Cheers,

Max