Hi, I'm hitting Compiler Exception with some of my data set, but not all of them.Exception in thread "main" org.apache.flink.optimizer.CompilerException: No plan meeting the requirements could be created @ Bulk Iteration (Bulk Iteration) (1:null). Most likely reason: Too restrictive plan hints. |
Hi Kien Truong, could you share the problematic code with us? Cheers, On Nov 18, 2015 9:54 PM, "Truong Duc Kien" <[hidden email]> wrote:
|
Hi Till,
I have narrowed down a minimal test case, you will need flink-gelly-scala package to run this. import org.apache.flink.api.common.functions.MapFunction import org.apache.flink.api.scala._ import org.apache.flink.graph._ import org.apache.flink.graph.scala.Graph import org.apache.flink.types.NullValue import org.apache.flink.util.Collector object BulkIterationBug { def main(args: Array[String]): Unit = { val environment = ExecutionEnvironment.getExecutionEnvironment val g = Graph.fromCsvReader[Long, Long, NullValue]( pathEdges = "edge.in", vertexValueInitializer = new MapFunction[Long, Long] { override def map(t: Long): Long = t }, fieldDelimiterEdges = " ", lineDelimiterEdges = "\n", ignoreCommentsEdges = "%", env = environment ) val vertices = g.getVertices val edges = g.getEdges val data = vertices.iterate(1) { (it) => { it.coGroup(edges).where(0).equalTo(0) { (first: Iterator[Vertex[Long, Long]], second: Iterator[Edge[Long, NullValue]], collector: Collector[Vertex[Long, Long]]) => { if (first.hasNext) { collector.collect(first.next) } } } } } println(data.collect()) } }The input file "edge.in" contains only 1 line 1 2 Thanks, Kien Truong On 11/19/2015 09:36 AM, Till Rohrmann wrote:
|
Hi Kien Truong, I found a solution to your problem. It's actually a bug in Flink's optimizer. Thanks for spotting it :-) I've opened a pull request to fix it (https://github.com/apache/flink/pull/1388). The fix will also be included in the upcoming `0.10.1` release. After the pull request has been merged you can try it out by either checking the current master out and building Flink yourself or wait until the SNAPSHOT binaries have been updated (usually over night). Cheers, Till On Thu, Nov 19, 2015 at 2:05 PM, Truong Duc Kien <[hidden email]> wrote:
|
Hi Jill, Thank you very much. Looking forward to trying the fix.On Fri, Nov 20, 2015 at 12:38 PM, Till Rohrmann <[hidden email]> wrote:
|
Free forum by Nabble | Edit this page |