Changes in Flink 1.6.2

[Boris Lublinsky]

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Dominik Wosiński]

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Boris Lublinsky]

Here is the code

def executeLocal() : Unit = {
  val env = StreamExecutionEnvironment.getExecutionEnvironment
  buildGraph(env)
  System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)
  env.execute()
}

And an error

Error:(68, 63) ambiguous reference to overloaded definition,

both method getJobGraph in class StreamGraph of type (x$1: org.apache.flink.api.common.JobID)org.apache.flink.runtime.jobgraph.JobGraph

and  method getJobGraph in class StreamingPlan of type ()org.apache.flink.runtime.jobgraph.JobGraph

match expected type ?

    System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:47 PM, Dominik Wosiński <[hidden email]> wrote:

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Boris Lublinsky]

Dominik,

Any feedback on this?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:56 PM, Boris Lublinsky <[hidden email]> wrote:

Here is the code

def executeLocal() : Unit = {
  val env = StreamExecutionEnvironment.getExecutionEnvironment
  buildGraph(env)
  System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)
  env.execute()
}

And an error

Error:(68, 63) ambiguous reference to overloaded definition,

both method getJobGraph in class StreamGraph of type (x$1: org.apache.flink.api.common.JobID)org.apache.flink.runtime.jobgraph.JobGraph

and  method getJobGraph in class StreamingPlan of type ()org.apache.flink.runtime.jobgraph.JobGraph

match expected type ?

    System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:47 PM, Dominik Wosiński <[hidden email]> wrote:

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Dawid Wysakowicz-2]

Hi Boris,

I am not a scala expert, so I won't be able explain the root cause completely, but it is because you access empty-parameter java method as scala parameterless one (I don't know why it doesn't work).

If you change your code to: env.getStreamGraph.getJobGraph().getJobID it will work.

Best,

Dawid

On 30/11/2018 15:19, Boris Lublinsky wrote:

Dominik,

Any feedback on this?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:56 PM, Boris Lublinsky <[hidden email]> wrote:

Here is the code

def executeLocal() : Unit = {
  val env = StreamExecutionEnvironment.getExecutionEnvironment
  buildGraph(env)
  System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)
  env.execute()
}

And an error

Error:(68, 63) ambiguous reference to overloaded definition,

both method getJobGraph in class StreamGraph of type (x$1: org.apache.flink.api.common.JobID)org.apache.flink.runtime.jobgraph.JobGraph

and  method getJobGraph in class StreamingPlan of type ()org.apache.flink.runtime.jobgraph.JobGraph

match expected type ?

    System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:47 PM, Dominik Wosiński <[hidden email]> wrote:

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Boris Lublinsky]

It does, weird

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 30, 2018, at 8:56 AM, Dawid Wysakowicz <[hidden email]> wrote:

Hi Boris,

I am not a scala expert, so I won't be able explain the root cause completely, but it is because you access empty-parameter java method as scala parameterless one (I don't know why it doesn't work).

If you change your code to: env.getStreamGraph.getJobGraph().getJobID it will work.

Best,

Dawid

On 30/11/2018 15:19, Boris Lublinsky wrote:

Dominik,

Any feedback on this?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:56 PM, Boris Lublinsky <[hidden email]> wrote:

Here is the code

def executeLocal() : Unit = {
  val env = StreamExecutionEnvironment.getExecutionEnvironment
  buildGraph(env)
  System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)
  env.execute()
}

And an error

Error:(68, 63) ambiguous reference to overloaded definition,

both method getJobGraph in class StreamGraph of type (x$1: org.apache.flink.api.common.JobID)org.apache.flink.runtime.jobgraph.JobGraph

and  method getJobGraph in class StreamingPlan of type ()org.apache.flink.runtime.jobgraph.JobGraph

match expected type ?

    System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:47 PM, Dominik Wosiński <[hidden email]> wrote:

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

[Dominik Wosiński]

Hey, 

@Dawid is right. It is a known issue in Scala. This is due to the functional nature of Scala and is explained on StackOverflow[1].

Best Regards,

Dom.
[1]https://stackoverflow.com/questions/7498677/why-is-this-reference-ambiguous

pt., 30 lis 2018 o 15:56 Dawid Wysakowicz <[hidden email]> napisał(a):

Hi Boris,

I am not a scala expert, so I won't be able explain the root cause completely, but it is because you access empty-parameter java method as scala parameterless one (I don't know why it doesn't work).

If you change your code to: env.getStreamGraph.getJobGraph().getJobID it will work.

Best,

Dawid

On 30/11/2018 15:19, Boris Lublinsky wrote:

Dominik,

Any feedback on this?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:56 PM, Boris Lublinsky <[hidden email]> wrote:

Here is the code

def executeLocal() : Unit = {
  val env = StreamExecutionEnvironment.getExecutionEnvironment
  buildGraph(env)
  System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)
  env.execute()
}

And an error

Error:(68, 63) ambiguous reference to overloaded definition,

both method getJobGraph in class StreamGraph of type (x$1: org.apache.flink.api.common.JobID)org.apache.flink.runtime.jobgraph.JobGraph

and  method getJobGraph in class StreamingPlan of type ()org.apache.flink.runtime.jobgraph.JobGraph

match expected type ?

    System.out.println("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID)

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/

On Nov 28, 2018, at 2:47 PM, Dominik Wosiński <[hidden email]> wrote:

Hey, 
Could you show the message that You are getting? 
Best Regards,
Dom.

śr., 28 lis 2018 o 19:08 Boris Lublinsky <[hidden email]> napisał(a):

Prior to Flink version 1.6.2 including 1.6.1

env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message

AM I missing something?

Boris Lublinsky
FDP Architect
[hidden email]
https://www.lightbend.com/