how many iterations (supersteps) were made

[Attila Bernáth]

Dear All,

In an IterativeDataSet I can set the maximum number of iterations to make.
Can I find out how many supersteps were in fact made?

Attila

[Ufuk Celebi]

Hey Attila,

1) Yes. Both iterate and deltaIterate take an argument for the maximum number of iterations to be made.

2) Yes. You can use an Accumulator [1] to count the number of iterations. You can also have a look at log output (logged at INFO level).

Does this help?

– Ufuk

[1] http://flink.incubator.apache.org/docs/0.7-incubating/programming_guide.html#accumulators--counters

On 16 Oct 2014, at 10:49, Attila Bernáth <[hidden email]> wrote:

> Dear All,
>
> In an IterativeDataSet I can set the maximum number of iterations to make.
> Can I find out how many supersteps were in fact made?
>
> Attila

[Fabian Hueske-2]

Hi Attila,

you can also call getIterationRuntimeContext.getSuperstepNumber() in any function that is applied within an iteration.

Best, Fabian

2014-10-16 11:05 GMT+02:00 Ufuk Celebi <[hidden email]>:

Hey Attila,

1) Yes. Both iterate and deltaIterate take an argument for the maximum number of iterations to be made.

2) Yes. You can use an Accumulator [1] to count the number of iterations. You can also have a look at log output (logged at INFO level).

Does this help?

– Ufuk

[1] http://flink.incubator.apache.org/docs/0.7-incubating/programming_guide.html#accumulators--counters

On 16 Oct 2014, at 10:49, Attila Bernáth <[hidden email]> wrote:

> Dear All,
>
> In an IterativeDataSet I can set the maximum number of iterations to make.
> Can I find out how many supersteps were in fact made?
>
> Attila

[Fabian Hueske]

Hi Attila,

you can also call getIterationRuntimeContext.getSuperstepNumber() in any function that is applied within an iteration.

Best, Fabian

2014-10-16 11:08 GMT+02:00 Fabian Hueske <[hidden email]>:

Hi Attila,

you can also call getIterationRuntimeContext.getSuperstepNumber() in any function that is applied within an iteration.

Best, Fabian

2014-10-16 11:05 GMT+02:00 Ufuk Celebi <[hidden email]>:

Hey Attila,

1) Yes. Both iterate and deltaIterate take an argument for the maximum number of iterations to be made.

2) Yes. You can use an Accumulator [1] to count the number of iterations. You can also have a look at log output (logged at INFO level).

Does this help?

– Ufuk

[1] http://flink.incubator.apache.org/docs/0.7-incubating/programming_guide.html#accumulators--counters

On 16 Oct 2014, at 10:49, Attila Bernáth <[hidden email]> wrote:

> Dear All,
>
> In an IterativeDataSet I can set the maximum number of iterations to make.
> Can I find out how many supersteps were in fact made?
>
> Attila