Flink 1.9.1 allocating more containers than needed

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink 1.9.1 allocating more containers than needed

eSKa
Hello,
recently we have upgraded our environment to from 1.6.4 to 1.9.1. We started
to notice similar behaviour we met in 1.6.2, which was allocating more
containers on yarn then are needed by job - i think it was fixed by
https://issues.apache.org/jira/browse/FLINK-10848, but that one is still
existing in 1.9.1.
Any chance to have that fixed?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.9.1 allocating more containers than needed

Chesnay Schepler
There are some follow-up issues that are fixed for 1.9.2; release date
for that is TBD.

https://issues.apache.org/jira/browse/FLINK-12342
https://issues.apache.org/jira/browse/FLINK-13184

On 06/12/2019 15:08, eSKa wrote:

> Hello,
> recently we have upgraded our environment to from 1.6.4 to 1.9.1. We started
> to notice similar behaviour we met in 1.6.2, which was allocating more
> containers on yarn then are needed by job - i think it was fixed by
> https://issues.apache.org/jira/browse/FLINK-10848, but that one is still
> existing in 1.9.1.
> Any chance to have that fixed?
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>

Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.9.1 allocating more containers than needed

Chesnay Schepler
Note that FLINK-10848 is included in 1.9.X, but it didn't fix the issue
completely.

On 06/12/2019 15:10, Chesnay Schepler wrote:

> There are some follow-up issues that are fixed for 1.9.2; release date
> for that is TBD.
>
> https://issues.apache.org/jira/browse/FLINK-12342
> https://issues.apache.org/jira/browse/FLINK-13184
>
> On 06/12/2019 15:08, eSKa wrote:
>> Hello,
>> recently we have upgraded our environment to from 1.6.4 to 1.9.1. We
>> started
>> to notice similar behaviour we met in 1.6.2, which was allocating more
>> containers on yarn then are needed by job - i think it was fixed by
>> https://issues.apache.org/jira/browse/FLINK-10848, but that one is still
>> existing in 1.9.1.
>> Any chance to have that fixed?
>>
>>
>>
>> --
>> Sent from:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.9.1 allocating more containers than needed

eSKa
Thank you for quick reply. Will wait for 1.9.2 then. I believe you dont have
any estimates on when it can happen?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.9.1 allocating more containers than needed

Chesnay Schepler
I would expect January. With 1.8.3 release being underway, 1.10 feature
freeze coming close and, of course, Christmas, it seems unlikely that
we'll manage to pump out another bugfix release in December.

On 06/12/2019 15:18, eSKa wrote:
> Thank you for quick reply. Will wait for 1.9.2 then. I believe you dont have
> any estimates on when it can happen?
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>