(DEPRECATED) Apache Flink User Mailing List archive.

Updated Flink Documentation and tutorials

classic Classic list List threaded Threaded
♦
♦
 5 messages Options
Pankaj Chand
Reply | Threaded
Open this post in threaded view
♦
♦
|

Updated Flink Documentation and tutorials

Pankaj Chand
Hello,

Please let me know how to get the updated documentation and tutorials of Apache Flink.
The stable v1.8 and v1.9-snapshot release of the documentation seems to be outdated.

Thanks!

Pankaj
Chesnay Schepler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Updated Flink Documentation and tutorials

Chesnay Schepler
What makes you believe that they are out-dated?

On 19/06/2019 19:17, Pankaj Chand wrote:

> Hello,
>
> Please let me know how to get the updated documentation and tutorials
> of Apache Flink.
> The stable v1.8 and v1.9-snapshot release of the documentation seems
> to be outdated.
>
> Thanks!
>
> Pankaj


Pankaj Chand
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Updated Flink Documentation and tutorials

Pankaj Chand
Based on the below conversation (reverse chronological order) regarding my previous question on the role of Job Manager in Flink:


Hi Biao,

Thank you for your reply!

Please let me know the url of the updated Flink documentation.

The url of the outdated document is:

Another page which (tacitly) supports the outdated concept is:
 
The website that hosts these pages is also the first result that comes up when you Google Search for "Flink documentation", and it claims it is a stable version. The url is:

Again, please let me know the url of the updated Flink documentation. 
 
Thank you Biao and Eduardo!

Pankaj
Hide quoted text

On Tue, Jun 18, 2019 at 11:49 PM Biao Liu <[hidden email]> wrote:
Hi Pankaj,

That's really a good question. There was a refactor of architecture before[1]. So there might be some descriptions used the outdated concept.

Before refactoring, Job Manager is a centralized role. It controls whole cluster and all jobs which is described in your interpretation 1.

After refactoring, the old Job Manager is separated into several roles, Resource Manager, Dispatcher, new Job Manager, etc. The new Job Manager is responsible for only one job, which is described in your interpretation 2.

So the document you refer to is outdated. Would you mind telling us the URL of this document? I think we should update it to avoid misleading more people.


Eduardo Winpenny Tejedor <[hidden email]> 于2019年6月19日周三 上午1:12写道：
Hi Pankaj,

I have no experience with Hadoop but from the book I gathered there's one Job Manager per application i.e. per jar (as in the example in the first chapter). This is not to say there's one Job Manager per job. Actually I don't think the word Job is defined in the book, I've seen Task defined, and those do have Task Managers

Hope this is along the right lines

Regards,
Eduardo

On Tue, 18 Jun 2019, 08:42 Pankaj Chand, <[hidden email]> wrote:
I am trying to understand the role of Job Manager in Flink, and have come across two possibly distinct interpretations.

1. The online documentation v1.8 signifies that there is at least one Job Manager in a cluster, and it is closely tied to the cluster of machines, by managing all jobs in that cluster of machines.

This signifies that Flink's Job Manager is much like Hadoop's Application Manager.

2. The book, "Stream Processing with Apache Flink", writes that, "The Job Manager is the master process that controls the execution of a single application—each application is controlled by a different Job Manager."

This signifies that Flink defaults to one Job Manager per job, and the Job Manager is closely tied to that single job, much like Hadoop's Application Master for each job.

Please let me know which one is correct.

Pankaj

On Thu, Jun 20, 2019, 4:54 AM Chesnay Schepler <[hidden email]> wrote:
What makes you believe that they are out-dated?

On 19/06/2019 19:17, Pankaj Chand wrote:
> Hello,
>
> Please let me know how to get the updated documentation and tutorials
> of Apache Flink.
> The stable v1.8 and v1.9-snapshot release of the documentation seems
> to be outdated.
>
> Thanks!
>
> Pankaj
Chesnay Schepler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Updated Flink Documentation and tutorials

Chesnay Schepler
There is no version of the documentation that is more up-to-date. The documentation was simply not updated yet for the new architecture.

On 20/06/2019 11:45, Pankaj Chand wrote:
Based on the below conversation (reverse chronological order) regarding my previous question on the role of Job Manager in Flink:


Hi Biao,

Thank you for your reply!

Please let me know the url of the updated Flink documentation.

The url of the outdated document is:

Another page which (tacitly) supports the outdated concept is:
 
The website that hosts these pages is also the first result that comes up when you Google Search for "Flink documentation", and it claims it is a stable version. The url is:

Again, please let me know the url of the updated Flink documentation. 
 
Thank you Biao and Eduardo!

Pankaj
Hide quoted text

On Tue, Jun 18, 2019 at 11:49 PM Biao Liu <[hidden email]> wrote:
Hi Pankaj,

That's really a good question. There was a refactor of architecture before[1]. So there might be some descriptions used the outdated concept.

Before refactoring, Job Manager is a centralized role. It controls whole cluster and all jobs which is described in your interpretation 1.

After refactoring, the old Job Manager is separated into several roles, Resource Manager, Dispatcher, new Job Manager, etc. The new Job Manager is responsible for only one job, which is described in your interpretation 2.

So the document you refer to is outdated. Would you mind telling us the URL of this document? I think we should update it to avoid misleading more people.


Eduardo Winpenny Tejedor <[hidden email]> 于2019年6月19日周三 上午1:12写道：
Hi Pankaj,

I have no experience with Hadoop but from the book I gathered there's one Job Manager per application i.e. per jar (as in the example in the first chapter). This is not to say there's one Job Manager per job. Actually I don't think the word Job is defined in the book, I've seen Task defined, and those do have Task Managers

Hope this is along the right lines

Regards,
Eduardo

On Tue, 18 Jun 2019, 08:42 Pankaj Chand, <[hidden email]> wrote:
I am trying to understand the role of Job Manager in Flink, and have come across two possibly distinct interpretations.

1. The online documentation v1.8 signifies that there is at least one Job Manager in a cluster, and it is closely tied to the cluster of machines, by managing all jobs in that cluster of machines.

This signifies that Flink's Job Manager is much like Hadoop's Application Manager.

2. The book, "Stream Processing with Apache Flink", writes that, "The Job Manager is the master process that controls the execution of a single application—each application is controlled by a different Job Manager."

This signifies that Flink defaults to one Job Manager per job, and the Job Manager is closely tied to that single job, much like Hadoop's Application Master for each job.

Please let me know which one is correct.

Pankaj

On Thu, Jun 20, 2019, 4:54 AM Chesnay Schepler <[hidden email]> wrote:
What makes you believe that they are out-dated?

On 19/06/2019 19:17, Pankaj Chand wrote:
> Hello,
>
> Please let me know how to get the updated documentation and tutorials
> of Apache Flink.
> The stable v1.8 and v1.9-snapshot release of the documentation seems
> to be outdated.
>
> Thanks!
>
> Pankaj
Pankaj Chand
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Updated Flink Documentation and tutorials

Pankaj Chand
Thank you!

On Thu, Jun 20, 2019, 5:49 AM Chesnay Schepler <[hidden email]> wrote:
There is no version of the documentation that is more up-to-date. The documentation was simply not updated yet for the new architecture.

On 20/06/2019 11:45, Pankaj Chand wrote:
Based on the below conversation (reverse chronological order) regarding my previous question on the role of Job Manager in Flink:


Hi Biao,

Thank you for your reply!

Please let me know the url of the updated Flink documentation.

The url of the outdated document is:

Another page which (tacitly) supports the outdated concept is:
 
The website that hosts these pages is also the first result that comes up when you Google Search for "Flink documentation", and it claims it is a stable version. The url is:

Again, please let me know the url of the updated Flink documentation. 
 
Thank you Biao and Eduardo!

Pankaj
Hide quoted text

On Tue, Jun 18, 2019 at 11:49 PM Biao Liu <[hidden email]> wrote:
Hi Pankaj,

That's really a good question. There was a refactor of architecture before[1]. So there might be some descriptions used the outdated concept.

Before refactoring, Job Manager is a centralized role. It controls whole cluster and all jobs which is described in your interpretation 1.

After refactoring, the old Job Manager is separated into several roles, Resource Manager, Dispatcher, new Job Manager, etc. The new Job Manager is responsible for only one job, which is described in your interpretation 2.

So the document you refer to is outdated. Would you mind telling us the URL of this document? I think we should update it to avoid misleading more people.


Eduardo Winpenny Tejedor <[hidden email]> 于2019年6月19日周三 上午1:12写道：
Hi Pankaj,

I have no experience with Hadoop but from the book I gathered there's one Job Manager per application i.e. per jar (as in the example in the first chapter). This is not to say there's one Job Manager per job. Actually I don't think the word Job is defined in the book, I've seen Task defined, and those do have Task Managers

Hope this is along the right lines

Regards,
Eduardo

On Tue, 18 Jun 2019, 08:42 Pankaj Chand, <[hidden email]> wrote:
I am trying to understand the role of Job Manager in Flink, and have come across two possibly distinct interpretations.

1. The online documentation v1.8 signifies that there is at least one Job Manager in a cluster, and it is closely tied to the cluster of machines, by managing all jobs in that cluster of machines.

This signifies that Flink's Job Manager is much like Hadoop's Application Manager.

2. The book, "Stream Processing with Apache Flink", writes that, "The Job Manager is the master process that controls the execution of a single application—each application is controlled by a different Job Manager."

This signifies that Flink defaults to one Job Manager per job, and the Job Manager is closely tied to that single job, much like Hadoop's Application Master for each job.

Please let me know which one is correct.

Pankaj

On Thu, Jun 20, 2019, 4:54 AM Chesnay Schepler <[hidden email]> wrote:
What makes you believe that they are out-dated?

On 19/06/2019 19:17, Pankaj Chand wrote:
> Hello,
>
> Please let me know how to get the updated documentation and tutorials
> of Apache Flink.
> The stable v1.8 and v1.9-snapshot release of the documentation seems
> to be outdated.
>
> Thanks!
>
> Pankaj
Free forum by Nabble Edit this page