Can't access Flink Dashboard at 8081, running Flink program using Eclipse

[Biplob Biswas]

Hi,

I am running my flink program using Eclipse and I can't access the dashboard at http://localhost:8081, can someone help me with this?

I read that I need to check my flink-conf.yaml, but its a maven project and I don't have a flink-conf.

Any help would be really appreciated.

Thanks a lot
Biplob

[Sameer Wadkar]

From Eclipse it creates a local environment and runs in the IDE. When the program finishes so does the Flink execution instance. I have never tried accessing the console when the program is running but one the program is finished there is nothing to connect to.

If you need to access the dashboard, start Flink in the pseudo-cluster mode and connect to it using the getRemoteExecutionEnvironment(). That will allow you to access the jobs statuses on the dashboard when you finish running your job.

Sameer

On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas <[hidden email]> wrote:

Hi,

I am running my flink program using Eclipse and I can't access the dashboard
at http://localhost:8081, can someone help me with this?

I read that I need to check my flink-conf.yaml, but its a maven project and
I don't have a flink-conf.

Any help would be really appreciated.

Thanks a lot
Biplob



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Biplob Biswas]

Hi Sameer,

Thanks for that quick reply, I was using flink streaming so the program keeps on running until i close it. But anyway I am ready to try this getRemoteExecutionEnvironment(), I checked but it ask me for the jar file, which is weird because I am running the program directly.

Does it mean I create a jar package and then run it via eclipse?

If not, could you point me to some resources?

Thanks
Biplob

Sameer W wrote

From Eclipse it creates a local environment and runs in the IDE. When the
program finishes so does the Flink execution instance. I have never tried
accessing the console when the program is running but one the program is
finished there is nothing to connect to.

If you need to access the dashboard, start Flink in the pseudo-cluster mode
and connect to it using the getRemoteExecutionEnvironment(). That will
allow you to access the jobs statuses on the dashboard when you finish
running your job.

Sameer

On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas <[hidden email]>
wrote:

> Hi,
>
> I am running my flink program using Eclipse and I can't access the
> dashboard
> at http://localhost:8081, can someone help me with this?
>
> I read that I need to check my flink-conf.yaml, but its a maven project and
> I don't have a flink-conf.
>
> Any help would be really appreciated.
>
> Thanks a lot
> Biplob
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

[Ufuk Celebi]

You can explicitly create a LocalEnvironment and provide a Configuration:

Configuration config = new Configuration();
config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);

ExecutionEnvironment env = new LocalEnvironment(config);
...


On Tue, Jul 19, 2016 at 1:28 PM, Sameer W <[hidden email]> wrote:

> From Eclipse it creates a local environment and runs in the IDE. When the
> program finishes so does the Flink execution instance. I have never tried
> accessing the console when the program is running but one the program is
> finished there is nothing to connect to.
>
> If you need to access the dashboard, start Flink in the pseudo-cluster mode
> and connect to it using the getRemoteExecutionEnvironment(). That will allow
> you to access the jobs statuses on the dashboard when you finish running
> your job.
>
> Sameer
>
> On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas <[hidden email]>
> wrote:
>>
>> Hi,
>>
>> I am running my flink program using Eclipse and I can't access the
>> dashboard
>> at http://localhost:8081, can someone help me with this?
>>
>> I read that I need to check my flink-conf.yaml, but its a maven project
>> and
>> I don't have a flink-conf.
>>
>> Any help would be really appreciated.
>>
>> Thanks a lot
>> Biplob
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
>> Sent from the Apache Flink User Mailing List archive. mailing list archive
>> at Nabble.com.
>
>

[Biplob Biswas]

Thanks Ufuk, for the input. I tried what u suggested as well ( as follows)

                Configuration config = new Configuration();
                config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);

                StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment(getP, config);

But still i get nothing, i tried 127.0.0.1:8081 and localhost:8081 both as I was getting this message in my log "No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name."

But still nothing.

Anything else I can try, before installing flink and running it via command line?

Thanks for such quick replie btw :)

Biplob

Ufuk Celebi wrote

You can explicitly create a LocalEnvironment and provide a Configuration:

Configuration config = new Configuration();
config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);

ExecutionEnvironment env = new LocalEnvironment(config);
...


On Tue, Jul 19, 2016 at 1:28 PM, Sameer W <[hidden email]> wrote:
> From Eclipse it creates a local environment and runs in the IDE. When the
> program finishes so does the Flink execution instance. I have never tried
> accessing the console when the program is running but one the program is
> finished there is nothing to connect to.
>
> If you need to access the dashboard, start Flink in the pseudo-cluster mode
> and connect to it using the getRemoteExecutionEnvironment(). That will allow
> you to access the jobs statuses on the dashboard when you finish running
> your job.
>
> Sameer
>
> On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas <[hidden email]>
> wrote:
>>
>> Hi,
>>
>> I am running my flink program using Eclipse and I can't access the
>> dashboard
>> at http://localhost:8081, can someone help me with this?
>>
>> I read that I need to check my flink-conf.yaml, but its a maven project
>> and
>> I don't have a flink-conf.
>>
>> Any help would be really appreciated.
>>
>> Thanks a lot
>> Biplob
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
>> Sent from the Apache Flink User Mailing List archive. mailing list archive
>> at Nabble.com.
>
>

[Sameer Wadkar]

Yes you have to provide the path of your jar. The reason is:

1. When you start in the pseudo-cluster mode the tasks are started in their own JVM's with their own class loader.

2. You client program has access to your custom operator classes but the remote JVM's don't. Hence you need to ship the JAR file to these remote Task nodes. The getRemoteExcecutionEnvironment() method has overloaded version which takes a JAR file. Just provide your local path to it and it will ship it when it starts

Sameer

On Tue, Jul 19, 2016 at 6:51 AM, Biplob Biswas <[hidden email]> wrote:

Hi Sameer,

Thanks for that quick reply, I was using flink streaming so the program
keeps on running until i close it. But anyway I am ready to try this
getRemoteExecutionEnvironment(), I checked but it ask me for the jar file,
which is weird because I am running the program directly.

Does it mean I create a jar package and then run it via eclipse?

If not, could you point me to some resources?

Thanks
Biplob


Sameer W wrote
> From Eclipse it creates a local environment and runs in the IDE. When the
> program finishes so does the Flink execution instance. I have never tried
> accessing the console when the program is running but one the program is
> finished there is nothing to connect to.
>
> If you need to access the dashboard, start Flink in the pseudo-cluster
> mode
> and connect to it using the getRemoteExecutionEnvironment(). That will
> allow you to access the jobs statuses on the dashboard when you finish
> running your job.
>
> Sameer
>
> On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas &lt;

> revolutionisme@

> &gt;
> wrote:
>
>> Hi,
>>
>> I am running my flink program using Eclipse and I can't access the
>> dashboard
>> at http://localhost:8081, can someone help me with this?
>>
>> I read that I need to check my flink-conf.yaml, but its a maven project
>> and
>> I don't have a flink-conf.
>>
>> Any help would be really appreciated.
>>
>> Thanks a lot
>> Biplob
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive
>> at Nabble.com.
>>





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016p8018.html

Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Till Rohrmann]

Hi Biplob,

if you want to start the web interface from within your IDE, then you have to create a local execution environment as Ufuk told you:

Configuration config = new Configuration();
config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);

StreamExecutionEnvironment env = StreamExecutionEnvironment.createLocalEnvironment(getP, config);

and you have to add the following dependency to your pom.xml:

<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-runtime-web_2.10</artifactId>
    <version>${flink.version}</version>
</dependency>

Cheers,
Till

​

On Tue, Jul 19, 2016 at 2:27 PM, Sameer W <[hidden email]> wrote:

Yes you have to provide the path of your jar. The reason is:

1. When you start in the pseudo-cluster mode the tasks are started in their own JVM's with their own class loader.

2. You client program has access to your custom operator classes but the remote JVM's don't. Hence you need to ship the JAR file to these remote Task nodes. The getRemoteExcecutionEnvironment() method has overloaded version which takes a JAR file. Just provide your local path to it and it will ship it when it starts

Sameer

On Tue, Jul 19, 2016 at 6:51 AM, Biplob Biswas <[hidden email]> wrote:

Hi Sameer,

Thanks for that quick reply, I was using flink streaming so the program
keeps on running until i close it. But anyway I am ready to try this
getRemoteExecutionEnvironment(), I checked but it ask me for the jar file,
which is weird because I am running the program directly.

Does it mean I create a jar package and then run it via eclipse?

If not, could you point me to some resources?

Thanks
Biplob


Sameer W wrote
> From Eclipse it creates a local environment and runs in the IDE. When the
> program finishes so does the Flink execution instance. I have never tried
> accessing the console when the program is running but one the program is
> finished there is nothing to connect to.
>
> If you need to access the dashboard, start Flink in the pseudo-cluster
> mode
> and connect to it using the getRemoteExecutionEnvironment(). That will
> allow you to access the jobs statuses on the dashboard when you finish
> running your job.
>
> Sameer
>
> On Tue, Jul 19, 2016 at 6:35 AM, Biplob Biswas &lt;

> revolutionisme@

> &gt;
> wrote:
>
>> Hi,
>>
>> I am running my flink program using Eclipse and I can't access the
>> dashboard
>> at http://localhost:8081, can someone help me with this?
>>
>> I read that I need to check my flink-conf.yaml, but its a maven project
>> and
>> I don't have a flink-conf.
>>
>> Any help would be really appreciated.
>>
>> Thanks a lot
>> Biplob
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive
>> at Nabble.com.
>>





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Can-t-access-Flink-Dashboard-at-8081-running-Flink-program-using-Eclipse-tp8016p8018.html

Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Biplob Biswas]

Thanks a ton, Till.

That worked. Thank you so much.

-Biplob

[Mar_zieh]

Hello

I added these dependencies to "pom.xml"; also, I added configuration to my
code like these:

Configuration config = new Configuration();
config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);

StreamExecutionEnvironment env =
StreamExecutionEnvironment.createLocalEnvironment(getP, config);

First, I could connect to Dashboard,but now I get this error:
"Exception in thread "main" java.net.BindException: Address already in use:
bind"

I know it is related to port number (8081) which is shared with other
programs. But I cannot solve it.

Would you please guide me?

I really appreciate it.

Sincerely




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Chesnay Schepler]

you can setup a specific port using
https://ci.apache.org/projects/flink/flink-docs-master/ops/config.html#rest-port.
On 03.09.2018 12:12, Mar_zieh wrote:

> Hello
>
> I added these dependencies to "pom.xml"; also, I added configuration to my
> code like these:
>
> Configuration config = new Configuration();
> config.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER, true);
>
> StreamExecutionEnvironment env =
> StreamExecutionEnvironment.createLocalEnvironment(getP, config);
>
> First, I could connect to Dashboard,but now I get this error:
> "Exception in thread "main" java.net.BindException: Address already in use:
> bind"
>
> I know it is related to port number (8081) which is shared with other
> programs. But I cannot solve it.
>
> Would you please guide me?
>
> I really appreciate it.
>
> Sincerely
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>