Jupyter PyFlink Web UI

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Jupyter PyFlink Web UI

maverick
Hi,
I've got a question. I'm running PyFlink code from Jupyter Notebook starting
TableEnvironment with following code:

env_settings =
EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
table_env = TableEnvironment.create(env_settings)

How can I enable Web UI in this code?

Regards,
Maciek



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Jupyter PyFlink Web UI

Dian Fu
Hi Macike,

You could try if the following works:

```
table_env.get_config().get_configuration().set_string("rest.bind-port", "xxx")
```

Regards,
Dian

> 2021年6月8日 下午8:26,maverick <[hidden email]> 写道:
>
> Hi,
> I've got a question. I'm running PyFlink code from Jupyter Notebook starting
> TableEnvironment with following code:
>
> env_settings =
> EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
> table_env = TableEnvironment.create(env_settings)
>
> How can I enable Web UI in this code?
>
> Regards,
> Maciek
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reply | Threaded
Open this post in threaded view
|

Re: Jupyter PyFlink Web UI

maverick
Nope.
I found the following solution.

conf = Configuration()
env = StreamExecutionEnvironment(get_gateway().jvm.org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironmentWithWebUI(conf._j_configuration))
env_settings = EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
table_env = StreamTableEnvironment.create(stream_execution_environment=env,
environment_settings=env_settings)

I also created the bug report https://issues.apache.org/jira/browse/FLINK-22924.
I think this API should be exposed in Python.

śr., 9 cze 2021 o 04:57 Dian Fu <[hidden email]> napisał(a):

>
> Hi Macike,
>
> You could try if the following works:
>
> ```
> table_env.get_config().get_configuration().set_string("rest.bind-port", "xxx")
> ```
>
> Regards,
> Dian
>
> > 2021年6月8日 下午8:26,maverick <[hidden email]> 写道:
> >
> > Hi,
> > I've got a question. I'm running PyFlink code from Jupyter Notebook starting
> > TableEnvironment with following code:
> >
> > env_settings =
> > EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
> > table_env = TableEnvironment.create(env_settings)
> >
> > How can I enable Web UI in this code?
> >
> > Regards,
> > Maciek
> >
> >
> >
> > --
> > Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>


--
Maciek Bryński
Reply | Threaded
Open this post in threaded view
|

Re: Jupyter PyFlink Web UI

Jeff Zhang
Hi Maciek,

You can try zeppelin which support pyflink and display flink job url inline.



Maciej Bryński <[hidden email]> 于2021年6月9日周三 下午1:53写道:
Nope.
I found the following solution.

conf = Configuration()
env = StreamExecutionEnvironment(get_gateway().jvm.org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironmentWithWebUI(conf._j_configuration))
env_settings = EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
table_env = StreamTableEnvironment.create(stream_execution_environment=env,
environment_settings=env_settings)

I also created the bug report https://issues.apache.org/jira/browse/FLINK-22924.
I think this API should be exposed in Python.

śr., 9 cze 2021 o 04:57 Dian Fu <[hidden email]> napisał(a):
>
> Hi Macike,
>
> You could try if the following works:
>
> ```
> table_env.get_config().get_configuration().set_string("rest.bind-port", "xxx")
> ```
>
> Regards,
> Dian
>
> > 2021年6月8日 下午8:26,maverick <[hidden email]> 写道:
> >
> > Hi,
> > I've got a question. I'm running PyFlink code from Jupyter Notebook starting
> > TableEnvironment with following code:
> >
> > env_settings =
> > EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
> > table_env = TableEnvironment.create(env_settings)
> >
> > How can I enable Web UI in this code?
> >
> > Regards,
> > Maciek
> >
> >
> >
> > --
> > Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>


--
Maciek Bryński


--
Best Regards

Jeff Zhang
Reply | Threaded
Open this post in threaded view
|

Re: Jupyter PyFlink Web UI

Jeff Zhang
BTW, you can also send email to zeppelin user maillist to join zeppelin slack channel to discuss more details. 


Jeff Zhang <[hidden email]> 于2021年6月9日周三 下午6:34写道:
Hi Maciek,

You can try zeppelin which support pyflink and display flink job url inline.



Maciej Bryński <[hidden email]> 于2021年6月9日周三 下午1:53写道:
Nope.
I found the following solution.

conf = Configuration()
env = StreamExecutionEnvironment(get_gateway().jvm.org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironmentWithWebUI(conf._j_configuration))
env_settings = EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
table_env = StreamTableEnvironment.create(stream_execution_environment=env,
environment_settings=env_settings)

I also created the bug report https://issues.apache.org/jira/browse/FLINK-22924.
I think this API should be exposed in Python.

śr., 9 cze 2021 o 04:57 Dian Fu <[hidden email]> napisał(a):
>
> Hi Macike,
>
> You could try if the following works:
>
> ```
> table_env.get_config().get_configuration().set_string("rest.bind-port", "xxx")
> ```
>
> Regards,
> Dian
>
> > 2021年6月8日 下午8:26,maverick <[hidden email]> 写道:
> >
> > Hi,
> > I've got a question. I'm running PyFlink code from Jupyter Notebook starting
> > TableEnvironment with following code:
> >
> > env_settings =
> > EnvironmentSettings.new_instance().in_streaming_mode().use_blink_planner().build()
> > table_env = TableEnvironment.create(env_settings)
> >
> > How can I enable Web UI in this code?
> >
> > Regards,
> > Maciek
> >
> >
> >
> > --
> > Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>


--
Maciek Bryński


--
Best Regards

Jeff Zhang


--
Best Regards

Jeff Zhang