Problem with passing arguments to Flink Web Submission Client

[Filip Łęczycki]

Hi all,

I would like get the pretty printed execution plan of my job, in order to achieve that I uploaded my jar to Flink Web Submission Client and tried to run it. However when I provide arguments for my app I receive following error:

An unexpected error occurred:

Unrecognized option: -f

org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f

at org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)

at org.apache.flink.client.CliFrontend.info(CliFrontend.java:376)

at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)

at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)

at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)

at org.eclipse.jetty.server.Server.handle(Server.java:348)

at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)

at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)

at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)

at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)

at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)

at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)

at java.lang.Thread.run(Thread.java:745)

Here is what i write into the "Program Arguments" box:

-f flink -i <filepath> -m 1

Am I doing something wrong or is this a bug and web client tries to interpret my arguments as flink options?

[Matthias J. Sax-2]

That is a bug. Can you open a JIRA for it?

You can work around by not prefixing your flag with "-"

-Matthias

On 12/20/2015 12:59 PM, Filip Łęczycki wrote:

> Hi all,
>
> I would like get the pretty printed execution plan of my job, in order
> to achieve that I uploaded my jar to Flink Web Submission Client and
> tried to run it. However when I provide arguments for my app I receive
> following error:
>
> An unexpected error occurred:
> Unrecognized option: -f
> org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f
> at
> org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)
> at org.apache.flink.client.CliFrontend.info
> <http://org.apache.flink.client.CliFrontend.info>(CliFrontend.java:376)
> at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)
> at
> org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
> at org.eclipse.jetty.server.Server.handle(Server.java:348)
> at
> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
> at
> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
> at java.lang.Thread.run(Thread.java:745)
>
> Here is what i write into the "Program Arguments" box:
> -f flink -i <filepath> -m 1
>
> Am I doing something wrong or is this a bug and web client tries to
> interpret my arguments as flink options?
>
> Regards/Pozdrawiam,
> Filip Łęczycki

[Matthias J. Sax-2]

The bug is actually in the CLI (it's not a WebClient related issue)

if you run

> bin/flink myJarFile.jar -f flink -i <filepath> -m 1

it also returns

> Unrecognized option: -f


-Matthias

On 12/20/2015 09:37 PM, Matthias J. Sax wrote:

> That is a bug. Can you open a JIRA for it?
>
> You can work around by not prefixing your flag with "-"
>
> -Matthias
>
> On 12/20/2015 12:59 PM, Filip Łęczycki wrote:
>> Hi all,
>>
>> I would like get the pretty printed execution plan of my job, in order
>> to achieve that I uploaded my jar to Flink Web Submission Client and
>> tried to run it. However when I provide arguments for my app I receive
>> following error:
>>
>> An unexpected error occurred:
>> Unrecognized option: -f
>> org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f
>> at
>> org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)
>> at org.apache.flink.client.CliFrontend.info
>> <http://org.apache.flink.client.CliFrontend.info>(CliFrontend.java:376)
>> at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)
>> at
>> org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
>> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
>> at
>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
>> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
>> at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
>> at
>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
>> at org.eclipse.jetty.server.Server.handle(Server.java:348)
>> at
>> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
>> at
>> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
>> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
>> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
>> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
>> at
>> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
>> at
>> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Here is what i write into the "Program Arguments" box:
>> -f flink -i <filepath> -m 1
>>
>> Am I doing something wrong or is this a bug and web client tries to
>> interpret my arguments as flink options?
>>
>> Regards/Pozdrawiam,
>> Filip Łęczycki
>

[Filip Łęczycki]

Hi,

Regarding the CLI, I have been using 

>bin/flink run myJarFile.jar -f flink -i <filepath> -m 1 

and it is working perfectly fine. Is there a difference between this two ways of submitting a job ("bin/flink MyJar.jar" and "bin/flink run MyJar.jar")?

I will open a Jira.

Best Regards,

Filip Łęczycki

2015-12-20 21:55 GMT+01:00 Matthias J. Sax <[hidden email]>:

The bug is actually in the CLI (it's not a WebClient related issue)

if you run

> bin/flink myJarFile.jar -f flink -i <filepath> -m 1

it also returns

> Unrecognized option: -f


-Matthias

On 12/20/2015 09:37 PM, Matthias J. Sax wrote:
> That is a bug. Can you open a JIRA for it?
>
> You can work around by not prefixing your flag with "-"
>
> -Matthias
>
> On 12/20/2015 12:59 PM, Filip Łęczycki wrote:
>> Hi all,
>>
>> I would like get the pretty printed execution plan of my job, in order
>> to achieve that I uploaded my jar to Flink Web Submission Client and
>> tried to run it. However when I provide arguments for my app I receive
>> following error:
>>
>> An unexpected error occurred:
>> Unrecognized option: -f
>> org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f
>> at
>> org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)
>> at org.apache.flink.client.CliFrontend.info
>> <http://org.apache.flink.client.CliFrontend.info>(CliFrontend.java:376)
>> at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)
>> at
>> org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
>> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
>> at
>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
>> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
>> at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
>> at
>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
>> at org.eclipse.jetty.server.Server.handle(Server.java:348)
>> at
>> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
>> at
>> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
>> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
>> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
>> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
>> at
>> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
>> at
>> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Here is what i write into the "Program Arguments" box:
>> -f flink -i <filepath> -m 1
>>
>> Am I doing something wrong or is this a bug and web client tries to
>> interpret my arguments as flink options?
>>
>> Regards/Pozdrawiam,
>> Filip Łęczycki
>

[Matthias J. Sax-2]

Thanks for opening a JIRA.

I used "info" which yield the error (forgot it in the mail):

> bin/flink info myJarFile.jar -f flink -i <filepath> -m 1

-Matthias

On 12/21/2015 10:36 AM, Filip Łęczycki wrote:

> Hi,
>
> Regarding the CLI, I have been using
>>bin/flink run myJarFile.jar -f flink -i <filepath> -m 1
> and it is working perfectly fine. Is there a difference between this two
> ways of submitting a job ("bin/flink MyJar.jar" and "bin/flink run
> MyJar.jar")?
>
> I will open a Jira.
>
> Best Regards,
> Filip Łęczycki
>
> Pozdrawiam,
> Filip Łęczycki
>
> 2015-12-20 21:55 GMT+01:00 Matthias J. Sax <[hidden email]
> <mailto:[hidden email]>>:
>
>     The bug is actually in the CLI (it's not a WebClient related issue)
>
>     if you run
>
>     > bin/flink myJarFile.jar -f flink -i <filepath> -m 1
>
>     it also returns
>
>     > Unrecognized option: -f
>
>
>     -Matthias
>
>     On 12/20/2015 09:37 PM, Matthias J. Sax wrote:
>     > That is a bug. Can you open a JIRA for it?
>     >
>     > You can work around by not prefixing your flag with "-"
>     >
>     > -Matthias
>     >
>     > On 12/20/2015 12:59 PM, Filip Łęczycki wrote:
>     >> Hi all,
>     >>
>     >> I would like get the pretty printed execution plan of my job, in
>     order
>     >> to achieve that I uploaded my jar to Flink Web Submission Client and
>     >> tried to run it. However when I provide arguments for my app I
>     receive
>     >> following error:
>     >>
>     >> An unexpected error occurred:
>     >> Unrecognized option: -f
>     >> org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f
>     >> at
>     >>
>     org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)
>     >> at org.apache.flink.client.CliFrontend.info
>     <http://org.apache.flink.client.CliFrontend.info>
>     >>
>     <http://org.apache.flink.client.CliFrontend.info>(CliFrontend.java:376)
>     >> at
>     org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)
>     >> at
>     >>
>     org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)
>     >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
>     >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
>     >> at
>     org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
>     >> at
>     >>
>     org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
>     >> at
>     >>
>     org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
>     >> at
>     >>
>     org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
>     >> at
>     org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
>     >> at
>     >>
>     org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
>     >> at
>     >>
>     org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
>     >> at
>     >>
>     org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>     >> at
>     org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
>     >> at
>     >>
>     org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
>     >> at org.eclipse.jetty.server.Server.handle(Server.java:348)
>     >> at
>     >>
>     org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
>     >> at
>     >>
>     org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
>     >> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
>     >> at
>     org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
>     >> at
>     org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
>     >> at
>     >>
>     org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
>     >> at
>     >>
>     org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
>     >> at java.lang.Thread.run(Thread.java:745)
>     >>
>     >> Here is what i write into the "Program Arguments" box:
>     >> -f flink -i <filepath> -m 1
>     >>
>     >> Am I doing something wrong or is this a bug and web client tries to
>     >> interpret my arguments as flink options?
>     >>
>     >> Regards/Pozdrawiam,
>     >> Filip Łęczycki
>     >
>
>