(DEPRECATED) Apache Flink User Mailing List archive.

CLI: wait-Flag to schedule multiple jobs in a script

Classic

List

Threaded

6 messages Options

Mathias Peters

CLI: wait-Flag to schedule multiple jobs in a script

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

is there still a way to schedule jobs to the JobManager on after each
other?

I remember the "-w" flag in an earlier version for that. This seems to
be gone now, though.
How could one schedule jobs like that now?

Thanks and regards
Mathias
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQEcBAEBAgAGBQJUulSNAAoJEHj0VWOtoCa7RQ8H/inynJ9j/MSUpyBeg8MA7+/2
rvOgd2LTg+DfysJKzsUIyh87G+yMSqEF6/I0bGL6hqF53TspLa8PEqZxe/Cr1RPy
+SkQ5FERhKSHBDMQLGNItoqg1y6a5u9S8O6e/JGOpO5Lo9h0vame8+WoocKz9334
tmy3Gr/rTJHMjy0dgM1xQl+EKMJQVK1vUCeiyLqKWGwH3S5kvrpz+8y7XKmiWQN/
hZpVndDd7+ggc6oCsukoVzvmogTDu6zLdy4jtKaMGO3kPJU/cVxWNZvXlRPBKnEz
KtSoGYcPWqFtL/qt6x26nmRvNimGQ4hFX+tAOri+2AQnJ4E+2XN/zGj3CVDHXqU=
=xwce
-----END PGP SIGNATURE-----

Alexander Alexandrov

Re: CLI: wait-Flag to schedule multiple jobs in a script

Are you looking at the master (0.9-SNAPSHOT) branch?

2015-01-17 13:24 GMT+01:00 Mathias Peters <[hidden email]>:

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi,

is there still a way to schedule jobs to the JobManager on after each
other?

I remember the "-w" flag in an earlier version for that. This seems to
be gone now, though.
How could one schedule jobs like that now?

Thanks and regards
Mathias
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQEcBAEBAgAGBQJUulSNAAoJEHj0VWOtoCa7RQ8H/inynJ9j/MSUpyBeg8MA7+/2
rvOgd2LTg+DfysJKzsUIyh87G+yMSqEF6/I0bGL6hqF53TspLa8PEqZxe/Cr1RPy
+SkQ5FERhKSHBDMQLGNItoqg1y6a5u9S8O6e/JGOpO5Lo9h0vame8+WoocKz9334
tmy3Gr/rTJHMjy0dgM1xQl+EKMJQVK1vUCeiyLqKWGwH3S5kvrpz+8y7XKmiWQN/
hZpVndDd7+ggc6oCsukoVzvmogTDu6zLdy4jtKaMGO3kPJU/cVxWNZvXlRPBKnEz
KtSoGYcPWqFtL/qt6x26nmRvNimGQ4hFX+tAOri+2AQnJ4E+2XN/zGj3CVDHXqU=
=xwce
-----END PGP SIGNATURE-----

Mathias Peters

Re: CLI: wait-Flag to schedule multiple jobs in a script

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Yes but not at the current state.
I checked out, just before christmas last year and haven't merged yet.

Mathias

On 17.01.2015 13:53, Alexander Alexandrov wrote:

> Are you looking at the master (0.9-SNAPSHOT) branch?
>
> 2015-01-17 13:24 GMT+01:00 Mathias Peters
> <[hidden email]>:
>
> Hi,
>
> is there still a way to schedule jobs to the JobManager on after
> each other?
>
> I remember the "-w" flag in an earlier version for that. This seems
> to be gone now, though. How could one schedule jobs like that now?
>
> Thanks and regards Mathias
>>
>

Alexander Alexandrov

Re: CLI: wait-Flag to schedule multiple jobs in a script

The "wait" mode of execution seems to be the default now as of this commit:

https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c

2015-01-17 14:10 GMT+01:00 Mathias Peters <[hidden email]>:

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Yes but not at the current state.
I checked out, just before christmas last year and haven't merged yet.

Mathias

On 17.01.2015 13:53, Alexander Alexandrov wrote:
> Are you looking at the master (0.9-SNAPSHOT) branch?
>
> 2015-01-17 13:24 GMT+01:00 Mathias Peters
> <[hidden email]>:
>
> Hi,
>
> is there still a way to schedule jobs to the JobManager on after
> each other?
>
> I remember the "-w" flag in an earlier version for that. This seems
> to be gone now, though. How could one schedule jobs like that now?
>
> Thanks and regards Mathias
>>
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQEcBAEBAgAGBQJUul8qAAoJEHj0VWOtoCa7yR4IAKTqPgGrrzl7zjIR4+fs7kAl
GMHDICvCOo9PJEaK7fxUx6yY9PXK+LDUyEamoW8clzk5BDTDd7uhNmdL+N65FV7o
26GS354xqFtLEZEVGGGwJeBlboshtYkvsrEYYqId+e7qDysvRkOmgkwuPReqR4Qk
wLnLkwtfQ5GrspZYPY3HcTbfQOv697EjyoI9+C1fG+SV+R+f5yVkMgzoJyC0DF/J
iTZkwIt16K+fjjZiYh6EoQWW1d3QO+tA24s22dk9rQTxKFifxThLfHn6+ta8XdRJ
YwqR03SZJDsKEf+rFAF8MbDfCKN1odXB0In+u/jSqzJrPqCtYrRohjXdmGScibA=
=dfsJ
-----END PGP SIGNATURE-----

Mathias Peters

Re: CLI: wait-Flag to schedule multiple jobs in a script

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thanks for the reply.

I had some issues with running several jobs from a script yesterday.
The jobs at the end of the script failed due to a lack of processing
slots. I'll check the log files again, maybe there was another issue
with the first job.

Thanks
Mathias

On 17.01.2015 14:32, Alexander Alexandrov wrote:

> The "wait" mode of execution seems to be the default now as of this
> commit:
>
> https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c
>
> 2015-01-17 14:10 GMT+01:00 Mathias Peters
> <[hidden email]>:
>
> Yes but not at the current state. I checked out, just before
> christmas last year and haven't merged yet.
>
> Mathias
>
>
> On 17.01.2015 13:53, Alexander Alexandrov wrote:
>>>> Are you looking at the master (0.9-SNAPSHOT) branch?
>>>>
>>>> 2015-01-17 13:24 GMT+01:00 Mathias Peters
>>>> <[hidden email]>:
>>>>
>>>> Hi,
>>>>
>>>> is there still a way to schedule jobs to the JobManager on
>>>> after each other?
>>>>
>>>> I remember the "-w" flag in an earlier version for that. This
>>>> seems to be gone now, though. How could one schedule jobs
>>>> like that now?
>>>>
>>>> Thanks and regards Mathias
>>>>>
>>>>
>
>>
>

rmetzger0

Re: CLI: wait-Flag to schedule multiple jobs in a script

Stephan or Till can probably elaborate better on that, but maybe you need to add a "sleep 5" between submitting jobs. Maybe the slots are freed up lazily .. or the reporting of the free slots doesn't happen directly.

On Sat, Jan 17, 2015 at 3:00 PM, Mathias Peters <[hidden email]> wrote:

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thanks for the reply.

I had some issues with running several jobs from a script yesterday.
The jobs at the end of the script failed due to a lack of processing
slots. I'll check the log files again, maybe there was another issue
with the first job.

Thanks
Mathias

On 17.01.2015 14:32, Alexander Alexandrov wrote:
> The "wait" mode of execution seems to be the default now as of this
> commit:
>
> https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c
>
> 2015-01-17 14:10 GMT+01:00 Mathias Peters
> <[hidden email]>:
>
> Yes but not at the current state. I checked out, just before
> christmas last year and haven't merged yet.
>
> Mathias
>
>
> On 17.01.2015 13:53, Alexander Alexandrov wrote:
>>>> Are you looking at the master (0.9-SNAPSHOT) branch?
>>>>
>>>> 2015-01-17 13:24 GMT+01:00 Mathias Peters
>>>> <[hidden email]>:
>>>>
>>>> Hi,
>>>>
>>>> is there still a way to schedule jobs to the JobManager on
>>>> after each other?
>>>>
>>>> I remember the "-w" flag in an earlier version for that. This
>>>> seems to be gone now, though. How could one schedule jobs
>>>> like that now?
>>>>
>>>> Thanks and regards Mathias
>>>>>
>>>>
>
>>
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQEcBAEBAgAGBQJUumr2AAoJEHj0VWOtoCa7iSsIAKO8w2Q+1pKTJ4VXQ3jHMKx2
STJJGf+xM7Zty+vXbUN+4fLsPNyZoTJt8fmigZ3xxbwj5CbSC2IOpye2arlVVEXV
eFbb4ap3EOim7lZqGYTISNw7vPSTAmZdEvqJY6XNdSg3vVni70NbrEIKDe0rWnvE
K4P2/gTGQi0a5JUBwesjbTdKlGYNHjGztUbm/q97g1rNdcD/zb3J5+RgMpoyk37h
A7KmX1qjQepNUdbrotzPxvN9rmz5RTMNmURnBv/0u7lDopQOUE4t6HhUaZ94d18R
5UyOp7kPcuUSjmsx1kOYjCzZUsIsGi0dOtXv0PSDFFzFCjhoYO2MIEkNJh3W7nY=
=7B/P
-----END PGP SIGNATURE-----