user driven stream processing

Posted by zanqing zhang on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/user-driven-stream-processing-tp16935.html

Hi All,

Has anyone done any stream processing driven by a user request? What's the recommended way of doing this? Or is this completely wrong direction to go for applications running on top of Flink?

Basically we need to tweak the stream processing based on parameters provided by a user, e.g. show me the total # of application failures due to "ABC", which is provided by the user. We are thinking of starting a flink job with "ABC" as a parameter but this would result in a huge number of flink jobs, is there a better way for this? Can we trigger the calculation on a running job?

Thanks in advance. 

KZ