Flink Statefun Byte Ingress

Posted by Igal Shilman on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Statefun-Byte-Ingress-tp38289p38298.html

Hi Tim,

You are correct, currently the argument to a remote function must be a Protobuf Any, however StateFun doesn't interpret the contents of that Any, and it would be passed as-is to the remote function.

As you mentioned in your email you can interpret the bytes as the bytes of a JSON string.

I hope it helps,

Igal.

On Wed, Sep 23, 2020 at 5:06 AM Timothy Bess <[hidden email]> wrote:

Hi,

So most of the examples of "module.yaml" files I've seen focus on protobuf ingress, but is there a way to just get bytes from Kafka? I want to integrate this with the rest of my codebase which uses JSON, but don't want to migrate to protobuf just yet. I'm not totally sure how it would work since function arguments seem to be encoded as an Any type which is a protobuf type string + some bytes, I guess the string would need to be some made up constant value and I'd just grab the bytes? Honestly just using bytes like is done with the state value might be a bit more flexible to work with.

Thanks,

Tim