Kafka+Flink

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Kafka+Flink

Vinaya M S
Hi,

I have a 3 node kafka cluster. In server.properties file of each of them I'm setting
 advertisedhost.name: to its IP.

I have 4 node flink cluster. In each of kaka's node I'm setting 
host.name: to one of link's worker node.

like,

in kafka1:
host.name:  flink-data1IP

in kafka2:
host.name: flink-data2 IP

in kafka3:
host.name: flink-data3 IP

My question is, 
In order to connect to kafka how should my conf/producer.yaml look like?

kafka.brokers: ??

zookeeper.servers: ??

kafka.port: 9092
zookeeper.port: 2181

kafka.topic: "xxxx"
kafka.partitions: 1

Thanks,
Vinaya


Reply | Threaded
Open this post in threaded view
|

Re: Kafka+Flink

rmetzger0
Hi Vinaya,

this blog post explains how to connect Flink and Kafka: http://data-artisans.com/kafka-flink-a-practical-how-to/

On Thu, Jan 28, 2016 at 1:28 AM, Vinaya M S <[hidden email]> wrote:
Hi,

I have a 3 node kafka cluster. In server.properties file of each of them I'm setting
 advertisedhost.name: to its IP.

I have 4 node flink cluster. In each of kaka's node I'm setting 
host.name: to one of link's worker node.

like,

in kafka1:
host.name:  flink-data1IP

in kafka2:
host.name: flink-data2 IP

in kafka3:
host.name: flink-data3 IP

My question is, 
In order to connect to kafka how should my conf/producer.yaml look like?

kafka.brokers: ??

zookeeper.servers: ??

kafka.port: 9092
zookeeper.port: 2181

kafka.topic: "xxxx"
kafka.partitions: 1

Thanks,
Vinaya