FlinkKinesisProducer sends data to only 1 shard. Is it because I don't have "AggregationEnabled" set to false ?

Posted by Vijay Balakrishnan on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/FlinkKinesisProducer-sends-data-to-only-1-shard-Is-it-because-I-don-t-have-AggregationEnabled-set-to-tp35722.html

Hi,

My FlinkKinesisProducer sends data to only 1 shard. Is it because I don't have "AggregationEnabled" set to false ?

flink_connector_kinesis_2.11 : flink version 1.9.1

//Setup Kinesis Producer
        Properties kinesisProducerConfig = new Properties();
        kinesisProducerConfig.setProperty(AWSConfigConstants.AWS_REGION, region);
        kinesisProducerConfig.setProperty(AWSConfigConstants.AWS_CREDENTIALS_PROVIDER, "AUTO");
        //kinesisProducerConfig.setProperty("AggregationEnabled", "false");
       
        FlinkKinesisProducer<Map<String, Object>> kinesisProducer = new FlinkKinesisProducer<>(
                new MonitoringMapKinesisSchema(localKinesis), kinesisProducerConfig);

        //TODO: kinesisProducer.setFailOnError(true);
        kinesisProducer.setDefaultStream(kinesisTopicWrite);
        kinesisProducer.setDefaultPartition("0");//TODO: why from start ?
        return kinesisProducer;

TIA,