Re: Filter Null in Array in SQL Connector
Posted by
Danny Chan-2 on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Filter-Null-in-Array-in-SQL-Connector-tp39607p39614.html
Can you also share your problematic json string here ? So that we can decide the specific error case cause.
Hi,
I recently discovered some of our data has NULL values arriving in an ARRAY<STRING> column. This column is being consumed by Flink via the Kafka connector Debezium format. We seem to be receiving NullPointerExceptions for when these NULL values in the arrays arrive which restarts the source operator in a loop.
Is there any way to not throw or to possibly filter out NULLs in an Array of Strings in Flink?
We're somewhat stuck on how to solve this problem, we'd like to be defensive about this on Flink's side.
Thanks!
(P.S. The exception was not that informative, there may be room for improvement in terms of a richer error message when this happens.)