(DEPRECATED) Apache Flink User Mailing List archive.

Avro from avrohugger still invalid

classic Classic list List threaded Threaded
♦
♦
 7 messages Options
Georg Heiler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Avro from avrohugger still invalid

Georg Heiler
Older versions of flink were incompatible with the Scala specific record classes generated from AvroHugger.

https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10 apparently is fixing this. I am currently using 1.10.1. However, still experience thus problem https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde of:

AvroRuntimeException: Not a Specific class

What is still wrong here?

Best,
Georg
Till Rohrmann
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Till Rohrmann
Hi Georg,

I'm pulling in Aljoscha who might know more about the problem you are describing.

Cheers,
Till

On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <[hidden email]> wrote:
Older versions of flink were incompatible with the Scala specific record classes generated from AvroHugger.

https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10 apparently is fixing this. I am currently using 1.10.1. However, still experience thus problem https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde of:

AvroRuntimeException: Not a Specific class

What is still wrong here?

Best,
Georg
Aljoscha Krettek
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Aljoscha Krettek
Hi Georg,

unfortunately, it seems I only fixed the issue for AvroSerializer and
not for AvroDeserializationSchema. I created a new issue (which is a
clone of the old one) to track this [1]. The fix should be very simple
since it's the same issue.

Best,
Aljoscha

[1] https://issues.apache.org/jira/browse/FLINK-18478

On 01.07.20 09:11, Till Rohrmann wrote:

> Hi Georg,
>
> I'm pulling in Aljoscha who might know more about the problem you are
> describing.
>
> Cheers,
> Till
>
> On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <[hidden email]>
> wrote:
>
>> Older versions of flink were incompatible with the Scala specific record
>> classes generated from AvroHugger.
>>
>> https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10 apparently
>> is fixing this. I am currently using 1.10.1. However, still experience thus
>> problem
>> https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde
>> of:
>>
>> AvroRuntimeException: Not a Specific class
>>
>> What is still wrong here?
>>
>> Best,
>>
>> Georg
>>
>>
>

Georg Heiler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Georg Heiler
What is the suggested workaround for now?


Thanks!

Aljoscha Krettek <[hidden email]> schrieb am Do. 2. Juli 2020 um 20:55:
Hi Georg,

unfortunately, it seems I only fixed the issue for AvroSerializer and
not for AvroDeserializationSchema. I created a new issue (which is a
clone of the old one) to track this [1]. The fix should be very simple
since it's the same issue.

Best,
Aljoscha

[1] https://issues.apache.org/jira/browse/FLINK-18478

On 01.07.20 09:11, Till Rohrmann wrote:
> Hi Georg,
>
> I'm pulling in Aljoscha who might know more about the problem you are
> describing.
>
> Cheers,
> Till
>
> On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <[hidden email]>
> wrote:
>
>> Older versions of flink were incompatible with the Scala specific record
>> classes generated from AvroHugger.
>>
>> https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10 apparently
>> is fixing this. I am currently using 1.10.1. However, still experience thus
>> problem
>> https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde
>> of:
>>
>> AvroRuntimeException: Not a Specific class
>>
>> What is still wrong here?
>>
>> Best,
>>
>> Georg
>>
>>
>

Georg Heiler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Georg Heiler
But would it be possible to somehow use AvroSerializer for now?

Best,
Georg

Am Do., 2. Juli 2020 um 23:44 Uhr schrieb Georg Heiler <[hidden email]>:
What is the suggested workaround for now?


Thanks!

Aljoscha Krettek <[hidden email]> schrieb am Do. 2. Juli 2020 um 20:55:
Hi Georg,

unfortunately, it seems I only fixed the issue for AvroSerializer and
not for AvroDeserializationSchema. I created a new issue (which is a
clone of the old one) to track this [1]. The fix should be very simple
since it's the same issue.

Best,
Aljoscha

[1] https://issues.apache.org/jira/browse/FLINK-18478

On 01.07.20 09:11, Till Rohrmann wrote:
> Hi Georg,
>
> I'm pulling in Aljoscha who might know more about the problem you are
> describing.
>
> Cheers,
> Till
>
> On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <[hidden email]>
> wrote:
>
>> Older versions of flink were incompatible with the Scala specific record
>> classes generated from AvroHugger.
>>
>> https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10 apparently
>> is fixing this. I am currently using 1.10.1. However, still experience thus
>> problem
>> https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde
>> of:
>>
>> AvroRuntimeException: Not a Specific class
>>
>> What is still wrong here?
>>
>> Best,
>>
>> Georg
>>
>>
>

Aljoscha Krettek
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Aljoscha Krettek
Hi,

I don't think there's a workaround, except copying the code and manually
fixing it. Did you check out my comment on the Jira issue and the new
one I created?

Best,
Aljoscha

On 03.07.20 07:19, Georg Heiler wrote:

> But would it be possible to somehow use AvroSerializer for now?
>
> Best,
> Georg
>
> Am Do., 2. Juli 2020 um 23:44 Uhr schrieb Georg Heiler <
> [hidden email]>:
>
>> What is the suggested workaround for now?
>>
>>
>> Thanks!
>>
>> Aljoscha Krettek <[hidden email]> schrieb am Do. 2. Juli 2020 um
>> 20:55:
>>
>>> Hi Georg,
>>>
>>> unfortunately, it seems I only fixed the issue for AvroSerializer and
>>> not for AvroDeserializationSchema. I created a new issue (which is a
>>> clone of the old one) to track this [1]. The fix should be very simple
>>> since it's the same issue.
>>>
>>> Best,
>>> Aljoscha
>>>
>>> [1] https://issues.apache.org/jira/browse/FLINK-18478
>>>
>>> On 01.07.20 09:11, Till Rohrmann wrote:
>>>> Hi Georg,
>>>>
>>>> I'm pulling in Aljoscha who might know more about the problem you are
>>>> describing.
>>>>
>>>> Cheers,
>>>> Till
>>>>
>>>> On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <
>>> [hidden email]>
>>>> wrote:
>>>>
>>>>> Older versions of flink were incompatible with the Scala specific
>>> record
>>>>> classes generated from AvroHugger.
>>>>>
>>>>> https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10
>>> apparently
>>>>> is fixing this. I am currently using 1.10.1. However, still experience
>>> thus
>>>>> problem
>>>>>
>>> https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde
>>>>> of:
>>>>>
>>>>> AvroRuntimeException: Not a Specific class
>>>>>
>>>>> What is still wrong here?
>>>>>
>>>>> Best,
>>>>>
>>>>> Georg
>>>>>
>>>>>
>>>>
>>>
>>>
>

Georg Heiler
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Avro from avrohugger still invalid

Georg Heiler
Hi,

Many thanks for the PR!
However, I have tried to build an updated version of Flink and still run into issues.

I have documented in a GIST (see the last comment) how to replicate it.

Best,
Georg

Am Fr., 3. Juli 2020 um 12:00 Uhr schrieb Aljoscha Krettek <[hidden email]>:
Hi,

I don't think there's a workaround, except copying the code and manually
fixing it. Did you check out my comment on the Jira issue and the new
one I created?

Best,
Aljoscha

On 03.07.20 07:19, Georg Heiler wrote:
> But would it be possible to somehow use AvroSerializer for now?
>
> Best,
> Georg
>
> Am Do., 2. Juli 2020 um 23:44 Uhr schrieb Georg Heiler <
> [hidden email]>:
>
>> What is the suggested workaround for now?
>>
>>
>> Thanks!
>>
>> Aljoscha Krettek <[hidden email]> schrieb am Do. 2. Juli 2020 um
>> 20:55:
>>
>>> Hi Georg,
>>>
>>> unfortunately, it seems I only fixed the issue for AvroSerializer and
>>> not for AvroDeserializationSchema. I created a new issue (which is a
>>> clone of the old one) to track this [1]. The fix should be very simple
>>> since it's the same issue.
>>>
>>> Best,
>>> Aljoscha
>>>
>>> [1] https://issues.apache.org/jira/browse/FLINK-18478
>>>
>>> On 01.07.20 09:11, Till Rohrmann wrote:
>>>> Hi Georg,
>>>>
>>>> I'm pulling in Aljoscha who might know more about the problem you are
>>>> describing.
>>>>
>>>> Cheers,
>>>> Till
>>>>
>>>> On Mon, Jun 29, 2020 at 10:21 PM Georg Heiler <
>>> [hidden email]>
>>>> wrote:
>>>>
>>>>> Older versions of flink were incompatible with the Scala specific
>>> record
>>>>> classes generated from AvroHugger.
>>>>>
>>>>> https://issues.apache.org/jira/browse/FLINK-12501 Flink 1.10
>>> apparently
>>>>> is fixing this. I am currently using 1.10.1. However, still experience
>>> thus
>>>>> problem
>>>>>
>>> https://stackoverflow.com/questions/62637009/flink-use-confluent-schema-registry-for-avro-serde
>>>>> of:
>>>>>
>>>>> AvroRuntimeException: Not a Specific class
>>>>>
>>>>> What is still wrong here?
>>>>>
>>>>> Best,
>>>>>
>>>>> Georg
>>>>>
>>>>>
>>>>
>>>
>>>
>

Free forum by Nabble Edit this page