error in using package SubnetUtils

[Diwakar Jha]

Hello,

I'm migrating from Flink 1.8 to Flink 1.11 on an EMR cluster and I get this error message for using package subnetUtils. Its working fine for Flink 1.8.

 [javac] import org.apache.flink.fs.s3presto.shaded.com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils;
    [javac]                                                                                                            ^
    [javac] /workplace/.../utility/IPAddressHelper.java:31: error: package SubnetUtils does not exist
    [javac]     public static final HashMap<String, List<SubnetUtils.SubnetInfo>>        IPS_MATCH = new HashMap<String, List<SubnetUtils.SubnetInfo>>() {{
    [javac]                                                         ^
    [javac] 2 errors

Anyone know about this error. Any pointers? 

Thanks.

[Arvid Heise-3]

Hi Diwakar,

we removed shading from s3 plugins in Flink 1.11. So the package should be com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils now.

But I strongly discourage you from using internally shaded libs. Rather use add apache-commons to your project as a proper dependent and use org.apache.commons.net.util.SubnetUtils.

On Tue, Nov 10, 2020 at 6:11 PM Diwakar Jha <[hidden email]> wrote:

Hello,

I'm migrating from Flink 1.8 to Flink 1.11 on an EMR cluster and I get this error message for using package subnetUtils. Its working fine for Flink 1.8.

 [javac] import org.apache.flink.fs.s3presto.shaded.com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils;
    [javac]                                                                                                            ^
    [javac] /workplace/.../utility/IPAddressHelper.java:31: error: package SubnetUtils does not exist
    [javac]     public static final HashMap<String, List<SubnetUtils.SubnetInfo>>        IPS_MATCH = new HashMap<String, List<SubnetUtils.SubnetInfo>>() {{
    [javac]                                                         ^
    [javac] 2 errors

Anyone know about this error. Any pointers? 

Thanks.

--

[Diwakar Jha]

Thank you, Arvid. i changed the import to com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils  and it worked. Also, I will add apache-commons to my project as you suggested.

Thanks.

On Wed, Nov 11, 2020 at 4:46 AM Arvid Heise <[hidden email]> wrote:

Hi Diwakar,

we removed shading from s3 plugins in Flink 1.11. So the package should be com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils now.

But I strongly discourage you from using internally shaded libs. Rather use add apache-commons to your project as a proper dependent and use org.apache.commons.net.util.SubnetUtils.

On Tue, Nov 10, 2020 at 6:11 PM Diwakar Jha <[hidden email]> wrote:

Hello,

I'm migrating from Flink 1.8 to Flink 1.11 on an EMR cluster and I get this error message for using package subnetUtils. Its working fine for Flink 1.8.

 [javac] import org.apache.flink.fs.s3presto.shaded.com.facebook.presto.hadoop.$internal.org.apache.commons.net.util.SubnetUtils;
    [javac]                                                                                                            ^
    [javac] /workplace/.../utility/IPAddressHelper.java:31: error: package SubnetUtils does not exist
    [javac]     public static final HashMap<String, List<SubnetUtils.SubnetInfo>>        IPS_MATCH = new HashMap<String, List<SubnetUtils.SubnetInfo>>() {{
    [javac]                                                         ^
    [javac] 2 errors

Anyone know about this error. Any pointers? 

Thanks.

--

Arvid Heise | Senior Java Developer

Follow us @VervericaData

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Toni) Cheng