Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Hailu, Andreas

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class to jar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices
Reply | Threaded
Open this post in threaded view
|

Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Chesnay Schepler
I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.
Have you changed the Hadoop version you are using or how you provide them to Flink?

On 10/14/2020 6:56 PM, Hailu, Andreas wrote:

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class to jar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices


Reply | Threaded
Open this post in threaded view
|

RE: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Hailu, Andreas

Hi Chesnay, no, we haven’t changed our Hadoop version. The only changes were the update the 1.11.2 runtime dependencies listed earlier, as well as compiling with the flink-clients in some of our modules since we were relying  on the transitive dependency. Our 1.9.2 jobs are still able to run just fine, which is interesting.

 

// ah

 

From: Chesnay Schepler <[hidden email]>
Sent: Thursday, October 15, 2020 7:34 AM
To: Hailu, Andreas [Engineering] <[hidden email]>; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.

Have you changed the Hadoop version you are using or how you provide them to Flink?

 

On 10/14/2020 6:56 PM, Hailu, Andreas wrote:

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class to jar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices
Reply | Threaded
Open this post in threaded view
|

Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Chesnay Schepler
Can you provide us with the classpath (found at the top of the log file) for your 1.9.2/1.11.2 setups?
(to see whether maybe something has changed in regards to classpath ordering)

It would also be good to know what things were copied  from opt/ to lib/ or plugins/.
(to see whether some packaging change might affect you)

Is the Stacktrace from your attempt where you set rs-api to compileOnly, or from a previous attempt? (I assume you use gradle?)
Was the error the same in both cases?

@Leonared I noticed you handled a similar case on the Chinese ML in July, do you have any insights?

On 10/15/2020 7:51 PM, Hailu, Andreas wrote:

Hi Chesnay, no, we haven’t changed our Hadoop version. The only changes were the update the 1.11.2 runtime dependencies listed earlier, as well as compiling with the flink-clients in some of our modules since we were relying  on the transitive dependency. Our 1.9.2 jobs are still able to run just fine, which is interesting.

 

// ah

 

From: Chesnay Schepler [hidden email]
Sent: Thursday, October 15, 2020 7:34 AM
To: Hailu, Andreas [Engineering] [hidden email]; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.

Have you changed the Hadoop version you are using or how you provide them to Flink?

 

On 10/14/2020 6:56 PM, Hailu, Andreas wrote:

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class to jar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices


Reply | Threaded
Open this post in threaded view
|

RE: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Hailu, Andreas

Yes, we do we use Gradle. The stack trace is for both compileOnly and compile. Could you please elaborate on what you mean by copied from opt/, lib/ or plugins?

 

I’ve included both of our classpaths below. They’re somewhat lengthy, I’ve tried my best to format them to be easier to read :) You can see that the lion’s share of them are Hadoop 2.6 packages.

 

== Classpath on 1.9.2 ==

/local/scratch/tmp/p2epdlsuat/extract_temp_UIDM25XHKA225GWHS27Q8UZCEGF3A/flink-patches-3.6.4.1_rc1.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.9.2_bin_scala_2.11-1.9.2_standalone_2.11/flink_1.9.2_bin_scala_2.11/flink-1.9.2//lib/flink-dist_2.11-1.9.2.jar/gns/area/certified/external/org/apache/flink/flink/flink_1.9.2_bin_scala_2.11-1.9.2_standalone_2.11/flink_1.9.2_bin_scala_2.11/flink-1.9.2//lib/flink-table-blink_2.11-1.9.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.9.2_bin_scala_2.11-1.9.2_standalone_2.11/flink_1.9.2_bin_scala_2.11/flink-1.9.2//lib/flink-table_2.11-1.9.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.9.2_bin_scala_2.11-1.9.2_standalone_2.11/flink_1.9.2_bin_scala_2.11/flink-1.9.2//lib/log4j-1.2.17.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.9.2_bin_scala_2.11-1.9.2_standalone_2.11/flink_1.9.2_bin_scala_2.11/flink-1.9.2//lib/slf4j-log4j12-1.7.15.jar

/local/scratch/tmp/p2epdlsuat/extract_temp_UIDM25QX22225GWHS27Q8UZCEGF3A/flink-ingest-refiner-fat-shaded-3.6.4.1_rc1.jar

/home/p2epdlsuat/datalake-edc-nonprod/etc/flink/conf/lib/*

/home/p2epdlsuat/datalake-edc-nonprod/etc/hadoop/conf

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/azure-data-lake-store-sdk-2.1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-datalake-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-annotations-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-annotations.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-datalake.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-aws.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-auth-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-aws-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-auth.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-nfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-nfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/slf4j-api-1.7.10.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/azure-storage-5.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235-sources.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-kms-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/slf4j-log4j12-1.7.10.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-yarn-plugin-shim-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-core-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/joda-time-2.9.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-hdfs-plugin-shim-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235-javadoc.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ojdbc6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-s3-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-plugin-classloader-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/mockito-all-1.8.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-nfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-nfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/okhttp-2.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xercesImpl-2.9.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xml-apis-1.3.04.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-daemon-1.0.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/okio-1.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-rumen.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-app.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-httpclient-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-examples-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-distcp.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-gridmix-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-distcp-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/metrics-core-3.0.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-archives-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-core-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-extras.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-extras-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/okhttp-2.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-examples.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-auth-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-sls.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-ant-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-datajoin-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-streaming-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-ant.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-gridmix.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-rumen-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-auth.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-openstack.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/okio-1.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-streaming.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-archives.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-app-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-datajoin.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-sls-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-core.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/mockito-all-1.8.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-openstack-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/aopalliance-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/guice-servlet-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/guice-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/javax.inject-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-guice-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-registry-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-api-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-sharedcachemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-api.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-web-proxy.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-web-proxy-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-client.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-tests-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-client-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-nodemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-registry.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-nodemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/aopalliance-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/azure-storage-5.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-client-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/metrics-core-3.0.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guice-servlet-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guice-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/javax.inject-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/zookeeper-3.4.6.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-guice-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/javassist-3.18.1-GA.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/fst-2.24.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/objenesis-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-compress-1.4.1.jar

/gns/software/ep/da/dataproc/dataproc-prod/lakeRmProxy.jar

/afs/.@mount/gns-cdc-2.ny.fw.gs.com/d_0057078b7b.1ba3.0627.readonly/jre/lib/ext/JavaEngAgent.jar

/afs/.@mount/gns-cdc-2.ny.fw.gs.com/d_0057078b7b.1ba3.0627.readonly/jre/lib/ext/APGAgent.jar

 

== Classpath on 1.11.2 ==

flink-patches-LI_54-SNAPSHOT.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/log4j-api-2.12.1.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/log4j-slf4j-impl-2.12.1.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-table_2.11-1.11.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/log4j-1.2-api-2.12.1.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-table-blink_2.11-1.11.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/log4j-core-2.12.1.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-dist_2.11-1.11.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-csv-1.11.2.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-shaded-zookeeper-3.4.14.jar

/gns/area/certified/external/org/apache/flink/flink/flink_1.11.2_bin_scala_2.11-1.11.2_2.11/flink_1.11.2_bin_scala_2.11/flink-1.11.2//lib/flink-json-1.11.2.jar

flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar

/home/p2epdlsuat/datalake-edc-nonprod/etc/flink/conf/lib/*

/home/p2epdlsuat/datalake-edc-nonprod/etc/hadoop/conf

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/azure-data-lake-store-sdk-2.1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-datalake-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-annotations-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-annotations.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-azure-datalake.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-aws.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-auth-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-aws-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-auth.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-nfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-nfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/hadoop-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/slf4j-api-1.7.10.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/azure-storage-5.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235-sources.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-kms-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/slf4j-log4j12-1.7.10.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-yarn-plugin-shim-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-core-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/joda-time-2.9.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-hdfs-plugin-shim-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235-javadoc.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ojdbc6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/aws-java-sdk-s3-1.10.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/ranger-plugin-classloader-0.7.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/hadoop-lzo-0.6.0.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/mockito-all-1.8.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop/lib/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-nfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/hadoop-hdfs-nfs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/okhttp-2.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xercesImpl-2.9.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/xml-apis-1.3.04.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/commons-daemon-1.0.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/okio-1.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-rumen.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-app.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-httpclient-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-examples-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-distcp.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-gridmix-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-distcp-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/metrics-core-3.0.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-archives-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-core-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-extras.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-extras-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/okhttp-2.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-examples.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-auth-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-sls.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-ant-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-datajoin-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-streaming-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-ant.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-gridmix.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-rumen-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-auth.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-openstack.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/okio-1.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-streaming.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-archives.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-app-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-datajoin.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-sls-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-mapreduce-client-core.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/mockito-all-1.8.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/hadoop-openstack-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/aopalliance-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/junit-4.11.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/guice-servlet-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/hamcrest-core-1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/guice-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/javax.inject-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jersey-guice-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-mapreduce/lib/commons-compress-1.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-registry-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-api-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-sharedcachemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-api.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-web-proxy.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-web-proxy-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-client.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-tests-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-client-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-nodemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-registry.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-common-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-nodemanager-2.7.3.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/hadoop-yarn-server-common.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/aopalliance-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-beanutils-1.7.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/api-util-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-cli-1.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-math3-3.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-framework-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-digester-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-lang-2.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/avro-1.7.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/azure-storage-5.4.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guava-11.0.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-client-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/java-xmlbuilder-0.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsr305-3.0.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/activation-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-collections-3.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/metrics-core-3.0.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guice-servlet-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/log4j-1.2.17.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-core-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-net-3.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-json-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-server-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-databind-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-logging-1.1.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-configuration-1.6.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-io-2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-recipes-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsp-api-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/json-smart-1.1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/asm-3.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-annotations-2.2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/protobuf-java-2.5.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/snappy-java-1.0.4.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/curator-client-2.7.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/stax-api-1.0-2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/guice-3.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/servlet-api-2.5.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/xz-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/httpclient-4.5.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/httpcore-4.4.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/leveldbjni-all-1.8.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jets3t-0.9.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/javax.inject-1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/gson-2.2.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jsch-0.1.54.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-codec-1.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-xc-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jettison-1.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/xmlenc-0.52.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/zookeeper-3.4.6.2.6.3.0-235-tests.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-lang3-3.4.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/netty-3.6.2.Final.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-core-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/nimbus-jose-jwt-3.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jersey-guice-1.9.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jaxb-api-2.2.2.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/javassist-3.18.1-GA.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/fst-2.24.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/objenesis-2.1.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jetty-sslengine-6.1.26.hwx.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/jcip-annotations-1.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/paranamer-2.3.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/zookeeper-3.4.6.2.6.3.0-235.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/azure-keyvault-core-0.8.0.jar

/gns/software/infra/big-data/hadoop/hdp-2.6.3.0.0/hadoop-yarn/lib/commons-compress-1.4.1.jar

/gns/software/ep/da/dataproc/dataproc-prod/lakeRmProxy.jar

/afs/.@mount/gns-cdc-2.ny.fw.gs.com/d_0057078b7b.1ba3.0627.readonly/jre/lib/ext/JavaEngAgent.jar

/afs/.@mount/gns-cdc-2.ny.fw.gs.com/d_0057078b7b.1ba3.0627.readonly/jre/lib/ext/APGAgent.jar

 

// ah

 

From: Chesnay Schepler <[hidden email]>
Sent: Thursday, October 15, 2020 2:52 PM
To: Hailu, Andreas [Engineering] <[hidden email]>; [hidden email]
Cc: Leonard Xu <[hidden email]>
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

Can you provide us with the classpath (found at the top of the log file) for your 1.9.2/1.11.2 setups?

(to see whether maybe something has changed in regards to classpath ordering)

 

It would also be good to know what things were copied  from opt/ to lib/ or plugins/.

(to see whether some packaging change might affect you)

 

Is the Stacktrace from your attempt where you set rs-api to compileOnly, or from a previous attempt? (I assume you use gradle?)

Was the error the same in both cases?

 

@Leonared I noticed you handled a similar case on the Chinese ML in July, do you have any insights?

 

On 10/15/2020 7:51 PM, Hailu, Andreas wrote:

Hi Chesnay, no, we haven’t changed our Hadoop version. The only changes were the update the 1.11.2 runtime dependencies listed earlier, as well as compiling with the flink-clients in some of our modules since we were relying  on the transitive dependency. Our 1.9.2 jobs are still able to run just fine, which is interesting.

 

// ah

 

From: Chesnay Schepler [hidden email]
Sent: Thursday, October 15, 2020 7:34 AM
To: Hailu, Andreas [Engineering] [hidden email]; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.

Have you changed the Hadoop version you are using or how you provide them to Flink?

 

On 10/14/2020 6:56 PM, Hailu, Andreas wrote:

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class to jar:file:/local/data/scratch/hailua_p2epdlsuat/flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar!/javax/ws/rs/ext/RuntimeDelegate.class

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices
Reply | Threaded
Open this post in threaded view
|

Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Leonard Xu
In reply to this post by Chesnay Schepler
Hi, Chesnay

@Leonared I noticed you handled a similar case on the Chinese ML in July, do you have any insights?

The case in Chinese ML is the user added jakarta.ws.rs-api-3.0.0-M1.jar to Flink/lib which lead the dependency conflicts, Hailu’s case looks differently.

Hi @Hailu, 
The Hadoop dependency jersey-core-1.9.jar contains class javax.ws.rs.RuntimeDelegate,
the dependency javax.ws.rs:javax.ws.rs-api in your shaed jar also contains class javax.ws.rs.RuntimeDelegate,
I doubt the CastException come from here.

Best
Leonard




On 10/15/2020 7:51 PM, Hailu, Andreas wrote:
Hi Chesnay, no, we haven’t changed our Hadoop version. The only changes were the update the 1.11.2 runtime dependencies listed earlier, as well as compiling with the flink-clients in some of our modules since we were relying  on the transitive dependency. Our 1.9.2 jobs are still able to run just fine, which is interesting.
 
// ah
 
From: Chesnay Schepler [hidden email] 
Sent: Thursday, October 15, 2020 7:34 AM
To: Hailu, Andreas [Engineering] [hidden email]; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2
 
I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.
Have you changed the Hadoop version you are using or how you provide them to Flink?
 
On 10/14/2020 6:56 PM, Hailu, Andreas wrote:
Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:
 
        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]
        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]
        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]
        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]
        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]
        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]
        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]
        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]
 
I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.
Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:
1.       flink-dist_2.11-1.9.2.jar
2.       flink-table-blink_2.11-1.9.2.jar
3.       flink-table_2.11-1.9.2.jar
4.       log4j-1.2.17.jar
5.       slf4j-log4j12-1.7.15.jar
 
Whereas 1.11.2’s dependencies are:
1.       flink-dist_2.11-1.11.2.jar
2.       flink-table-blink_2.11-1.11.2.jar
3.       flink-table_2.11-1.11.2.jar
4.       log4j-1.2-api-2.12.1.jar
5.       log4j-api-2.12.1.jar
6.       log4j-core-2.12.1.jar
7.       log4j-slf4j-impl-2.12.1.jar
 
RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?
 
____________
 
Andreas Hailu
Data Lake Engineering | Goldman Sachs & Co.
 
 


Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices




Reply | Threaded
Open this post in threaded view
|

RE: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

Hailu, Andreas

Hi Leonard, Chesnay, thanks for having a look. I was able to sort this out -it was because of the change in default Class Loading policy becoming child-first introduced in 1.10 through  https://issues.apache.org/jira/browse/FLINK-13749 . Once I changed it back to parent-first, I was able to submit jobs.

 

Hopefully any other devs who have similar issues will find this thread useful J

 

// ah

 

From: Leonard Xu <[hidden email]>
Sent: Friday, October 16, 2020 1:10 AM
To: Chesnay Schepler <[hidden email]>
Cc: Hailu, Andreas [Engineering] <[hidden email]>; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

Hi, Chesnay

 

@Leonared I noticed you handled a similar case on the Chinese ML in July, do you have any insights?

 

The case in Chinese ML is the user added jakarta.ws.rs-api-3.0.0-M1.jar to Flink/lib which lead the dependency conflicts, Hailu’s case looks differently.

 

Hi @Hailu, 

The Hadoop dependency jersey-core-1.9.jar contains class javax.ws.rs.RuntimeDelegate,

the dependency javax.ws.rs:javax.ws.rs-api in your shaed jar also contains class javax.ws.rs.RuntimeDelegate,

I doubt the CastException come from here.

 

Best

Leonard

 

 

 



On 10/15/2020 7:51 PM, Hailu, Andreas wrote:

Hi Chesnay, no, we haven’t changed our Hadoop version. The only changes were the update the 1.11.2 runtime dependencies listed earlier, as well as compiling with the flink-clients in some of our modules since we were relying  on the transitive dependency. Our 1.9.2 jobs are still able to run just fine, which is interesting.

 

// ah

 

From: Chesnay Schepler [hidden email] 
Sent: Thursday, October 15, 2020 7:34 AM
To: Hailu, Andreas [Engineering] [hidden email]; [hidden email]
Subject: Re: Runtime Dependency Issues Upgrading to Flink 1.11.2 from 1.9.2

 

I'm not aware of any Flink module bundling this class. Note that this class is also bundled in jersey-core (which is also on your classpath), so it appears that there is a conflict between this jar and your shaded one.

Have you changed the Hadoop version you are using or how you provide them to Flink?

 

On 10/14/2020 6:56 PM, Hailu, Andreas wrote:

Hi team! We’re trying to upgrade our applications from 1.9.2 to 1.11.2. After re-compiling and updating our runtime dependencies to use 1.11.2, we see this LinkageError:

 

        at javax.ws.rs.ext.RuntimeDelegate.findDelegate(RuntimeDelegate.java:146) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.ext.RuntimeDelegate.getInstance(RuntimeDelegate.java:120) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at javax.ws.rs.core.MediaType.valueOf(MediaType.java:179) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.core.header.MediaTypes.<clinit>(MediaTypes.java:64) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:182) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:175) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.init(Client.java:342) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.access$000(Client.java:118) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:191) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client$1.f(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) ~[jersey-core-1.9.jar:1.9]

        at com.sun.jersey.api.client.Client.<init>(Client.java:187) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at com.sun.jersey.api.client.Client.<init>(Client.java:170) ~[flink-ingest-refiner-sandbox-SNAPSHOT-fat-shaded.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:285) ~[hadoop-yarn-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getTimelineDelegationToken(YarnClientImpl.java:355) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:331) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:250) ~[hadoop-yarn-client-2.7.3.2.6.3.0-235.jar:?]

        at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1002) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:524) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:424) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:70) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72) ~[flink-dist_2.11-1.11.2.jar:1.11.2]

 

I’ll note that the flink-ingest-refiner jar is our shaded JAR application that we use to submit jobs.

Looking into what dependencies have changed, on 1.9.2 our runtime dependencies from the available artifacts (sourced from one of the many mirrors)  are:

1.       flink-dist_2.11-1.9.2.jar

2.       flink-table-blink_2.11-1.9.2.jar

3.       flink-table_2.11-1.9.2.jar

4.       log4j-1.2.17.jar

5.       slf4j-log4j12-1.7.15.jar

 

Whereas 1.11.2’s dependencies are:

1.       flink-dist_2.11-1.11.2.jar

2.       flink-table-blink_2.11-1.11.2.jar

3.       flink-table_2.11-1.11.2.jar

4.       log4j-1.2-api-2.12.1.jar

5.       log4j-api-2.12.1.jar

6.       log4j-core-2.12.1.jar

7.       log4j-slf4j-impl-2.12.1.jar

 

RuntimeDelegate comes from the javax.ws.rs:javax.ws.rs-api module, which we use internally for some of our REST implementations. I’ve been trying a few things here to no avail such as declaring our dependency on rs-api as compileOnly. Curious to hear your thoughts. Was there a version change in one of the above listed 1.11.2 modules?

 

____________

 

Andreas Hailu

Data Lake Engineering | Goldman Sachs & Co.

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 

 



Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices

 

 

 




Your Personal Data: We may collect and process information about you that may be subject to data protection laws. For more information about how we use and disclose your personal data, how we protect your information, our legal basis to use your information, your rights and who you can contact, please refer to: www.gs.com/privacy-notices