(DEPRECATED) Apache Flink User Mailing List archive.

Flink-ML as Dependency

classic Classic list List threaded Threaded
♦
♦
 7 messages Options
Maximilian Alber
Reply | Threaded
Open this post in threaded view
♦
♦
|

Flink-ML as Dependency

Maximilian Alber
Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: <a href="http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom">http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max
Till Rohrmann-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Till Rohrmann-2

Hi Max,

I think the reason is that the flink-ml pom contains as a dependency an artifact with artifactId breeze_${scala.binary.version}. The variable scala.binary.version is defined in the parent pom and not substituted when flink-ml is installed. Therefore gradle tries to find a dependency with the name breeze_${scala.binary.version}.

I try to find a solution for this problem. As a quick work around you should be able to define the variable manually and set it to 2.10.

Cheers,
Till

​

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber <[hidden email]> wrote:
Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max
Maximilian Alber
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Maximilian Alber
Hi Till,

Thanks for the quick help!

Cheers,
Max

On Wed, Jun 10, 2015 at 5:50 PM, Till Rohrmann <[hidden email]> wrote:

Hi Max,

I think the reason is that the flink-ml pom contains as a dependency an artifact with artifactId breeze_${scala.binary.version}. The variable scala.binary.version is defined in the parent pom and not substituted when flink-ml is installed. Therefore gradle tries to find a dependency with the name breeze_${scala.binary.version}.

I try to find a solution for this problem. As a quick work around you should be able to define the variable manually and set it to 2.10.

Cheers,
Till

​

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber <[hidden email]> wrote:
Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max
Till Rohrmann
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Till Rohrmann
In reply to this post by Maximilian Alber

Hi Max,

I just tested a build using gradle (with your build.gradle file) and some flink-ml algorithms. And it was completed without the problem of the unresolved breeze dependency.

I use the version 2.2.1 of Gradle. Which version are you using?

Since you’re using Flink’s snapshots and have specified only the local maven repository, can you re-install flink again and check whether the error still occurs? Simple call mvn clean install -DskipTests -Dmaven.javadoc.skip=true from the root directory of Flink.

Cheers,
Till

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber alber.maximilian@... wrote:

Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max

​
Maximilian Alber
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Maximilian Alber
Hi Till,

I use the standard one for Ubuntu 15.04, which is 1.5.

That did not make any difference.

Thanks and Cheers,
Max

On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <[hidden email]> wrote:

Hi Max,

I just tested a build using gradle (with your build.gradle file) and some flink-ml algorithms. And it was completed without the problem of the unresolved breeze dependency.

I use the version 2.2.1 of Gradle. Which version are you using?

Since you’re using Flink’s snapshots and have specified only the local maven repository, can you re-install flink again and check whether the error still occurs? Simple call mvn clean install -DskipTests -Dmaven.javadoc.skip=true from the root directory of Flink.

Cheers,
Till

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber alber.maximilian@... wrote:

Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max

​
Till Rohrmann-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Till Rohrmann-2
Hmm then I assume that version 2 can properly handle maven property variables.

On Thu, Jun 11, 2015 at 3:05 PM Maximilian Alber <[hidden email]> wrote:
Hi Till,

I use the standard one for Ubuntu 15.04, which is 1.5.

That did not make any difference.

Thanks and Cheers,
Max

On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <[hidden email]> wrote:

Hi Max,

I just tested a build using gradle (with your build.gradle file) and some flink-ml algorithms. And it was completed without the problem of the unresolved breeze dependency.

I use the version 2.2.1 of Gradle. Which version are you using?

Since you’re using Flink’s snapshots and have specified only the local maven repository, can you re-install flink again and check whether the error still occurs? Simple call mvn clean install -DskipTests -Dmaven.javadoc.skip=true from the root directory of Flink.

Cheers,
Till

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber alber.maximilian@... wrote:

Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max

​
Maximilian Alber
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Flink-ML as Dependency

Maximilian Alber
Well then, I should update ;-)

On Thu, Jun 11, 2015 at 4:01 PM, Till Rohrmann <[hidden email]> wrote:
Hmm then I assume that version 2 can properly handle maven property variables.


On Thu, Jun 11, 2015 at 3:05 PM Maximilian Alber <[hidden email]> wrote:
Hi Till,

I use the standard one for Ubuntu 15.04, which is 1.5.

That did not make any difference.

Thanks and Cheers,
Max

On Thu, Jun 11, 2015 at 11:22 AM, Till Rohrmann <[hidden email]> wrote:

Hi Max,

I just tested a build using gradle (with your build.gradle file) and some flink-ml algorithms. And it was completed without the problem of the unresolved breeze dependency.

I use the version 2.2.1 of Gradle. Which version are you using?

Since you’re using Flink’s snapshots and have specified only the local maven repository, can you re-install flink again and check whether the error still occurs? Simple call mvn clean install -DskipTests -Dmaven.javadoc.skip=true from the root directory of Flink.

Cheers,
Till

On Wed, Jun 10, 2015 at 3:38 PM Maximilian Alber alber.maximilian@... wrote:

Hi Flinksters,

I would like to test FlinkML. Unfortunately, I get an error when including it to my project. It might be my error as I'm not experienced with Gradle, but with Google I got any wiser.

My build.gradle looks as follows:

apply plugin: 'java'
apply plugin: 'scala'

//sourceCompatibility = 1.5
version = '1.0'
jar {
    manifest {
        attributes 'Implementation-Title': 'Test Project',
                   'Implementation-Version': 1.0
    }
}

repositories {
  mavenCentral()
  mavenLocal()
}

dependencies {
  compile 'org.scala-lang:scala-library:2.10.5'
  compile 'org.scala-lang:scala-compiler:2.10.5'

  compile 'org.scalanlp:breeze_2.10:0.11.2'

  compile group: 'org.apache.flink', name: 'flink-clients', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-scala', version: '0.9-SNAPSHOT'
  compile group: 'org.apache.flink', name: 'flink-ml', version: '0.9-SNAPSHOT'
}

And I get the following error:

alber@alberTU:/media/alber/datadisk/tmp/flink/code/test$ gradle compileScala
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar

FAILURE: Build failed with an exception.

* What went wrong:
Could not resolve all dependencies for configuration ':compile'.
> Could not resolve org.scalanlp:breeze_${scala.binary.version}:0.11.2.
  Required by:
      :test:1.0 > org.apache.flink:flink-ml:0.9-SNAPSHOT
   > Illegal character in path at index 51: http://repo1.maven.org/maven2/org/scalanlp/breeze_${scala.binary.version}/0.11.2/breeze_${scala.binary.version}-0.11.2.pom

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 7.113 secs


I'm thankful for any ideas!

Cheers,
Max

​
Free forum by Nabble Edit this page