How best to deal with wide, structured tuples?

Hi all, I currently find myself evaluating a use case, where I have to deal with wide (i.e. about 50-60 columns, definitely more than the 25 supported by the Tuple types), structured data from CSV files, with a potentially dynamically (during runtime) generated (or automatically inferred from the

Re: compile flink-gelly-scala using sbt

Are you using 0.10-SNAPSHOT for this? Because in 0.9.1 this method (getJavaEnv()) indeed doesn't exist ;) On 28 October 2015 at 16:51, Le Quoc Do wrote: > From Graph.scala: > > * def fromDataSet[K: TypeInformation : ClassTag, EV: TypeInformation : > ClassTag]* > * (edges: DataSet[Edge[K, EV]],

Re: compile flink-gelly-scala using sbt

>From Graph.scala: * def fromDataSet[K: TypeInformation : ClassTag, EV: TypeInformation : ClassTag]* * (edges: DataSet[Edge[K, EV]], env: ExecutionEnvironment): Graph[K, NullValue, EV] = {* *wrapGraph(jg.Graph.fromDataSet[K, EV](edges.javaSet, env.getJavaEnv))* * }* ==

Re: compile flink-gelly-scala using sbt

Could you share a minimal code example where this happens? On Wed, Oct 28, 2015 at 4:22 PM, Le Quoc Do wrote: > Hi Theodore and Vasia, > > Thanks for your reply. > > I can compile my code by add dependency jars manually. > > Yes, in my code, I already import Flink-scala (import > org.apache.fli

Re: compile flink-gelly-scala using sbt

Hi Theodore and Vasia, Thanks for your reply. I can compile my code by add dependency jars manually. Yes, in my code, I already import Flink-scala (import org.apache.flink.api.scala._). However when I run my code, I get the following error: *ava.lang.NoSuchMethodError: org.apache.flink.api.scal

Re: compile flink-gelly-scala using sbt

Your build.sbt seems correct. It might be that you are missing some basic imports. In your code have you imported import org.apache.flink.api.scala._ ? On Tue, Oct 27, 2015 at 8:45 PM, Vasiliki Kalavri wrote: > Hi Do, > > I don't really have experience with sbt, but one thing that might caus

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Thanks Theodore. I can confirm that Anwar solution worked. My build.sbt looks like: libraryDependencies ++= Seq( "org.scalanlp" %% "breeze" % "0.11.2", "org.scalanlp" %% "breeze-natives" % "0.11.2", "org.scalanlp" %% "breeze-viz" % "0.11.2" ) libraryDependencies ++= Seq("org.apache.flink"

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

This sounds similar to this problem: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-ML-as-Dependency-td1582.html The reason is (quoting Till, replace gradle with sbt here): the flink-ml pom contains as a dependency an artifact with artifactId > breeze_${scala.binary.ver

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Thank you Anwar! That did the trick :) On Wed, Oct 28, 2015 at 1:30 PM, Anwar Rizal wrote: > Yeah > > I had similar problems with kafka in spark streaming. I worked around the > problem by excluding kafka from connector and then adding the library back. > > Maybe you can try something like:

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Yeah I had similar problems with kafka in spark streaming. I worked around the problem by excluding kafka from connector and then adding the library back. Maybe you can try something like: libraryDependencies ++= Seq("org.apache.flink" % "flink-scala" % "0.9.1", "org.apache.flink" % "flink-c

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

I tried adding libraryDependencies += "org.scalanlp" % "breeze_2.10" % "0.11.2" but the problem persist. I also tried as explained in the Breeze documentation: libraryDependencies ++= Seq( "org.scalanlp" %% "breeze" % "0.11.2", "org.scalanlp" %% "breeze-natives" % "0.11.2", "org.scalanlp"

Re: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Can you add libraryDependencies += "org.scalanlp" % "breeze_2.10" % "0.11.2" also ? Devan M.S. | Technical Lead | Cyber Security | AMRITA VISHWA VIDYAPEETHAM | Amritapuri | Cell +919946535290 | [image: View DEVAN M S's profile on LinkedIn] On

Fwd: Scala Breeze Dependencies not resolving when adding flink-ml on build.sbt

Hi, I am getting an error when adding flink-ml to the libraryDependencies on my build.sbt file: [error] (*:update) sbt.ResolveException: unresolved dependency: org.scalanlp#breeze_${scala.binary.version};0.11.2: not found My libraryDependencies is: libraryDependencies ++= Seq("org.apache.flink"