also, i thought scala 2.10 was binary compatible, but does not seem to be the case. the spark artifacts for scala 2.10.4 dont work for me, since we are still on scala 2.10.3, but when i recompiled and published spark with scala 2.10.3 everything was fine again.
errors i see: java.lang.ClassNotFoundException: scala.None$ fun stuff! On Sun, Apr 6, 2014 at 12:13 PM, Koert Kuipers <ko...@tresata.com> wrote: > patrick, > this has happened before, that a commit introduced java 7 > code/dependencies and your build didnt fail, i think it was when reynold > upgraded to jetty 9. must be that your entire build infrastructure runs > java 7... > > > On Sat, Apr 5, 2014 at 6:06 PM, Patrick Wendell <pwend...@gmail.com>wrote: > >> If you want to submit a hot fix for this issue specifically please do. I'm >> not sure why it didn't fail our build... >> >> >> On Sat, Apr 5, 2014 at 2:30 PM, Debasish Das <debasish.da...@gmail.com >> >wrote: >> >> > I verified this is happening for both CDH4.5 and 1.0.4...My deploy >> > environment is Java 6...so Java 7 compilation is not going to help... >> > >> > Is this the PR which caused it ? >> > >> > Andre Schumacher >> > >> > fbebaed Spark parquet improvements A few improvements to the >> Parquet >> > support for SQL queries: - Instead of files a ParquetRelation is now >> backed >> > by a directory, which simplifies importing data from other sources - >> > InsertIntoParquetTable operation now supports switching between >> overwriting >> > or appending (at least in HiveQL) - tests now use the new API - Parquet >> > logging can be set to WARNING level (Default) - Default compression for >> > Parquet files (GZIP, as in parquet-mr) Author: Andre Schumacher &... >> 2 >> > days ago SPARK-1383 >> > >> > I will go to a stable checkin before this >> > >> > >> > >> > >> > On Sat, Apr 5, 2014 at 2:22 PM, Debasish Das <debasish.da...@gmail.com >> > >wrote: >> > >> > > I can compile with Java 7...let me try that... >> > > >> > > >> > > On Sat, Apr 5, 2014 at 2:19 PM, Sean Owen <so...@cloudera.com> wrote: >> > > >> > >> That method was added in Java 7. The project is on Java 6, so I think >> > >> this was just an inadvertent error in a recent PR (it was the 'Spark >> > >> parquet improvements' one). >> > >> >> > >> I'll open a hot-fix PR after looking for other stuff like this that >> > >> might have snuck in. >> > >> -- >> > >> Sean Owen | Director, Data Science | London >> > >> >> > >> >> > >> On Sat, Apr 5, 2014 at 10:04 PM, Debasish Das < >> debasish.da...@gmail.com >> > > >> > >> wrote: >> > >> > I am synced with apache/spark master but getting error in spark/sql >> > >> > compilation... >> > >> > >> > >> > Is the master broken ? >> > >> > >> > >> > [info] Compiling 34 Scala sources to >> > >> > /home/debasish/spark_deploy/sql/core/target/scala-2.10/classes... >> > >> > [error] >> > >> > >> > >> >> > >> /home/debasish/spark_deploy/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetRelation.scala:106: >> > >> > value getGlobal is not a member of object java.util.logging.Logger >> > >> > [error] logger.setParent(Logger.getGlobal) >> > >> > [error] ^ >> > >> > [error] one error found >> > >> > [error] (sql/compile:compile) Compilation failed >> > >> > [error] Total time: 171 s, completed Apr 5, 2014 4:58:41 PM >> > >> > >> > >> > Thanks. >> > >> > Deb >> > >> >> > > >> > > >> > >> > >
