[jira] [Resolved] (SPARK-3996) Shade Jetty in Spark deliverables

[ https://issues.apache.org/jira/browse/SPARK-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3996. Resolution: Fixed I've merged a new patch so closing this for now. > Shade Jetty

[jira] [Updated] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5197: --- Fix Version/s: (was: 1.3.0) > Support external shuffle service in fine-grained mode

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: 1.4.0 > Publish nightly snapshots of documentation, maven artifacts,

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.3.0) > Publish nightly snapshots of documentation, ma

[jira] [Commented] (SPARK-5492) Thread statistics can break with older Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298075#comment-14298075 ] Patrick Wendell commented on SPARK-5492: /cc [~sandyr] > Thread statist

[jira] [Updated] (SPARK-5492) Thread statistics can break with older Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5492: --- Priority: Blocker (was: Major) > Thread statistics can break with older Hadoop versi

[jira] [Created] (SPARK-5492) Thread statistics can break with older Hadoop versions

Patrick Wendell created SPARK-5492: -- Summary: Thread statistics can break with older Hadoop versions Key: SPARK-5492 URL: https://issues.apache.org/jira/browse/SPARK-5492 Project: Spark

[jira] [Reopened] (SPARK-3996) Shade Jetty in Spark deliverables

[ https://issues.apache.org/jira/browse/SPARK-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-3996: This was causing compiler failures in the master build, so I reverted it. I think it'

[jira] [Updated] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

[ https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3778: --- Priority: Critical (was: Major) > newAPIHadoopRDD doesn't properly pass credent

[jira] [Updated] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

[ https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3778: --- Target Version/s: 1.3.0 (was: 1.1.1, 1.2.0) > newAPIHadoopRDD doesn't prope

[jira] [Resolved] (SPARK-3996) Shade Jetty in Spark deliverables

[ https://issues.apache.org/jira/browse/SPARK-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3996. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Patrick Wendell (was

[jira] [Resolved] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5466. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Marcelo Vanzin Thanks

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296573#comment-14296573 ] Patrick Wendell commented on SPARK-5466: Okay Maven is reproducing this now

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Fix Version/s: 1.3.0 > Add Developer API to REPL to allow re-publishing the REPL

[jira] [Commented] (SPARK-4114) Use stable Hive API (if one exists) for communication with Metastore

[ https://issues.apache.org/jira/browse/SPARK-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296562#comment-14296562 ] Patrick Wendell commented on SPARK-4114: Dropping target version 1.3 becasu

[jira] [Updated] (SPARK-4628) Put external projects and examples behind a build flag

[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4628: --- Priority: Major (was: Blocker) > Put external projects and examples behind a build f

[jira] [Updated] (SPARK-4114) Use stable Hive API (if one exists) for communication with Metastore

[ https://issues.apache.org/jira/browse/SPARK-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4114: --- Target Version/s: (was: 1.3.0) > Use stable Hive API (if one exists) for communication w

[jira] [Updated] (SPARK-4628) Put external projects and examples behind a build flag

[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4628: --- Target Version/s: (was: 1.3.0) > Put external projects and examples behind a build f

[jira] [Resolved] (SPARK-2476) Have sbt-assembly include runtime dependencies in jar

[ https://issues.apache.org/jira/browse/SPARK-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2476. Resolution: Not a Problem [~srowen] Nope, I think we found a workaround. > Have

[jira] [Resolved] (SPARK-2487) Follow up from SBT build refactor (i.e. SPARK-1776)

[ https://issues.apache.org/jira/browse/SPARK-2487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2487. Resolution: Fixed > Follow up from SBT build refactor (i.e. SPARK-1

[jira] [Updated] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5466: --- Component/s: Build > Build Error caused by Guava shading in Sp

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296483#comment-14296483 ] Patrick Wendell commented on SPARK-5466: Also - [~srowen] can you reproduce

[jira] [Updated] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5466: --- Priority: Blocker (was: Major) > Build Error caused by Guava shading in Sp

[jira] [Commented] (SPARK-5466) Build Error caused by Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296482#comment-14296482 ] Patrick Wendell commented on SPARK-5466: I sent [~vanzin] and e-mail today a

[jira] [Comment Edited] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296479#comment-14296479 ] Patrick Wendell edited comment on SPARK-4049 at 1/29/15 6:5

[jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296479#comment-14296479 ] Patrick Wendell commented on SPARK-4049: [~skrasser] Yes - I agree that beha

[jira] [Resolved] (SPARK-5471) java.lang.NumberFormatException: For input string:

[ https://issues.apache.org/jira/browse/SPARK-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5471. Resolution: Not a Problem Resolving per your own comment

Re: spark akka fork : is the source anywhere?

It's maintained here: https://github.com/pwendell/akka/tree/2.2.3-shaded-proto Over time, this is something that would be great to get rid of, per rxin On Wed, Jan 28, 2015 at 3:33 PM, Reynold Xin wrote: > Hopefully problems like this will go away entirely in the next couple of > releases. http

[jira] [Resolved] (SPARK-1934) "this" reference escape to "selectorThread" during construction in ConnectionManager

[ https://issues.apache.org/jira/browse/SPARK-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1934. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sean Owen > &q

[jira] [Updated] (SPARK-5188) make-distribution.sh should support curl, not only wget to get Tachyon

[ https://issues.apache.org/jira/browse/SPARK-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5188: --- Fix Version/s: 1.3.0 > make-distribution.sh should support curl, not only wget to get Tach

[jira] [Resolved] (SPARK-5188) make-distribution.sh should support curl, not only wget to get Tachyon

[ https://issues.apache.org/jira/browse/SPARK-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5188. Resolution: Fixed Assignee: Kousuke Saruta > make-distribution.sh should support c

[jira] [Resolved] (SPARK-5458) Refer to aggregateByKey instead of combineByKey in docs

[ https://issues.apache.org/jira/browse/SPARK-5458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5458. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza > Refer

Re: [VOTE] Release Apache Spark 1.2.1 (RC2)

apache.org/jira/browse/SPARK-5144 > > Thanks, > Aniket > > On Wed Jan 28 2015 at 15:39:43 Patrick Wendell [via Apache Spark Developers > List] wrote: > >> Minor typo in the above e-mail - the tag is named v1.2.1-rc2 (not >> v1.2.1-rc1). >> >> On Wed, Jan 2

[jira] [Resolved] (SPARK-5144) spark-yarn module should be published

[ https://issues.apache.org/jira/browse/SPARK-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5144. Resolution: Duplicate > spark-yarn module should be publis

[jira] [Resolved] (SPARK-5415) Upgrade sbt to 0.13.7

[ https://issues.apache.org/jira/browse/SPARK-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5415. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Ryan Williams > Upgr

[jira] [Updated] (SPARK-5341) Support maven coordinates in spark-shell and spark-submit

[ https://issues.apache.org/jira/browse/SPARK-5341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5341: --- Priority: Critical (was: Major) > Support maven coordinates in spark-shell and spark-sub

Re: [VOTE] Release Apache Spark 1.2.1 (RC2)

Minor typo in the above e-mail - the tag is named v1.2.1-rc2 (not v1.2.1-rc1). On Wed, Jan 28, 2015 at 2:06 AM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.2.1! > > The tag to be voted on is v1.2.1-rc1 (commit b77f876): >

[VOTE] Release Apache Spark 1.2.1 (RC2)

Please vote on releasing the following candidate as Apache Spark version 1.2.1! The tag to be voted on is v1.2.1-rc1 (commit b77f876): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=b77f87673d1f9f03d4c83cf583158227c551359b The release files, including signatures, digests, etc. can

[RESULT] [VOTE] Release Apache Spark 1.2.1 (RC1)

t; 2.3. Decision Tree, Naive Bayes OK >> 2.4. KMeans OK >>Center And Scale OK >>Fixed : org.apache.spark.SparkException in zip ! >> 2.5. rdd operations OK >>State of the Union Texts - MapReduce, Filter,sortByKey (word count) >> 2.6. recomm

[jira] [Commented] (SPARK-5428) Declare the 'assembly' module at the bottom of the element in the parent POM

[ https://issues.apache.org/jira/browse/SPARK-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294935#comment-14294935 ] Patrick Wendell commented on SPARK-5428: [~tzolov] Do you mind explaining a

[jira] [Commented] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294928#comment-14294928 ] Patrick Wendell commented on SPARK-5420: How about just load and store

[jira] [Resolved] (SPARK-4809) Improve Guava shading in Spark

[ https://issues.apache.org/jira/browse/SPARK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4809. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Marcelo Vanzin > Impr

[jira] [Updated] (SPARK-5441) SerDeUtil Pair RDD to python conversion doesn't accept empty RDDs

[ https://issues.apache.org/jira/browse/SPARK-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5441: --- Target Version/s: 1.3.0 > SerDeUtil Pair RDD to python conversion doesn't accept em

[jira] [Updated] (SPARK-5441) SerDeUtil Pair RDD to python conversion doesn't accept empty RDDs

[ https://issues.apache.org/jira/browse/SPARK-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5441: --- Assignee: Michael Nazario > SerDeUtil Pair RDD to python conversion doesn't accept em

Friendly reminder/request to help with reviews!

Hey All, Just a reminder, as always around release time we have a very large volume of patches show up near the deadline. One thing that can help us maximize the number of patches we get in is to have community involvement in performing code reviews. And in particular, doing a thorough review and

[jira] [Resolved] (SPARK-5199) Input metrics should show up for InputFormats that return CombineFileSplits

[ https://issues.apache.org/jira/browse/SPARK-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5199. Resolution: Fixed Fix Version/s: 1.3.0 > Input metrics should show up

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

;> On Jan 27, 2015, at 11:35 AM, Patrick Wendell wrote: >> >> Hey Sean, >> >> Right now we don't publish every 2.11 binary to avoid combinatorial >> explosion of the number of build artifacts we publish (there are other >> parameters such as whether hive i

[jira] [Resolved] (SPARK-5299) Is http://www.apache.org/dist/spark/KEYS out of date?

[ https://issues.apache.org/jira/browse/SPARK-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5299. Resolution: Fixed Okay I've now added every key ever used to publish a Spark relea

[jira] [Reopened] (SPARK-5299) Is http://www.apache.org/dist/spark/KEYS out of date?

[ https://issues.apache.org/jira/browse/SPARK-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5299: Actually I need to deal with past releases as well, so re-opening. > Is http://www.apache.

[jira] [Resolved] (SPARK-5299) Is http://www.apache.org/dist/spark/KEYS out of date?

[ https://issues.apache.org/jira/browse/SPARK-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5299. Resolution: Fixed Thanks I've fixed this. > Is http://www.apache.org/dist/spark/

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

s, > > Sean > > >> On Jan 27, 2015, at 12:04 AM, Patrick Wendell wrote: >> >> Please vote on releasing the following candidate as Apache Spark version >> 1.2.1! >> >> The tag to be voted on is v1.2.1-rc1 (commit 3e

[jira] [Resolved] (SPARK-5308) MD5 / SHA1 hash format doesn't match standard Maven output

[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5308. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Assignee

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

hash > files that Maven didn't create: > > > true > > > As for the key issue, I think it's just a matter of uploading the new > key in both places. > > We should all of course test the release anyway. > > On Tue, Jan 27, 2015 at 5:55 PM, Patrick Wendell

Re: [VOTE] Release Apache Spark 1.2.1 (RC1)

9E4FE3AF, > 00799F7E) but only one is in http://www.apache.org/dist/spark/KEYS > > However, these artifacts seem to be signed by FC8ED089 which isn't in either. > > Details details, but I'd say non-binding -1 at the moment. > > > On Tue, Jan 27, 2015 at 7:02 AM,

[VOTE] Release Apache Spark 1.2.1 (RC1)

Please vote on releasing the following candidate as Apache Spark version 1.2.1! The tag to be voted on is v1.2.1-rc1 (commit 3e2d7d3): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=3e2d7d310b76c293b9ac787f204e6880f508f6ec The release files, including signatures, digests, etc. can

[jira] [Created] (SPARK-5420) Create cross-langauge load/store functions for creating and saving DataFrames

Patrick Wendell created SPARK-5420: -- Summary: Create cross-langauge load/store functions for creating and saving DataFrames Key: SPARK-5420 URL: https://issues.apache.org/jira/browse/SPARK-5420

[jira] [Updated] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5420: --- Summary: Cross-langauge load/store functions for creating and saving DataFrames (was: Create

[jira] [Updated] (SPARK-5052) com.google.common.base.Optional binary has a wrong method signatures

[ https://issues.apache.org/jira/browse/SPARK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5052: --- Assignee: Elmer Garduno > com.google.common.base.Optional binary has a wrong met

[jira] [Resolved] (SPARK-5052) com.google.common.base.Optional binary has a wrong method signatures

[ https://issues.apache.org/jira/browse/SPARK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5052. Resolution: Fixed Fix Version/s: 1.3.0 > com.google.common.base.Optional binary

Re: renaming SchemaRDD -> DataFrame

One thing potentially not clear from this e-mail, there will be a 1:1 correspondence where you can get an RDD to/from a DataFrame. On Mon, Jan 26, 2015 at 2:18 PM, Reynold Xin wrote: > Hi, > > We are considering renaming SchemaRDD -> DataFrame in 1.3, and wanted to > get the community's opinion.

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Fix Version/s: 1.2.1 1.3.0 > Reduce log4j depende

[jira] [Resolved] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4147. Resolution: Fixed > Reduce log4j depende

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Affects Version/s: 1.2.0 > Reduce log4j depende

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Assignee: Sean Owen > Reduce log4j depende

[jira] [Resolved] (SPARK-5339) build/mvn doesn't work because of invalid URL for maven's tgz.

[ https://issues.apache.org/jira/browse/SPARK-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5339. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta > build/

Upcoming Spark 1.2.1 RC

Hey All, I am planning to cut a 1.2.1 RC soon and wanted to notify people. There are a handful of important fixes in the 1.2.1 branch (http://s.apache.org/Mpn) particularly for Spark SQL. There was also an issue publishing some of our artifacts with 1.2.0 and this release would fix it for downstr

[jira] [Resolved] (SPARK-3958) Possible stream-corruption issues in TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3958. Resolution: Fixed Target Version/s: (was: 1.2.1) At this point I'm not awa

[jira] [Resolved] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4105. Resolution: Fixed Target Version/s: (was: 1.2.1) At this point I'm not awa

[jira] [Commented] (SPARK-4939) Python updateStateByKey example hang in local mode

[ https://issues.apache.org/jira/browse/SPARK-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286234#comment-14286234 ] Patrick Wendell commented on SPARK-4939: [~tdas] [~davies] [~kayouster

[jira] [Updated] (SPARK-4939) Python updateStateByKey example hang in local mode

[ https://issues.apache.org/jira/browse/SPARK-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4939: --- Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) > Python updateStateByKey example hang in lo

[jira] [Updated] (SPARK-5275) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5275: --- Fix Version/s: 1.2.1 1.3.0 > pyspark.streaming is not included in assem

Re: Standardized Spark dev environment

r directly, this will at least serve as an up-to-date list of packages/versions they should try to install locally in whatever environment they have. - Patrick On Wed, Jan 21, 2015 at 5:42 AM, Will Benton wrote: > - Original Message ----- >> From: "Patrick Wendell" >> T

Re: Standardized Spark dev environment

> If the goal is a reproducible test environment then I think that is what > Jenkins is. Granted you can only ask it for a test. But presumably you get > the same result if you start from the same VM image as Jenkins and run the > same steps. But the issue is when users can't reproduce Jenkins fai

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Assignee: Saisai Shao > File Streams do not work with custom key/val

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Fix Version/s: 1.3.0 > File Streams do not work with custom key/val

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Labels: backport-needed (was: ) > File Streams do not work with custom key/val

[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5297: --- Target Version/s: 1.3.0, 1.2.1 > File Streams do not work with custom key/val

Re: Standardized Spark dev environment

To respond to the original suggestion by Nick. I always thought it would be useful to have a Docker image on which we run the tests and build releases, so that we could have a consistent environment that other packagers or people trying to exhaustively run Spark tests could replicate (or at least l

[jira] [Updated] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4296: --- Fix Version/s: 1.2.1 1.3.0 > Throw "Expression not in GROUP BY&quo

[jira] [Commented] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285263#comment-14285263 ] Patrick Wendell commented on SPARK-4296: Note this was fixed in h

[jira] [Issue Comment Deleted] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Comment: was deleted (was: Note that in the 1.2 branch this was fixed by https://github.com

[jira] [Commented] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285262#comment-14285262 ] Patrick Wendell commented on SPARK-4959: Excuse my last comment, it was on

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: (was: 1.2.1) > Attributes are case sensitive when using a select qu

[jira] [Comment Edited] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285258#comment-14285258 ] Patrick Wendell edited comment on SPARK-4959 at 1/21/15 6:4

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: 1.2.1 > Attributes are case sensitive when using a select query fro

[jira] [Commented] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285258#comment-14285258 ] Patrick Wendell commented on SPARK-4959: Note that in the 1.2 branch this

[jira] [Resolved] (SPARK-5275) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5275. Resolution: Fixed Assignee: Davies Liu > pyspark.streaming is not included

[jira] [Updated] (SPARK-4996) Memory leak?

[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4996: --- Priority: Major (was: Blocker) > Memory leak? > > >

[jira] [Commented] (SPARK-4996) Memory leak?

[ https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285255#comment-14285255 ] Patrick Wendell commented on SPARK-4996: I'm de-escalating this right no

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Target Version/s: 1.3.0, 1.2.1 (was: 1.3.0) > Attributes are case sensitive when usin

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Assignee: Cheng Hao > Attributes are case sensitive when using a select query fro

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Fix Version/s: 1.3.0 > Attributes are case sensitive when using a select query fro

[jira] [Updated] (SPARK-4959) Attributes are case sensitive when using a select query from a projection

[ https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4959: --- Priority: Blocker (was: Critical) > Attributes are case sensitive when using a select qu

[jira] [Resolved] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4923. Resolution: Fixed Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) I updated the

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Assignee: Chip Senkbeil > Add Developer API to REPL to allow re-publishing the REPL

[jira] [Updated] (SPARK-4923) Add Developer API to REPL to allow re-publishing the REPL jar

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Summary: Add Developer API to REPL to allow re-publishing the REPL jar (was: Maven build

[jira] [Updated] (SPARK-5289) Backport publishing of repl, yarn into branch-1.2

[ https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5289: --- Fix Version/s: 1.2.1 > Backport publishing of repl, yarn into branch-

[jira] [Resolved] (SPARK-5276) pyspark.streaming is not included in assembly jar

[ https://issues.apache.org/jira/browse/SPARK-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5276. Resolution: Duplicate > pyspark.streaming is not included in assembly

[jira] [Resolved] (SPARK-5329) UIWorkloadGenerator should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5329. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta

[jira] [Updated] (SPARK-4660) JavaSerializer uses wrong classloader

[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4660: --- Assignee: Piotr Kołaczkowski > JavaSerializer uses wrong classloa

<    7   8   9   10   11   12   13   14   15   16   >