[jira] [Resolved] (SPARK-6922) RDD.cartesian is much slower than join

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6922. -- Resolution: Duplicate Yes, a likely subset of SPARK-6307. I'm closing this since I don't see it's

[jira] [Commented] (SPARK-12947) Spark with Swift throws EOFException when reading parquet file

2016-01-23 Thread Sam Stoelinga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113641#comment-15113641 ] Sam Stoelinga commented on SPARK-12947: --- I'm using Ceph with Swift compatible front-end. It's

[jira] [Resolved] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12883. --- Resolution: Not A Problem > 1.6 Dynamic allocation document for removing executors with cached data

[jira] [Resolved] (SPARK-6539) SparkContext throws NullPointerException

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6539. -- Resolution: Won't Fix > SparkContext throws NullPointerException >

[jira] [Resolved] (SPARK-6875) Add support for Joda-time types

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6875. -- Resolution: Won't Fix Although Joda is a pretty standard lib, it's also one of many third party

[jira] [Resolved] (SPARK-12933) Initial count-min sketch implementation

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12933. - Resolution: Fixed Fix Version/s: 2.0.0 > Initial count-min sketch implementation >

[jira] [Comment Edited] (SPARK-12947) Spark with Swift throws EOFException when reading parquet file

2016-01-23 Thread Sam Stoelinga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113641#comment-15113641 ] Sam Stoelinga edited comment on SPARK-12947 at 1/23/16 9:16 AM: I'm using

[jira] [Updated] (SPARK-12760) inaccurate description for difference between local vs cluster mode in closure handling

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12760: -- Assignee: Mortada Mehyar > inaccurate description for difference between local vs cluster mode in >

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-23 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113656#comment-15113656 ] Ahmet AKYOL commented on SPARK-12626: - I don't know if you guys watched [SalesForce's ML

[jira] [Resolved] (SPARK-12897) spark ui with tachyon show all Stream Blocks

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12897. --- Resolution: Not A Problem > spark ui with tachyon show all Stream Blocks >

[jira] [Resolved] (SPARK-6422) support customized akka system for actor-based receiver

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6422. -- Resolution: Won't Fix > support customized akka system for actor-based receiver >

[jira] [Resolved] (SPARK-6978) GraphX: Compute all the direct and indirect relations for each vertex

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6978. -- Resolution: Won't Fix > GraphX: Compute all the direct and indirect relations for each vertex >

[jira] [Commented] (SPARK-12958) Map accumulator in spark

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113665#comment-15113665 ] Sean Owen commented on SPARK-12958: --- Meaning, an accumulator that sums Long values for keys? (It need

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12859: --- Assignee: Alex Bozarth > Names of input streams with receivers don't fit in Streaming page >

[jira] [Resolved] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12859. Resolution: Fixed > Names of input streams with receivers don't fit in Streaming page >

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12859: --- Fix Version/s: 2.0.0 1.6.1 > Names of input streams with receivers don't

[jira] [Commented] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113729#comment-15113729 ] Sean Owen commented on SPARK-12966: --- Don't set Fix version / set component please > Postgres JDBC

[jira] [Resolved] (SPARK-3439) Add Canopy Clustering Algorithm

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3439. -- Resolution: Won't Fix > Add Canopy Clustering Algorithm > --- > >

[jira] [Updated] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12967: -- Component/s: Spark Core > NettyRPC races with SparkContext.stop() and throws exception >

[jira] [Updated] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12966: -- Component/s: SQL > Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type' >

[jira] [Updated] (SPARK-12960) Some examples are missing support for python2

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12960: -- Assignee: Mark Grover > Some examples are missing support for python2 >

[jira] [Updated] (SPARK-12961) Work around memory leak in Snappy library

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12961: -- Component/s: Spark Core > Work around memory leak in Snappy library >

[jira] [Updated] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12966: -- Fix Version/s: (was: 1.6.1) > Postgres JDBC ArrayType(DecimalType) 'Unable to find server array

[jira] [Resolved] (SPARK-12760) inaccurate description for difference between local vs cluster mode in closure handling

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12760. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12968) Implement command to set current database

2016-01-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113723#comment-15113723 ] Herman van Hovell commented on SPARK-12968: --- I am working on removing the current 'set' parser

[jira] [Resolved] (SPARK-12775) Couldn't find leader offsets exception when hostname can't be resolved

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12775. --- Resolution: Not A Problem > Couldn't find leader offsets exception when hostname can't be resolved >

[jira] [Resolved] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11137. --- Resolution: Fixed Assignee: Jayadevan M Fix Version/s: 2.0.0 Resolved by

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2016-01-23 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113764#comment-15113764 ] Luciano Resende commented on SPARK-5159: [~zhanzhang] Yes, the user that has proper access does

[jira] [Updated] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12904: Description: We can do the following strength reduction for comparisons between an integral

[jira] [Updated] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

2016-01-23 Thread Brian Wheeler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Wheeler updated SPARK-12940: -- Attachment: spark-12940.txt These commands can be run in the spark shell to duplicate this

[jira] [Created] (SPARK-12969) Exception while casting a spark supported date formatted "string" to "date" data type.

2016-01-23 Thread Jais Sebastian (JIRA)
Jais Sebastian created SPARK-12969: -- Summary: Exception while casting a spark supported date formatted "string" to "date" data type. Key: SPARK-12969 URL: https://issues.apache.org/jira/browse/SPARK-12969

[jira] [Resolved] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12904. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > Strength

[jira] [Updated] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

2016-01-23 Thread Brian Wheeler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Wheeler updated SPARK-12940: -- Affects Version/s: 1.6.0 Description: I have partitioned Parquet that I am trying to

[jira] [Commented] (SPARK-6875) Add support for Joda-time types

2016-01-23 Thread Patrick Grandjean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113770#comment-15113770 ] Patrick Grandjean commented on SPARK-6875: -- SPARK-7768 > Add support for Joda-time types >

[jira] [Created] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
Haidar Hadi created SPARK-12970: --- Summary: Error in documentation Key: SPARK-12970 URL: https://issues.apache.org/jira/browse/SPARK-12970 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-11796) Docker JDBC integration tests fail in Maven build due to dependency issue

2016-01-23 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113989#comment-15113989 ] Brandon Bradley commented on SPARK-11796: - I am still experiencing this while trying to debug

[jira] [Resolved] (SPARK-2949) SparkContext does not fate-share with ActorSystem

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2949. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been

[jira] [Resolved] (SPARK-10296) add preservesParitioning parameter to RDD.map

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10296. Resolution: Won't Fix Given the limited interest in this feature, combined with the fact that this

[jira] [Resolved] (SPARK-9367) spark sql select * cause driver java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9367. --- Resolution: Invalid It sounds like you're trying to collect too much data to the driver. Without

[jira] [Commented] (SPARK-4878) driverPropsFetcher causes spurious Akka disassociate errors

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114044#comment-15114044 ] Josh Rosen commented on SPARK-4878: --- Sean, is this still valid after SPARK-5293, which removes Spark

[jira] [Assigned] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-8725: - Assignee: Josh Rosen > Test modules in topological order in dev/run-tests and python/run-tests >

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113985#comment-15113985 ] Josh Rosen commented on SPARK-3630: --- Hi [~gfeher], This is very helpful information. The fact that

[jira] [Commented] (SPARK-12970) Error in documentation

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114010#comment-15114010 ] Josh Rosen commented on SPARK-12970: Do you mind submitting a pull request to fix this? > Error in

[jira] [Commented] (SPARK-12946) The SQL page is empty

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114014#comment-15114014 ] Josh Rosen commented on SPARK-12946: +1. I don't think this JIRA is actionable given its current

[jira] [Resolved] (SPARK-3105) Calling cache() after RDDs are pipelined has no effect in PySpark

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3105. --- Resolution: Won't Fix Closing as "Won't Fix", since I don't think we have any plans to change this

[jira] [Comment Edited] (SPARK-10728) Failed to set Jenkins Identity header on email.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114045#comment-15114045 ] Josh Rosen edited comment on SPARK-10728 at 1/24/16 12:02 AM: -- Resolving as

[jira] [Resolved] (SPARK-6557) Only set bold text on PR github test output for problems

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6557. --- Resolution: Won't Fix I don't think that anyone else has requested this feature, so I'm going to

[jira] [Resolved] (SPARK-2451) Enable to load config file for Akka

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2451. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been

[jira] [Resolved] (SPARK-12432) Make parts of the Spark testing API public to assist developers making their own tests.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12432. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of

[jira] [Resolved] (SPARK-12434) Make parts of the streaming testing API public to assist developers making their own tests.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12434. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of

[jira] [Resolved] (SPARK-12587) Make parts of the Spark SQL testing API public

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12587. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-23 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114080#comment-15114080 ] Alexander Ulanov commented on SPARK-10528: -- Hi! I'm getting the same problem on Windows 7 64x

[jira] [Updated] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12624: --- Summary: When schema is specified, we should give better error message if actual row length doesn't

[jira] [Commented] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113994#comment-15113994 ] Apache Spark commented on SPARK-12936: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12936: Assignee: Wenchen Fan (was: Apache Spark) > Initial bloom filter implementation >

[jira] [Assigned] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12936: Assignee: Apache Spark (was: Wenchen Fan) > Initial bloom filter implementation >

[jira] [Resolved] (SPARK-5812) Flaky test: o.a.s.JavaAPISuite

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5812. --- Resolution: Cannot Reproduce AFAIK this flakiness hasn't been observed in a really long time, so

[jira] [Resolved] (SPARK-11588) Submitting of Spark (Streaming) Job and killing/stopping of them

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11588. Resolution: Invalid This JIRA asks several different questions some of which are mostly

[jira] [Commented] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114032#comment-15114032 ] Josh Rosen commented on SPARK-9307: --- We might want to do this for Spark 2.0. > Logging: Make it either

[jira] [Resolved] (SPARK-10728) Failed to set Jenkins Identity header on email.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10728. Resolution: Invalid Resolving as "invalid", since I'd like to keep only actionable JIRAs that we

[jira] [Created] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12971: -- Summary: Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build Key: SPARK-12971 URL: https://issues.apache.org/jira/browse/SPARK-12971 Project:

[jira] [Commented] (SPARK-12897) spark ui with tachyon show all Stream Blocks

2016-01-23 Thread astralidea (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114052#comment-15114052 ] astralidea commented on SPARK-12897: It's a problem ! I mean if use StorageLevel such as

[jira] [Commented] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114067#comment-15114067 ] Josh Rosen commented on SPARK-8725: --- Here's an example of why this is a problem: I only changed files in

[jira] [Commented] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114115#comment-15114115 ] Apache Spark commented on SPARK-8725: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114123#comment-15114123 ] Cheng Lian commented on SPARK-12624: Quoted Davies' offline comment {quote} We always raise a

[jira] [Commented] (SPARK-12964) SparkContext.localProperties leaked

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114011#comment-15114011 ] Josh Rosen commented on SPARK-12964: Haven't read the entirety of this yet, but to briefly touch on

[jira] [Resolved] (SPARK-4991) Worker should reconnect to Master when Master actor restart

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4991. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been

[jira] [Assigned] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12971: Assignee: Apache Spark (was: Josh Rosen) > Address test isolation problems which broke

[jira] [Assigned] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12971: Assignee: Josh Rosen (was: Apache Spark) > Address test isolation problems which broke

[jira] [Commented] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114054#comment-15114054 ] Apache Spark commented on SPARK-12971: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12624: --- Description: The following code snippet reproduces this issue: {code} from pyspark.sql.types import

[jira] [Resolved] (SPARK-9678) HTTP request to BlockManager port yields exception

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9678. --- Resolution: Not A Problem Resolving as "Not a Problem." > HTTP request to BlockManager port yields

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-23 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114080#comment-15114080 ] Alexander Ulanov edited comment on SPARK-10528 at 1/24/16 1:30 AM: --- Hi!

[jira] [Assigned] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12624: Assignee: (was: Apache Spark) > When schema is specified, we should give better error

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114125#comment-15114125 ] Apache Spark commented on SPARK-12624: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12624: Assignee: Apache Spark > When schema is specified, we should give better error message if

[jira] [Updated] (SPARK-11416) Upgrade kryo package to version 3.0

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11416: --- Priority: Major (was: Trivial) > Upgrade kryo package to version 3.0 >

[jira] [Updated] (SPARK-11416) Upgrade kryo package to version 3.0

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11416: --- Target Version/s: 2.0.0 > Upgrade kryo package to version 3.0 > ---

[jira] [Resolved] (SPARK-12135) Remove scala-compiler and scalap deps from Spark runtime

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12135. Resolution: Won't Fix It's going to be tricky to assess whether JSON4S actually uses the

[jira] [Resolved] (SPARK-3075) Expose a way for users to parse event logs

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3075. --- Resolution: Won't Fix > Expose a way for users to parse event logs >

[jira] [Commented] (SPARK-3075) Expose a way for users to parse event logs

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114030#comment-15114030 ] Josh Rosen commented on SPARK-3075: --- This seems out-of-scope / won't fix to me. I don't think we want to

[jira] [Comment Edited] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114060#comment-15114060 ] Haidar Hadi edited comment on SPARK-12970 at 1/24/16 12:25 AM: --- I do not

[jira] [Commented] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114060#comment-15114060 ] Haidar Hadi commented on SPARK-12970: - I do not mind, but I really do not know how to :( Haidar. >

[jira] [Created] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Brandon Bradley (JIRA)
Brandon Bradley created SPARK-12972: --- Summary: Update org.apache.httpcomponents.httpclient Key: SPARK-12972 URL: https://issues.apache.org/jira/browse/SPARK-12972 Project: Spark Issue

[jira] [Commented] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114201#comment-15114201 ] Apache Spark commented on SPARK-12972: -- User 'blbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12972: Assignee: (was: Apache Spark) > Update org.apache.httpcomponents.httpclient >

[jira] [Assigned] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12972: Assignee: Apache Spark > Update org.apache.httpcomponents.httpclient >

[jira] [Created] (SPARK-12973) Support to set priority when submit spark application to YARN

2016-01-23 Thread Chaozhong Yang (JIRA)
Chaozhong Yang created SPARK-12973: -- Summary: Support to set priority when submit spark application to YARN Key: SPARK-12973 URL: https://issues.apache.org/jira/browse/SPARK-12973 Project: Spark