[jira] [Created] (SPARK-6134) Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive

Liang-Chi Hsieh created SPARK-6134: -- Summary: Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive Key: SPARK-6134 URL: https://issues.apache.org/jira/browse/SPARK-6134

[jira] [Created] (SPARK-6135) No checks of illegal hostname when runing spark on yarn.

Xia Hu created SPARK-6135: - Summary: No checks of illegal hostname when runing spark on yarn. Key: SPARK-6135 URL: https://issues.apache.org/jira/browse/SPARK-6135 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6134) Fix wrong datatype for casting FloatType and default LongType value in defaultPrimitive

[ https://issues.apache.org/jira/browse/SPARK-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344708#comment-14344708 ] Apache Spark commented on SPARK-6134: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

Cheng Lian created SPARK-6136: - Summary: Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities Key: SPARK-6136 URL: https://issues.apache.org/jira/browse/SPARK-6136

[jira] [Commented] (SPARK-5334) NullPointerException when getting files from S3 (hadoop 2.3+)

[ https://issues.apache.org/jira/browse/SPARK-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344809#comment-14344809 ] Kevin (Sangwoo) Kim commented on SPARK-5334: I tested this issue is resolved

[jira] [Updated] (SPARK-6105) enhance spark-ganglia to support redundant gmond addresses setting in ganglia unicast mode

[ https://issues.apache.org/jira/browse/SPARK-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6105: - Component/s: Spark Core Affects Version/s: (was: 1.3.0) 1.2.1

[jira] [Commented] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345188#comment-14345188 ] Sean Owen commented on SPARK-3437: -- Is the idea here to not write _2.xx in artifact IDs?

[jira] [Commented] (SPARK-6139) Allow pre-populate sliding window with initial data

[ https://issues.apache.org/jira/browse/SPARK-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345195#comment-14345195 ] Apache Spark commented on SPARK-6139: - User 'matuskik' has created a pull request for

[jira] [Created] (SPARK-6139) Allow pre-populate sliding window with initial data

Matus Faro (Kik) created SPARK-6139: --- Summary: Allow pre-populate sliding window with initial data Key: SPARK-6139 URL: https://issues.apache.org/jira/browse/SPARK-6139 Project: Spark

[jira] [Commented] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345189#comment-14345189 ] Sean Owen commented on SPARK-3859: -- May I suggest this be closed? I didn't want to do so

[jira] [Updated] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5707: -- Description: Exception thrown: {noformat} org.apache.spark.SparkException: Job aborted due to stage

[jira] [Commented] (SPARK-5143) spark-network-yarn 2.11 depends on spark-network-shuffle 2.10

[ https://issues.apache.org/jira/browse/SPARK-5143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345232#comment-14345232 ] Apache Spark commented on SPARK-5143: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-5271) PySpark History Web UI issues

[ https://issues.apache.org/jira/browse/SPARK-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345173#comment-14345173 ] Sean Owen commented on SPARK-5271: -- It sounds like a duplicate of SPARK-3898 then, right?

[jira] [Resolved] (SPARK-5356) Write to Hbase from Spark

[ https://issues.apache.org/jira/browse/SPARK-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5356. -- Resolution: Invalid I don't think this is suitable as JIRA, even though you've marked it as a

[jira] [Updated] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5707: -- Description: Exception thrown: {noformat} org.apache.spark.SparkException: Job aborted due to stage

[jira] [Commented] (SPARK-603) add simple Counter API

[ https://issues.apache.org/jira/browse/SPARK-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345204#comment-14345204 ] Imran Rashid commented on SPARK-603: Hi [~srowen] I don't think anyone is actively

[jira] [Closed] (SPARK-603) add simple Counter API

[ https://issues.apache.org/jira/browse/SPARK-603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid closed SPARK-603. -- Resolution: Won't Fix add simple Counter API -- Key: SPARK-603

[jira] [Created] (SPARK-6140) Retain longForm call site information even when shortForm is overridden.

Christopher Ng created SPARK-6140: - Summary: Retain longForm call site information even when shortForm is overridden. Key: SPARK-6140 URL: https://issues.apache.org/jira/browse/SPARK-6140 Project:

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6132: - Summary: Context cleaner race condition across SparkContexts (was: Context cleaner thread lives across

[jira] [Updated] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

[ https://issues.apache.org/jira/browse/SPARK-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6136: -- Description: Integration test suites in the JDBC data source ({{MySQLIntegration}} and

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344813#comment-14344813 ] Littlestar commented on SPARK-6049: --- I test 1.3.0 RC1, it fixed SPARK-3675 and

[jira] [Updated] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Dus updated SPARK-6137: - Priority: Minor (was: Major) G-Means clustering algorithm implementation

[jira] [Created] (SPARK-6137) G-Means clustering algorithm implementation

Denis Dus created SPARK-6137: Summary: G-Means clustering algorithm implementation Key: SPARK-6137 URL: https://issues.apache.org/jira/browse/SPARK-6137 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3071) Increase default driver memory

[ https://issues.apache.org/jira/browse/SPARK-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344772#comment-14344772 ] Sean Owen commented on SPARK-3071: -- I tend to support raising this. In most cases, the

[jira] [Resolved] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6131. -- Resolution: Not a Problem The file was actually a Scala file under the Scala tree in 1.2.x:

[jira] [Commented] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345259#comment-14345259 ] Apache Spark commented on SPARK-5949: - User 'squito' has created a pull request for

[jira] [Commented] (SPARK-4184) Improve Spark Streaming documentation

[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345031#comment-14345031 ] Sean Owen commented on SPARK-4184: -- Paging [~cfregly] to see if whatever this is, was

[jira] [Resolved] (SPARK-5055) Minor typos on the downloads page

[ https://issues.apache.org/jira/browse/SPARK-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5055. -- Resolution: Fixed Assignee: Sean Owen Thanks, I now have commit access and so was able to push

[jira] [Resolved] (SPARK-5023) In Web UI job history, the total job duration is incorrect (much smaller than the sum of its stages)

[ https://issues.apache.org/jira/browse/SPARK-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5023. -- Resolution: Duplicate Absent any follow-up to the contrary, this does indeed sound like the same issue

[jira] [Commented] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345080#comment-14345080 ] Saurabh Santhosh commented on SPARK-1823: - Hey, what is the status on this issues?

[jira] [Commented] (SPARK-4044) Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

[ https://issues.apache.org/jira/browse/SPARK-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345065#comment-14345065 ] Apache Spark commented on SPARK-4044: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-5949: --- Assignee: Imran Rashid Driver program has to register roaring bitmap classes used by spark

[jira] [Comment Edited] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345365#comment-14345365 ] Andrew Or edited comment on SPARK-3859 at 3/3/15 5:27 PM: -- The

[jira] [Commented] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345365#comment-14345365 ] Andrew Or commented on SPARK-3859: -- The problem is we keep adding more and more of these

[jira] [Comment Edited] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345365#comment-14345365 ] Andrew Or edited comment on SPARK-3859 at 3/3/15 5:26 PM: -- The

[jira] [Closed] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3859. Resolution: Duplicate Use consistent config names for duration (with units!)

[jira] [Comment Edited] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345365#comment-14345365 ] Andrew Or edited comment on SPARK-3859 at 3/3/15 5:27 PM: -- The

[jira] [Comment Edited] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345575#comment-14345575 ] Denis Dus edited comment on SPARK-6137 at 3/3/15 7:27 PM: -- As I

[jira] [Commented] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345556#comment-14345556 ] Apache Spark commented on SPARK-6141: - User 'dbtsai' has created a pull request for

[jira] [Updated] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kushal Datta updated SPARK-3789: Target Version/s: 1.4.0 Python bindings for GraphX --

[jira] [Created] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

DB Tsai created SPARK-6141: -- Summary: Upgrade Breeze to 0.11 to fix convergence bug Key: SPARK-6141 URL: https://issues.apache.org/jira/browse/SPARK-6141 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6141: - Priority: Critical (was: Blocker) Upgrade Breeze to 0.11 to fix convergence bug

[jira] [Created] (SPARK-6142) 10-12% Performance regression with finalize

Nishkam Ravi created SPARK-6142: --- Summary: 10-12% Performance regression with finalize Key: SPARK-6142 URL: https://issues.apache.org/jira/browse/SPARK-6142 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345484#comment-14345484 ] Denis Dus commented on SPARK-6137: -- Streaming K-Means (as I see) is just a variation of

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345575#comment-14345575 ] Denis Dus commented on SPARK-6137: -- As I see, splitting rules are different. 1) GMeans

[jira] [Updated] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6141: - Target Version/s: 1.3.0 Upgrade Breeze to 0.11 to fix convergence bug

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345491#comment-14345491 ] Kushal Datta commented on SPARK-3789: - PyGraphX depends on Java API for GraphX

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345499#comment-14345499 ] Joseph K. Bradley commented on SPARK-6137: -- I understand that GMeans picks K.

[jira] [Commented] (SPARK-5920) Use a BufferedInputStream to read local shuffle data

[ https://issues.apache.org/jira/browse/SPARK-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345495#comment-14345495 ] Apache Spark commented on SPARK-5920: - User 'ravipesala' has created a pull request

[jira] [Updated] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Hubbard updated SPARK-6067: - Attachment: job.log Spark sql hive dynamic partitions job will fail if task fails

[jira] [Commented] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345519#comment-14345519 ] Jason Hubbard commented on SPARK-6067: -- Hi baishuo. To reproduce, create a Hive

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345408#comment-14345408 ] Joseph K. Bradley commented on SPARK-6137: -- There is a method for splitting

[jira] [Updated] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6141: - Assignee: DB Tsai Upgrade Breeze to 0.11 to fix convergence bug

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345635#comment-14345635 ] Joseph K. Bradley commented on SPARK-6137: -- Yeah, I'm not aware of a theoretical

[jira] [Commented] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345696#comment-14345696 ] Imran Rashid commented on SPARK-5949: - Thanks [~ptorok]. I've updated the PR. Can

[jira] [Commented] (SPARK-6137) G-Means clustering algorithm implementation

[ https://issues.apache.org/jira/browse/SPARK-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345663#comment-14345663 ] Denis Dus commented on SPARK-6137: -- I really have no experience with X-Means, but from

[jira] [Commented] (SPARK-5433) Spark EC2 doesn't mount local disks for all instance types

[ https://issues.apache.org/jira/browse/SPARK-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345669#comment-14345669 ] Uri Laserson commented on SPARK-5433: - Confirming that I ran into this problem with an

[jira] [Updated] (SPARK-6143) Improve FP-Growth for mining closed-forms of frequent patterns

[ https://issues.apache.org/jira/browse/SPARK-6143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Dus updated SPARK-6143: - Description: It is more convenient for person to analyze closed forms of frequent itemsets (and patterns

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6132: - Target Version/s: 1.4.0, 1.3.1 (was: 1.4.0) Context cleaner race condition across SparkContexts

[jira] [Created] (SPARK-6143) Improve FP-Growth for mining closed-forms of frequent patterns

Denis Dus created SPARK-6143: Summary: Improve FP-Growth for mining closed-forms of frequent patterns Key: SPARK-6143 URL: https://issues.apache.org/jira/browse/SPARK-6143 Project: Spark Issue

[jira] [Updated] (SPARK-6143) Improve FP-Growth for mining closed-forms of frequent patterns

[ https://issues.apache.org/jira/browse/SPARK-6143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Dus updated SPARK-6143: - Description: It is more convenient for person to analyze closed forms of frequent itemsets (and patterns

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6132: - Labels: backport-needed (was: ) Context cleaner race condition across SparkContexts

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6132: - Fix Version/s: 1.4.0 Context cleaner race condition across SparkContexts

[jira] [Updated] (SPARK-6132) Context cleaner race condition across SparkContexts

[ https://issues.apache.org/jira/browse/SPARK-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6132: - Target Version/s: 1.1.2, 1.2.2, 1.4.0, 1.3.1 (was: 1.4.0, 1.3.1) Context cleaner race condition across

[jira] [Resolved] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6141. -- Resolution: Fixed Fix Version/s: 1.3.1 Issue resolved by pull request 4879

[jira] [Comment Edited] (SPARK-4368) Ceph integration?

[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346499#comment-14346499 ] kishorekumar neelamegam edited comment on SPARK-4368 at 3/4/15 6:58 AM:

[jira] [Commented] (SPARK-4368) Ceph integration?

[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346499#comment-14346499 ] kishorekumar neelamegam commented on SPARK-4368: If no changes or needed

[jira] [Created] (SPARK-6144) When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail

Trystan Leftwich created SPARK-6144: --- Summary: When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail Key: SPARK-6144 URL: https://issues.apache.org/jira/browse/SPARK-6144 Project:

[jira] [Commented] (SPARK-6144) When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail

[ https://issues.apache.org/jira/browse/SPARK-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345908#comment-14345908 ] Apache Spark commented on SPARK-6144: - User 'trystanleftwich' has created a pull

[jira] [Updated] (SPARK-6144) When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail

[ https://issues.apache.org/jira/browse/SPARK-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan Leftwich updated SPARK-6144: Description: While in cluster mode if you use ADD JAR with a HDFS sourced jar it will fail

[jira] [Created] (SPARK-6145) ORDER BY fails to resolve nested fields

Michael Armbrust created SPARK-6145: --- Summary: ORDER BY fails to resolve nested fields Key: SPARK-6145 URL: https://issues.apache.org/jira/browse/SPARK-6145 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6146) Support more datatype in SqlParser

Yin Huai created SPARK-6146: --- Summary: Support more datatype in SqlParser Key: SPARK-6146 URL: https://issues.apache.org/jira/browse/SPARK-6146 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5949. Resolution: Fixed Fix Version/s: 1.3.0 Driver program has to register roaring bitmap

[jira] [Updated] (SPARK-6148) After saveAsTable, non-nullable columns cannot be read back

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6148: Priority: Major (was: Blocker) After saveAsTable, non-nullable columns cannot be read back

[jira] [Commented] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime incompatibility issues caused by Guava 15

[ https://issues.apache.org/jira/browse/SPARK-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346515#comment-14346515 ] Patrick Wendell commented on SPARK-6149: Yes - because of this I think simply

[jira] [Commented] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 with SBT because of runtime incompatibility issues caused by Guava 15

[ https://issues.apache.org/jira/browse/SPARK-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346519#comment-14346519 ] Patrick Wendell commented on SPARK-6149: To be more specific, I am suggesting that

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346443#comment-14346443 ] Apache Spark commented on SPARK-2087: - User 'chenghao-intel' has created a pull

[jira] [Updated] (SPARK-6145) ORDER BY fails to resolve nested fields

[ https://issues.apache.org/jira/browse/SPARK-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6145: Description: {code} sqlContext.jsonRDD(sc.parallelize( {a: {b: 1}, c: 1} ::

[jira] [Updated] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6133: - Target Version/s: 1.2.2, 1.4.0 (was: 1.4.0) SparkContext#stop is not idempotent

[jira] [Updated] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6133: - Target Version/s: 1.2.2, 1.4.0, 1.3.1 (was: 1.2.2, 1.4.0) SparkContext#stop is not idempotent

[jira] [Commented] (SPARK-6142) 10-12% Performance regression with finalize

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346086#comment-14346086 ] Nishkam Ravi commented on SPARK-6142: - Fixed (master

[jira] [Updated] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5949: --- Fix Version/s: (was: 1.3.0) 1.4.0 Driver program has to register roaring

[jira] [Updated] (SPARK-6148) cachedDataSourceTables may store outdated metadata if the table is updated from another HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6148: Description: If we have two HiveContext, if we change a table through one (e.g. append and overwrite with

[jira] [Updated] (SPARK-6148) cachedDataSourceTables may store outdated metadata if the table is updated from another HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6148: Description: If we have two HiveContext, if we change a table through one, cachedDataSourceTables may

[jira] [Updated] (SPARK-6146) Support more datatype in SqlParser

[ https://issues.apache.org/jira/browse/SPARK-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6146: Issue Type: Improvement (was: Bug) Support more datatype in SqlParser --

[jira] [Resolved] (SPARK-6142) 10-12% Performance regression with finalize

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi resolved SPARK-6142. - Resolution: Fixed 10-12% Performance regression with finalize

[jira] [Reopened] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi reopened SPARK-5423: - The commit was reverted due to performance issues. Re-opening this JIRA. ExternalAppendOnlyMap

[jira] [Created] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

Cheng Lian created SPARK-6147: - Summary: Move JDBC data source integration tests to the Spark integration tests project Key: SPARK-6147 URL: https://issues.apache.org/jira/browse/SPARK-6147 Project:

[jira] [Created] (SPARK-6148) After saveAsTable, non-nullable columns cannot be read back

Yin Huai created SPARK-6148: --- Summary: After saveAsTable, non-nullable columns cannot be read back Key: SPARK-6148 URL: https://issues.apache.org/jira/browse/SPARK-6148 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6148) cachedDataSourceTables may store outdated metadata if the table is updated from another HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6148: Summary: cachedDataSourceTables may store outdated metadata if the table is updated from another

[jira] [Updated] (SPARK-6148) After saveAsTable, non-nullable columns cannot be read back

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6148: Target Version/s: (was: 1.3.0) After saveAsTable, non-nullable columns cannot be read back

[jira] [Commented] (SPARK-6144) When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail

[ https://issues.apache.org/jira/browse/SPARK-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346176#comment-14346176 ] Apache Spark commented on SPARK-6144: - User 'trystanleftwich' has created a pull

[jira] [Updated] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6133: - Fix Version/s: 1.2.2 SparkContext#stop is not idempotent ---

[jira] [Updated] (SPARK-6133) SparkContext#stop is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6133: - Fix Version/s: 1.4.0 SparkContext#stop is not idempotent ---

[jira] [Created] (SPARK-6149) Spark SQL CLI doesn't work when compiled against Hive 12 because of runtime incompatibility issues caused by Guava (15?)

Cheng Lian created SPARK-6149: - Summary: Spark SQL CLI doesn't work when compiled against Hive 12 because of runtime incompatibility issues caused by Guava (15?) Key: SPARK-6149 URL:

[jira] [Commented] (SPARK-6148) cachedDataSourceTables may store outdated metadata if the table is updated from another HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346165#comment-14346165 ] Yin Huai commented on SPARK-6148: - To workaround this issue. Users need to use

[jira] [Commented] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346405#comment-14346405 ] Prashant Sharma commented on SPARK-3437: Yes, you are right - Idea here is to not

[jira] [Issue Comment Deleted] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-3437: --- Comment: was deleted (was: Yes, you are right - Idea here is to not write _2.xx in artifact

[jira] [Commented] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346404#comment-14346404 ] Prashant Sharma commented on SPARK-3437: Yes, you are right - Idea here is to not

[jira] [Created] (SPARK-6153) intellij import from maven cannot debug sparksqlclidriver

Adrian Wang created SPARK-6153: -- Summary: intellij import from maven cannot debug sparksqlclidriver Key: SPARK-6153 URL: https://issues.apache.org/jira/browse/SPARK-6153 Project: Spark Issue

  1   2   >