[jira] [Commented] (SPARK-12112) Upgrade to SBT 0.13.9

[ https://issues.apache.org/jira/browse/SPARK-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036903#comment-15036903 ] Apache Spark commented on SPARK-12112: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-12112) Upgrade to SBT 0.13.9

Josh Rosen created SPARK-12112: -- Summary: Upgrade to SBT 0.13.9 Key: SPARK-12112 URL: https://issues.apache.org/jira/browse/SPARK-12112 Project: Spark Issue Type: Bug Components: Build

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036896#comment-15036896 ] Josh Rosen commented on SPARK-10878: Also, ping [~brkyvz] > Race condition when reso

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036893#comment-15036893 ] Josh Rosen commented on SPARK-10878: I think this is because Spark's use of the Ivy c

[jira] [Commented] (SPARK-12111) need upgrade instruction

[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036887#comment-15036887 ] Andrew Davidson commented on SPARK-12111: - Hi Sean I understand I will need to s

[jira] [Commented] (SPARK-12111) need upgrade instruction

[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036888#comment-15036888 ] Andrew Davidson commented on SPARK-12111: - This is where someone that knows the d

[jira] [Commented] (SPARK-12111) need upgrade instruction

[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036863#comment-15036863 ] Sean Owen commented on SPARK-12111: --- Are you asking about spark-ec2 specifically? this

[jira] [Reopened] (SPARK-12111) need upgrade instruction

[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson reopened SPARK-12111: - Hi Sean It must be possible for customers to upgrade installations. Given Spark is written

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036837#comment-15036837 ] Yin Huai commented on SPARK-9686: - [~lian cheng] I think it is pretty hard to workaround t

[jira] [Resolved] (SPARK-12111) need upgrade instruction

[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12111. --- Resolution: Invalid This is better started as a question on u...@spark.apache.org. This would be app

[jira] [Commented] (SPARK-12109) Expressions's simpleString should delegate to its toString

[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036833#comment-15036833 ] Apache Spark commented on SPARK-12109: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-12109) Expressions's simpleString should delegate to its toString

[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12109: Assignee: Yin Huai (was: Apache Spark) > Expressions's simpleString should delegate to it

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12089: -- Summary: java.lang.NegativeArraySizeException when growing BufferHolder (was: [][]][][]][[[) > java.l

[jira] [Assigned] (SPARK-12109) Expressions's simpleString should delegate to its toString

[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12109: Assignee: Apache Spark (was: Yin Huai) > Expressions's simpleString should delegate to it

[jira] [Created] (SPARK-12111) need upgrade instruction

Andrew Davidson created SPARK-12111: --- Summary: need upgrade instruction Key: SPARK-12111 URL: https://issues.apache.org/jira/browse/SPARK-12111 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-12089) [][]][][]][[[

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12089: --- Summary: [][]][][]][[[ (was: java.lang.NegativeArraySizeException when growing BufferHolder) > [][]

[jira] [Created] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

Andrew Davidson created SPARK-12110: --- Summary: spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive Key: SPARK-12110 URL: https://issues.apache.org/jira/browse/SPARK-12110

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036809#comment-15036809 ] shane knapp commented on SPARK-11255: - ok, [~shivaram] and i got together and whipped

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036807#comment-15036807 ] Davies Liu commented on SPARK-12089: This query will not generate huge record, each r

[jira] [Closed] (SPARK-11992) Severl numbers in my spark shell (pyspark)

[ https://issues.apache.org/jira/browse/SPARK-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alberto Bonsanto closed SPARK-11992. > Severl numbers in my spark shell (pyspark) > -- > >

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Affects Version/s: (was: 1.4.0) (was: 1.3.0) (

[jira] [Created] (SPARK-12109) Expressions's simpleString should delegate to its toString

Yin Huai created SPARK-12109: Summary: Expressions's simpleString should delegate to its toString Key: SPARK-12109 URL: https://issues.apache.org/jira/browse/SPARK-12109 Project: Spark Issue Type

[jira] [Created] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

Andrew Or created SPARK-12108: - Summary: Event logs are much bigger in 1.6 than in 1.5 Key: SPARK-12108 URL: https://issues.apache.org/jira/browse/SPARK-12108 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036625#comment-15036625 ] Dan Dutrow edited comment on SPARK-12103 at 12/2/15 10:38 PM: -

[jira] [Commented] (SPARK-12104) collect() does not handle multiple columns with same name

[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036791#comment-15036791 ] Shivaram Venkataraman commented on SPARK-12104: --- Any ideas what caused this

[jira] [Resolved] (SPARK-10266) Add @Since annotation to ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10266. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9338 [https://gi

[jira] [Commented] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036743#comment-15036743 ] Josh Rosen commented on SPARK-12082: For now, I'm going to try bumping the timeout to

[jira] [Commented] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036741#comment-15036741 ] Dan Dutrow commented on SPARK-12103: One possible way around this problem would be to

[jira] [Commented] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036738#comment-15036738 ] Marcelo Vanzin commented on SPARK-12082: If the build machines run on VMs, run mu

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12057: - Target Version/s: 1.6.0 > Prevent failure on corrupt JSON records > -

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036718#comment-15036718 ] Xiangrui Meng commented on SPARK-8517: -- [~timhunter] I agree with most of your points

[jira] [Updated] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12106: --- Labels: flaky-test (was: ) > Flaky Test: BatchedWriteAheadLog - name log with aggregated entries wit

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036710#comment-15036710 ] Xiangrui Meng commented on SPARK-8517: -- * I'm not sure whether the mathematical formu

[jira] [Resolved] (SPARK-12001) StreamingContext cannot be completely stopped if the stop() call is interrupted

[ https://issues.apache.org/jira/browse/SPARK-12001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12001. Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9982 [https://github.c

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036704#comment-15036704 ] Xiangrui Meng commented on SPARK-8517: -- * We should only mention MLlib specific types

[jira] [Updated] (SPARK-12001) StreamingContext cannot be completely stopped if the stop() call is interrupted

[ https://issues.apache.org/jira/browse/SPARK-12001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12001: --- Labels: backport-needed (was: ) > StreamingContext cannot be completely stopped if the stop() call i

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036690#comment-15036690 ] Xiangrui Meng commented on SPARK-8517: -- * Agree that the focus of spark.ml should not

[jira] [Commented] (SPARK-12085) The join condition hidden in DNF can't be pushed down to join operator

[ https://issues.apache.org/jira/browse/SPARK-12085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036685#comment-15036685 ] Min Qiu commented on SPARK-12085: - looks like the BooleanSimplification rule in Spark 1.5

[jira] [Commented] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036683#comment-15036683 ] Michael Armbrust commented on SPARK-12066: -- Can you reproduce this on 1.6-rc1?

[jira] [Updated] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8517: - Shepherd: Xiangrui Meng > Improve the organization and style of MLlib's user guide > -

[jira] [Updated] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12107: - Target Version/s: 1.6.0 > Update spark-ec2 versions > - > >

[jira] [Assigned] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12107: Assignee: (was: Apache Spark) > Update spark-ec2 versions > -

[jira] [Commented] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036672#comment-15036672 ] Apache Spark commented on SPARK-12107: -- User 'nchammas' has created a pull request f

[jira] [Assigned] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12107: Assignee: Apache Spark > Update spark-ec2 versions > - > >

[jira] [Created] (SPARK-12107) Update spark-ec2 versions

Nicholas Chammas created SPARK-12107: Summary: Update spark-ec2 versions Key: SPARK-12107 URL: https://issues.apache.org/jira/browse/SPARK-12107 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036661#comment-15036661 ] Josh Rosen commented on SPARK-12082: What's slightly odd to me is the huge variabilit

[jira] [Commented] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036656#comment-15036656 ] Apache Spark commented on SPARK-12106: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12106: Assignee: (was: Apache Spark) > Flaky Test: BatchedWriteAheadLog - name log with aggre

[jira] [Assigned] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12106: Assignee: Apache Spark > Flaky Test: BatchedWriteAheadLog - name log with aggregated entri

[jira] [Updated] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

[ https://issues.apache.org/jira/browse/SPARK-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-12106: Description: This test is still transiently flaky, because async methods can finish out of order, a

[jira] [Created] (SPARK-12106) Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry

Burak Yavuz created SPARK-12106: --- Summary: Flaky Test: BatchedWriteAheadLog - name log with aggregated entries with the timestamp of last entry Key: SPARK-12106 URL: https://issues.apache.org/jira/browse/SPARK-12106

[jira] [Created] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

Dean Wampler created SPARK-12105: Summary: Add a DataFrame.show() with argument for output PrintStream Key: SPARK-12105 URL: https://issues.apache.org/jira/browse/SPARK-12105 Project: Spark

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Description: (Note: yes, there is a Direct API that may be better, but it's not the easiest thing to

[jira] [Commented] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036625#comment-15036625 ] Dan Dutrow commented on SPARK-12103: After digging into the Kafka code some more (spe

[jira] [Created] (SPARK-12104) collect() does not handle multiple columns with same name

Hossein Falaki created SPARK-12104: -- Summary: collect() does not handle multiple columns with same name Key: SPARK-12104 URL: https://issues.apache.org/jira/browse/SPARK-12104 Project: Spark

[jira] [Commented] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036613#comment-15036613 ] Marcelo Vanzin commented on SPARK-10911: Ok, that makes sense. But since the YARN

[jira] [Updated] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10873: -- Assignee: Zhuo Liu > can't sort columns on history page > -- >

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12000: - Target Version/s: 1.7.0 (was: 1.6.0) > `sbt publishLocal` hits a Scala compiler bug caus

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Target Version/s: 1.4.2, 1.6.1 (was: 1.0.1) > KafkaUtils createStream with multiple topics -- does n

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Fix Version/s: (was: 1.0.1) 1.4.2 > KafkaUtils createStream with multiple topi

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Affects Version/s: 1.1.0 1.2.0 1.3.0

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Description: (Note: yes, there is a Direct API that may be better, but it's not the easiest thing to

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Description: (Note: yes, there is a Direct API that may be better, but it's not the easiest thing to

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Dutrow updated SPARK-12103: --- Description: (Note: yes, there is a Direct API that may be better, but it's not the easiest thing to

[jira] [Created] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

Dan Dutrow created SPARK-12103: -- Summary: KafkaUtils createStream with multiple topics -- does not work as expected Key: SPARK-12103 URL: https://issues.apache.org/jira/browse/SPARK-12103 Project: Spark

[jira] [Updated] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12102: - Summary: Cast a non-nullable struct field to a nullable field during analysis (was: In check analysis, d

[jira] [Created] (SPARK-12102) In check analysis, data type check always

Yin Huai created SPARK-12102: Summary: In check analysis, data type check always Key: SPARK-12102 URL: https://issues.apache.org/jira/browse/SPARK-12102 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12101: Assignee: Shixiong Zhu (was: Apache Spark) > Fix thread pools that cannot cache tasks in

[jira] [Commented] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036516#comment-15036516 ] Apache Spark commented on SPARK-12101: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12101: Assignee: Apache Spark (was: Shixiong Zhu) > Fix thread pools that cannot cache tasks in

[jira] [Commented] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036487#comment-15036487 ] Sean Owen commented on SPARK-12101: --- To cut down the noise, if this is logically the sa

[jira] [Updated] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

[ https://issues.apache.org/jira/browse/SPARK-12101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12101: -- Priority: Minor (was: Major) > Fix thread pools that cannot cache tasks in Worker and AppClient >

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036470#comment-15036470 ] Bryan Cutler commented on SPARK-11219: -- I added an assessment of the current state o

[jira] [Updated] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-11219: - Description: There are several different formats for describing params in PySpark.MLlib, making

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036418#comment-15036418 ] Christoph Pirkl commented on SPARK-10969: - This issue is about adding additional

[jira] [Created] (SPARK-12101) Fix thread pools that cannot cache tasks in Worker and AppClient

Shixiong Zhu created SPARK-12101: Summary: Fix thread pools that cannot cache tasks in Worker and AppClient Key: SPARK-12101 URL: https://issues.apache.org/jira/browse/SPARK-12101 Project: Spark

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036395#comment-15036395 ] Thomas Graves commented on SPARK-11701: --- Also seems related to https://github.com/a

[jira] [Updated] (SPARK-11155) Stage summary json should include stage duration

[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-11155: Attachment: Screen Shot 2015-12-02.png sorry for being so slow... my first code change and it took me quite

[jira] [Commented] (SPARK-11155) Stage summary json should include stage duration

[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036375#comment-15036375 ] Apache Spark commented on SPARK-11155: -- User 'keypointt' has created a pull request

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036366#comment-15036366 ] Thomas Graves commented on SPARK-11701: --- this looks like a dup of SPARK-9038 > YAR

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036341#comment-15036341 ] Thomas Graves commented on SPARK-1239: -- I have another user hitting this also. The a

[jira] [Commented] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036338#comment-15036338 ] Apache Spark commented on SPARK-12040: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12040: Assignee: (was: Apache Spark) > Add toJson/fromJson to Vector/Vectors for PySpark > --

[jira] [Assigned] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12040: Assignee: Apache Spark > Add toJson/fromJson to Vector/Vectors for PySpark > -

[jira] [Commented] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036337#comment-15036337 ] holdenk commented on SPARK-12040: - Working on this :) > Add toJson/fromJson to Vector/Ve

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036327#comment-15036327 ] Erik Selin commented on SPARK-12089: It's a bunch of table joins followed by a group

[jira] [Created] (SPARK-12100) bug in spark/python/pyspark/rdd.py portable_hash()

Andrew Davidson created SPARK-12100: --- Summary: bug in spark/python/pyspark/rdd.py portable_hash() Key: SPARK-12100 URL: https://issues.apache.org/jira/browse/SPARK-12100 Project: Spark Issu

[jira] [Commented] (SPARK-11801) Notify driver when OOM is thrown before executor JVM is killed

[ https://issues.apache.org/jira/browse/SPARK-11801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036302#comment-15036302 ] Imran Rashid commented on SPARK-11801: -- to summarize, it seems we agree that: 1) we

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036295#comment-15036295 ] Davies Liu commented on SPARK-12089: [~tyro89] Are you build a large Array using grou

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036280#comment-15036280 ] Davies Liu commented on SPARK-12089: Could you turn on debug log, and paste the java

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036247#comment-15036247 ] Erik Selin commented on SPARK-12089: There shouldn't be a single record larger than 1

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12089: --- Priority: Critical (was: Major) > java.lang.NegativeArraySizeException when growing BufferHolder > -

[jira] [Created] (SPARK-12099) Standalone and Mesos Should use OnOutOfMemoryError handlers

Imran Rashid created SPARK-12099: Summary: Standalone and Mesos Should use OnOutOfMemoryError handlers Key: SPARK-12099 URL: https://issues.apache.org/jira/browse/SPARK-12099 Project: Spark

[jira] [Commented] (SPARK-12098) Cross validator with multi-arm bandit search

[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036231#comment-15036231 ] Apache Spark commented on SPARK-12098: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-12098) Cross validator with multi-arm bandit search

[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12098: Assignee: (was: Apache Spark) > Cross validator with multi-arm bandit search > ---

[jira] [Assigned] (SPARK-12098) Cross validator with multi-arm bandit search

[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12098: Assignee: Apache Spark > Cross validator with multi-arm bandit search > --

[jira] [Resolved] (SPARK-12094) Better format for query plan tree string

[ https://issues.apache.org/jira/browse/SPARK-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12094. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10099 [https://github.com/

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036194#comment-15036194 ] Davies Liu commented on SPARK-12089: Is it possible that you have a record larger tha

[jira] [Commented] (SPARK-12097) How to do a cached, batched JDBC-lookup in Spark Streaming?

[ https://issues.apache.org/jira/browse/SPARK-12097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036116#comment-15036116 ] Sean Owen commented on SPARK-12097: --- Normally I'd say we don't use JIRA for discussion

[jira] [Created] (SPARK-12098) Cross validator with multi-arm bandit search

Xusen Yin created SPARK-12098: - Summary: Cross validator with multi-arm bandit search Key: SPARK-12098 URL: https://issues.apache.org/jira/browse/SPARK-12098 Project: Spark Issue Type: New Featur

<    1   2   3   >