[jira] [Assigned] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16703: Assignee: Apache Spark (was: Cheng Lian) > Extra space in WindowSpecDefinition SQL

[jira] [Commented] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391370#comment-15391370 ] Apache Spark commented on SPARK-16703: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16703: Assignee: Cheng Lian (was: Apache Spark) > Extra space in WindowSpecDefinition SQL

[jira] [Updated] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16703: --- Description: For a {{WindowSpecDefinition}} whose {{partitionSpec}} is empty, there's an extra

[jira] [Updated] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16703: --- Description: For a {{WindowSpecDefinition}} whose {{partitionSpec}} is empty, there's an extra

[jira] [Created] (SPARK-16703) Extra space in WindowSpecDefinition SQL representation

2016-07-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-16703: -- Summary: Extra space in WindowSpecDefinition SQL representation Key: SPARK-16703 URL: https://issues.apache.org/jira/browse/SPARK-16703 Project: Spark Issue

[jira] [Assigned] (SPARK-16685) audit release docs are ambiguous

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16685: Assignee: Apache Spark > audit release docs are ambiguous >

[jira] [Commented] (SPARK-16685) audit release docs are ambiguous

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391361#comment-15391361 ] Apache Spark commented on SPARK-16685: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16685) audit release docs are ambiguous

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16685: Assignee: (was: Apache Spark) > audit release docs are ambiguous >

[jira] [Updated] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16699: Description: In the following code in `VectorizedHashMapGenerator.scala`: {code} def

[jira] [Resolved] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16699. - Resolution: Fixed Assignee: Qifan Pu Fix Version/s: (was: 2.0.0)

[jira] [Updated] (SPARK-16702) Driver hangs after executors are lost

2016-07-24 Thread Angus Gerry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Angus Gerry updated SPARK-16702: Attachment: SparkThreadsBlocked.txt > Driver hangs after executors are lost >

[jira] [Created] (SPARK-16702) Driver hangs after executors are lost

2016-07-24 Thread Angus Gerry (JIRA)
Angus Gerry created SPARK-16702: --- Summary: Driver hangs after executors are lost Key: SPARK-16702 URL: https://issues.apache.org/jira/browse/SPARK-16702 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391274#comment-15391274 ] Apache Spark commented on SPARK-16534: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16534) Kafka 0.10 Python support

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16534: Assignee: (was: Apache Spark) > Kafka 0.10 Python support > -

[jira] [Assigned] (SPARK-16534) Kafka 0.10 Python support

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16534: Assignee: Apache Spark > Kafka 0.10 Python support > - > >

[jira] [Updated] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-07-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5581: -- Assignee: Josh Rosen > When writing sorted map output file, avoid open / close between each partition >

[jira] [Updated] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-07-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5581: -- Assignee: Brian Cho (was: Josh Rosen) > When writing sorted map output file, avoid open / close

[jira] [Comment Edited] (SPARK-16603) Spark2.0 fail in executing the sql statement which field name begins with number,like "d.30_day_loss_user" while spark1.6 supports

2016-07-24 Thread keliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391268#comment-15391268 ] keliang edited comment on SPARK-16603 at 7/25/16 2:46 AM: -- Hi, I test this

[jira] [Commented] (SPARK-16603) Spark2.0 fail in executing the sql statement which field name begins with number,like "d.30_day_loss_user" while spark1.6 supports

2016-07-24 Thread keliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391268#comment-15391268 ] keliang commented on SPARK-16603: - Hi, I test this feature with spark-2.0.1-snapshot: first. create

[jira] [Resolved] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-07-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5581. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13382

[jira] [Assigned] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16698: Assignee: Apache Spark > json parsing regression - "." in keys >

[jira] [Assigned] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16698: Assignee: (was: Apache Spark) > json parsing regression - "." in keys >

[jira] [Commented] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391264#comment-15391264 ] Apache Spark commented on SPARK-16698: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-16701) Make parameters configurable in BlockManager

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391247#comment-15391247 ] Apache Spark commented on SPARK-16701: -- User 'lovexi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16701) Make parameters configurable in BlockManager

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16701: Assignee: (was: Apache Spark) > Make parameters configurable in BlockManager >

[jira] [Assigned] (SPARK-16701) Make parameters configurable in BlockManager

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16701: Assignee: Apache Spark > Make parameters configurable in BlockManager >

[jira] [Created] (SPARK-16701) Make parameters configurable in BlockManager

2016-07-24 Thread YangyangLiu (JIRA)
YangyangLiu created SPARK-16701: --- Summary: Make parameters configurable in BlockManager Key: SPARK-16701 URL: https://issues.apache.org/jira/browse/SPARK-16701 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16700) StructType doesn't accept Python dicts anymore

2016-07-24 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16700: --- Component/s: (was: Spark Core) > StructType doesn't accept Python dicts anymore >

[jira] [Updated] (SPARK-16700) StructType doesn't accept Python dicts anymore

2016-07-24 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16700: --- Description: Hello, I found this issue while testing my codebase with 2.0.0-rc5 StructType

[jira] [Updated] (SPARK-16700) StructType doesn't accept Python dicts anymore

2016-07-24 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16700: --- Component/s: PySpark > StructType doesn't accept Python dicts anymore >

[jira] [Created] (SPARK-16700) StructType doesn't accept Python dicts anymore

2016-07-24 Thread Sylvain Zimmer (JIRA)
Sylvain Zimmer created SPARK-16700: -- Summary: StructType doesn't accept Python dicts anymore Key: SPARK-16700 URL: https://issues.apache.org/jira/browse/SPARK-16700 Project: Spark Issue

[jira] [Commented] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391239#comment-15391239 ] Dongjoon Hyun commented on SPARK-16699: --- Hi, [~qifan]. Nice catch! By the way, usually, only

[jira] [Resolved] (SPARK-16645) rename CatalogStorageFormat.serdeProperties to properties

2016-07-24 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16645. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14283

[jira] [Commented] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391231#comment-15391231 ] Hyukjin Kwon commented on SPARK-16698: -- It seems it does not work for all `FileFormat` data sources.

[jira] [Commented] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391217#comment-15391217 ] Hyukjin Kwon commented on SPARK-16698: -- FYI, this does not happen when it is read from json RDD. Let

[jira] [Assigned] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16699: Assignee: Apache Spark > Fix performance bug in hash aggregate on long string keys >

[jira] [Commented] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391191#comment-15391191 ] Apache Spark commented on SPARK-16699: -- User 'ooq' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16699: Assignee: (was: Apache Spark) > Fix performance bug in hash aggregate on long string

[jira] [Updated] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Qifan Pu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qifan Pu updated SPARK-16699: - Description: In the following code in `VectorizedHashMapGenerator.scala`: ``` def hashBytes(b:

[jira] [Created] (SPARK-16699) Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread Qifan Pu (JIRA)
Qifan Pu created SPARK-16699: Summary: Fix performance bug in hash aggregate on long string keys Key: SPARK-16699 URL: https://issues.apache.org/jira/browse/SPARK-16699 Project: Spark Issue

[jira] [Commented] (SPARK-16685) audit release docs are ambiguous

2016-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391168#comment-15391168 ] Patrick Wendell commented on SPARK-16685: - These scripts are pretty old and I'm not sure if

[jira] [Created] (SPARK-16698) json parsing regression - "." in keys

2016-07-24 Thread TobiasP (JIRA)
TobiasP created SPARK-16698: --- Summary: json parsing regression - "." in keys Key: SPARK-16698 URL: https://issues.apache.org/jira/browse/SPARK-16698 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16589) Chained cartesian produces incorrect number of records

2016-07-24 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391108#comment-15391108 ] Maciej Szymkiewicz commented on SPARK-16589: [~holdenk] Makes sense. I was thinking more

[jira] [Comment Edited] (SPARK-12378) CREATE EXTERNAL TABLE AS SELECT EXPORT AWS S3 ERROR

2016-07-24 Thread Chandana Sapparapu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387889#comment-15387889 ] Chandana Sapparapu edited comment on SPARK-12378 at 7/24/16 3:46 PM: -

[jira] [Commented] (SPARK-16695) compile spark with scala 2.11 is not working (with Sbt)

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391088#comment-15391088 ] Sean Owen commented on SPARK-16695: --- `sbt -Dscala-2.11 package` works for 1.6.2 on my Mac. So does

[jira] [Commented] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

2016-07-24 Thread Mohamed Baddar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391082#comment-15391082 ] Mohamed Baddar commented on SPARK-3246: --- [~sheridanrawlins] Working on it soon, most probably on 1st

[jira] [Updated] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16696: --- Issue Type: Improvement (was: Bug) > unused broadcast variables should call destroy instead of

[jira] [Assigned] (SPARK-16697) redundant RDD computation in LDAOptimizer

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16697: Assignee: Apache Spark > redundant RDD computation in LDAOptimizer >

[jira] [Commented] (SPARK-16697) redundant RDD computation in LDAOptimizer

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391067#comment-15391067 ] Apache Spark commented on SPARK-16697: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-16697) redundant RDD computation in LDAOptimizer

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16697: Assignee: (was: Apache Spark) > redundant RDD computation in LDAOptimizer >

[jira] [Updated] (SPARK-16697) redundant RDD computation in LDAOptimizer

2016-07-24 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16697: --- Description: In mllib.clustering.LDAOptimizer the submitMiniBatch method, the stats: RDD do not

[jira] [Created] (SPARK-16697) redundant RDD computation in LDAOptimizer

2016-07-24 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-16697: -- Summary: redundant RDD computation in LDAOptimizer Key: SPARK-16697 URL: https://issues.apache.org/jira/browse/SPARK-16697 Project: Spark Issue Type:

[jira] [Updated] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16696: --- Description: Unused broadcast variables should call destroy() instead of unpersist() so that the

[jira] [Commented] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391050#comment-15391050 ] Apache Spark commented on SPARK-16696: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16696: Assignee: (was: Apache Spark) > unused broadcast variables should call destroy

[jira] [Assigned] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16696: Assignee: Apache Spark > unused broadcast variables should call destroy instead of

[jira] [Created] (SPARK-16696) unused broadcast variables should call destroy instead of unpersist

2016-07-24 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-16696: -- Summary: unused broadcast variables should call destroy instead of unpersist Key: SPARK-16696 URL: https://issues.apache.org/jira/browse/SPARK-16696 Project: Spark

[jira] [Created] (SPARK-16695) compile spark with scala 2.11 is not working (with Sbt)

2016-07-24 Thread Eran Mizrahi (JIRA)
Eran Mizrahi created SPARK-16695: Summary: compile spark with scala 2.11 is not working (with Sbt) Key: SPARK-16695 URL: https://issues.apache.org/jira/browse/SPARK-16695 Project: Spark

[jira] [Updated] (SPARK-16416) Logging in shutdown hook does not work properly with Log4j 2.x

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16416: -- Assignee: Mikael Ståldal > Logging in shutdown hook does not work properly with Log4j 2.x >

[jira] [Resolved] (SPARK-16416) Logging in shutdown hook does not work properly with Log4j 2.x

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16416. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14320

[jira] [Updated] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16667: -- Target Version/s: (was: 1.6.0) > Spark driver executor dont release unused memory >

[jira] [Updated] (SPARK-16692) multilabel classification to DataFrame, ML

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16692: -- Target Version/s: (was: 1.6.0) > multilabel classification to DataFrame, ML >

[jira] [Updated] (SPARK-16463) Support `truncate` option in Overwrite mode for JDBC DataFrameWriter

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16463: -- Assignee: Dongjoon Hyun > Support `truncate` option in Overwrite mode for JDBC DataFrameWriter >

[jira] [Resolved] (SPARK-16410) DataFrameWriter's jdbc method drops table in overwrite mode

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16410. --- Resolution: Duplicate > DataFrameWriter's jdbc method drops table in overwrite mode >

[jira] [Resolved] (SPARK-16463) Support `truncate` option in Overwrite mode for JDBC DataFrameWriter

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16463. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14086

[jira] [Commented] (SPARK-16685) audit release docs are ambiguous

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390990#comment-15390990 ] Sean Owen commented on SPARK-16685: --- [~pwendell] I think you put this in place; do you know if

[jira] [Resolved] (SPARK-16541) SparkTC application could not shutdown successfully

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16541. --- Resolution: Cannot Reproduce > SparkTC application could not shutdown successfully >

[jira] [Updated] (SPARK-16664) Spark 1.6.2 - Persist call on Data frames with more than 200 columns is wiping out the data.

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16664: -- Target Version/s: 2.0.1 > Spark 1.6.2 - Persist call on Data frames with more than 200 columns is >

[jira] [Resolved] (SPARK-16676) Spark jobs stay in pending

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16676. --- Resolution: Not A Problem If your executors aren't starting, then you have another earlier problem.

[jira] [Resolved] (SPARK-16573) executor stderr processing tools

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16573. --- Resolution: Won't Fix > executor stderr processing tools > - > >

[jira] [Resolved] (SPARK-16574) Distribute computing to each node based on certain hints

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16574. --- Resolution: Not A Problem > Distribute computing to each node based on certain hints >

[jira] [Resolved] (SPARK-16601) Spark2.0 fail in creating table using sql statement "create table `db.tableName` xxx" while spark1.6 supports

2016-07-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16601. --- Resolution: Not A Problem > Spark2.0 fail in creating table using sql statement "create table >

[jira] [Assigned] (SPARK-16694) Use for/foreach rather than map for Unit expressions whose side effects are required

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16694: Assignee: Apache Spark (was: Sean Owen) > Use for/foreach rather than map for Unit

[jira] [Assigned] (SPARK-16694) Use for/foreach rather than map for Unit expressions whose side effects are required

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16694: Assignee: Sean Owen (was: Apache Spark) > Use for/foreach rather than map for Unit

[jira] [Commented] (SPARK-16694) Use for/foreach rather than map for Unit expressions whose side effects are required

2016-07-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390982#comment-15390982 ] Apache Spark commented on SPARK-16694: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-16694) Use for/foreach rather than map for Unit expressions whose side effects are required

2016-07-24 Thread Sean Owen (JIRA)
Sean Owen created SPARK-16694: - Summary: Use for/foreach rather than map for Unit expressions whose side effects are required Key: SPARK-16694 URL: https://issues.apache.org/jira/browse/SPARK-16694