[jira] [Updated] (SPARK-17577) SparkR support add files to Spark job and get by executors

2016-09-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17577: Description: Scala/Python users can add files to Spark job by submit options {{--files}} or

[jira] [Commented] (SPARK-17591) Fix/investigate the failure of tests in Scala On Windows

2016-09-18 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502356#comment-15502356 ] Jagadeesan A S commented on SPARK-17591: [~hyukjin.kwon] i would like to work on this issue.

[jira] [Commented] (SPARK-15472) Add support for writing partitioned `csv`, `json`, `text` formats in Structured Streaming

2016-09-18 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502305#comment-15502305 ] Shixiong Zhu commented on SPARK-15472: -- Not yet. Right now we don't use partition information of

[jira] [Updated] (SPARK-15472) Add support for writing partitioned `csv`, `json`, `text` formats in Structured Streaming

2016-09-18 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-15472: - Summary: Add support for writing partitioned `csv`, `json`, `text` formats in Structured

[jira] [Updated] (SPARK-17590) Analyze CTE definitions at once and allow CTE subquery to define CTE

2016-09-18 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17590: Summary: Analyze CTE definitions at once and allow CTE subquery to define CTE (was:

[jira] [Updated] (SPARK-17590) Analyze CTE definitions at once and allow CTE subquery to define CTE

2016-09-18 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17590: Description: We substitute logical plan with CTE definitions in the analyzer rule

[jira] [Updated] (SPARK-17577) SparkR support add files to Spark job and get by executors

2016-09-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17577: Description: Scala/Python users can add files to Spark job by submit options {{--files}} or

[jira] [Commented] (SPARK-17591) Fix/investigate the failure of tests in Scala On Windows

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502252#comment-15502252 ] Hyukjin Kwon commented on SPARK-17591: -- Please cc me if any of you is interested in and would like

[jira] [Updated] (SPARK-17591) Fix/investigate the failure of tests in Scala On Windows

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17591: - Description: {code} Tests run: 90, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 17.53 sec

[jira] [Updated] (SPARK-17591) Fix/investigate the failure of tests in Scala On Windows

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17591: - Description: {code} Tests run: 90, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 17.53 sec

[jira] [Created] (SPARK-17591) Fix/investigate the failure of tests in Scala On Windows

2016-09-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17591: Summary: Fix/investigate the failure of tests in Scala On Windows Key: SPARK-17591 URL: https://issues.apache.org/jira/browse/SPARK-17591 Project: Spark

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Nathan Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502064#comment-15502064 ] Nathan Beyer commented on SPARK-17545: -- This is a PR based on my suggestion above. It would be nicer

[jira] [Assigned] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17545: Assignee: (was: Apache Spark) > Spark SQL Catalyst doesn't handle ISO 8601 date

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502061#comment-15502061 ] Apache Spark commented on SPARK-17545: -- User 'nbeyer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17545: Assignee: Apache Spark > Spark SQL Catalyst doesn't handle ISO 8601 date without colon in

[jira] [Commented] (SPARK-17590) Analyze CTE definitions at once

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502050#comment-15502050 ] Apache Spark commented on SPARK-17590: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17590) Analyze CTE definitions at once

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17590: Assignee: (was: Apache Spark) > Analyze CTE definitions at once >

[jira] [Assigned] (SPARK-17590) Analyze CTE definitions at once

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17590: Assignee: Apache Spark > Analyze CTE definitions at once >

[jira] [Created] (SPARK-17590) Analyze CTE definitions at once

2016-09-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-17590: --- Summary: Analyze CTE definitions at once Key: SPARK-17590 URL: https://issues.apache.org/jira/browse/SPARK-17590 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17582) Dead executors shouldn't show in the SparkUI

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-17582: -- Summary: Dead executors shouldn't show in the SparkUI (was: Dead executors are still shown in the UI on

[jira] [Updated] (SPARK-17582) Dead executors are still shown in the UI on purpose

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-17582: -- Summary: Dead executors are still shown in the UI on purpose (was: Error Executor info in SparkUI

[jira] [Comment Edited] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501969#comment-15501969 ] xukun edited comment on SPARK-17582 at 9/19/16 1:27 AM: [~sowen] Yes. I means:

[jira] [Commented] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501969#comment-15501969 ] xukun commented on SPARK-17582: --- [~sowen] It means, dead executors shouldn't show in the SparkUI. > Error

[jira] [Updated] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-17582: -- Description: When executor is losted, SparkUI ExecutorsTab still show its executor info. class

[jira] [Updated] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

2016-09-18 Thread sai pavan kumar chitti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sai pavan kumar chitti updated SPARK-17588: --- Description: hi, i am getting java.lang.AssertionError error when running

[jira] [Commented] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

2016-09-18 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501927#comment-15501927 ] Jianfei Wang commented on SPARK-17579: -- {code} 16/09/19 08:49:41 INFO TaskSetManager: Starting task

[jira] [Commented] (SPARK-17589) Fix test case `create external table`

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501921#comment-15501921 ] Apache Spark commented on SPARK-17589: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17589) Fix test case `create external table`

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17589: Assignee: (was: Apache Spark) > Fix test case `create external table` >

[jira] [Assigned] (SPARK-17589) Fix test case `create external table`

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17589: Assignee: Apache Spark > Fix test case `create external table` >

[jira] [Created] (SPARK-17589) Fix test case `create external table`

2016-09-18 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17589: --- Summary: Fix test case `create external table` Key: SPARK-17589 URL: https://issues.apache.org/jira/browse/SPARK-17589 Project: Spark Issue Type: Test

[jira] [Comment Edited] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

2016-09-18 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501910#comment-15501910 ] Jianfei Wang edited comment on SPARK-17579 at 9/19/16 12:41 AM: Yeah,if i

[jira] [Commented] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

2016-09-18 Thread Jianfei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501910#comment-15501910 ] Jianfei Wang commented on SPARK-17579: -- Yeah,if i change A[T:Encoder] to A[T],it will work both in

[jira] [Resolved] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

2016-09-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17571. - Resolution: Fixed Assignee: Peter Lee Fix Version/s: 2.1.0

[jira] [Created] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

2016-09-18 Thread sai pavan kumar chitti (JIRA)
sai pavan kumar chitti created SPARK-17588: -- Summary: java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function. Key: SPARK-17588 URL:

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501682#comment-15501682 ] Hyukjin Kwon commented on SPARK-17545: -- I think maybe, we should just change this to

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501666#comment-15501666 ] Hyukjin Kwon commented on SPARK-17545: -- I left my comment as I am confirmed that the fixed version

[jira] [Assigned] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17587: Assignee: Apache Spark > SparseVector __getitem__ should follow __getitem__ contract >

[jira] [Commented] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501581#comment-15501581 ] Apache Spark commented on SPARK-17587: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17587: Assignee: (was: Apache Spark) > SparseVector __getitem__ should follow __getitem__

[jira] [Created] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

2016-09-18 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-17587: -- Summary: SparseVector __getitem__ should follow __getitem__ contract Key: SPARK-17587 URL: https://issues.apache.org/jira/browse/SPARK-17587 Project:

[jira] [Commented] (SPARK-17584) Add test coverage for TaskState and ExecutorState

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501570#comment-15501570 ] Apache Spark commented on SPARK-17584: -- User 'erenavsarogullari' has created a pull request for this

[jira] [Assigned] (SPARK-17584) Add test coverage for TaskState and ExecutorState

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17584: Assignee: (was: Apache Spark) > Add test coverage for TaskState and ExecutorState >

[jira] [Assigned] (SPARK-17584) Add test coverage for TaskState and ExecutorState

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17584: Assignee: Apache Spark > Add test coverage for TaskState and ExecutorState >

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Nathan Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501550#comment-15501550 ] Nathan Beyer commented on SPARK-17545: -- Here's what I would suggest (I can build a PR, but want to

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Nathan Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501532#comment-15501532 ] Nathan Beyer commented on SPARK-17545: -- In looking at the javadoc again and what commons-lang seem

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-18 Thread Nathan Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501486#comment-15501486 ] Nathan Beyer commented on SPARK-17545: -- Is it safe to assume the preference is to stick with the

[jira] [Commented] (SPARK-17297) Clarify window/slide duration as absolute time, not relative to a calendar

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501447#comment-15501447 ] Apache Spark commented on SPARK-17297: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17297) Clarify window/slide duration as absolute time, not relative to a calendar

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17297: Assignee: Sean Owen (was: Apache Spark) > Clarify window/slide duration as absolute

[jira] [Assigned] (SPARK-17297) Clarify window/slide duration as absolute time, not relative to a calendar

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17297: Assignee: Apache Spark (was: Sean Owen) > Clarify window/slide duration as absolute

[jira] [Updated] (SPARK-17297) Clarify window/slide duration as absolute time, not relative to a calendar

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17297: -- Assignee: Sean Owen Priority: Minor (was: Major) Component/s: (was: SQL)

[jira] [Updated] (SPARK-16462) Spark 2.0 CSV does not cast null values to certain data types properly

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16462: -- Assignee: Liwei Lin > Spark 2.0 CSV does not cast null values to certain data types properly >

[jira] [Resolved] (SPARK-16462) Spark 2.0 CSV does not cast null values to certain data types properly

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16462. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Resolved] (SPARK-16460) Spark 2.0 CSV ignores NULL value in Date format

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16460. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16460) Spark 2.0 CSV ignores NULL value in Date format

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16460: -- Assignee: Liwei Lin > Spark 2.0 CSV ignores NULL value in Date format >

[jira] [Resolved] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15144. --- Resolution: Duplicate > option nullValue for CSV data source not working for several types. >

[jira] [Updated] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17586: -- Assignee: Hyukjin Kwon > Use Static member not via instance reference >

[jira] [Resolved] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17586. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Resolved] (SPARK-17479) Fix LDA example in docs

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17479. --- Resolution: Not A Problem Target Version/s: (was: 2.0.1, 2.1.0) > Fix LDA example in

[jira] [Resolved] (SPARK-17401) Scala IDE not able to connect to Spark Master

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17401. --- Resolution: Not A Problem > Scala IDE not able to connect to Spark Master >

[jira] [Commented] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501194#comment-15501194 ] Sean Owen commented on SPARK-17579: --- Is there more to the error? this doesn't say why it could not

[jira] [Commented] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501185#comment-15501185 ] Sean Owen commented on SPARK-17582: --- Dead executors are still shown in the UI on purpose. Is that what

[jira] [Resolved] (SPARK-17546) start-* scripts should use hostname -f

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17546. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Assigned] (SPARK-17546) start-* scripts should use hostname -f

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-17546: - Assignee: Sean Owen > start-* scripts should use hostname -f >

[jira] [Resolved] (SPARK-17578) Modify default value of spark.app.name in configuration for spark session

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17578. --- Resolution: Duplicate >From PRs it sounds like this is a duplicate, but there's no real detail here

[jira] [Resolved] (SPARK-17542) Compiler warning in UnsafeInMemorySorter class

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17542. --- Resolution: Duplicate > Compiler warning in UnsafeInMemorySorter class >

[jira] [Resolved] (SPARK-17506) Improve the check double values equality rule

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17506. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15059

[jira] [Updated] (SPARK-17506) Improve the check double values equality rule

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17506: -- Component/s: Tests > Improve the check double values equality rule >

[jira] [Updated] (SPARK-17506) Improve the check double values equality rule

2016-09-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17506: -- Assignee: Jiang Xingbo > Improve the check double values equality rule >

[jira] [Assigned] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17586: Assignee: Apache Spark > Use Static member not via instance reference >

[jira] [Commented] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501065#comment-15501065 ] Apache Spark commented on SPARK-17586: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17586: Assignee: (was: Apache Spark) > Use Static member not via instance reference >

[jira] [Assigned] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17585: Assignee: Apache Spark > PySpark SparkContext.addFile supports adding files recursively >

[jira] [Updated] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively

2016-09-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17585: Component/s: Spark Core > PySpark SparkContext.addFile supports adding files recursively >

[jira] [Commented] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501063#comment-15501063 ] Apache Spark commented on SPARK-17585: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17585: Assignee: (was: Apache Spark) > PySpark SparkContext.addFile supports adding files

[jira] [Updated] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17586: - Component/s: (was: Spark Core) Build > Use Static member not via instance

[jira] [Created] (SPARK-17586) Use Static member not via instance reference

2016-09-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17586: Summary: Use Static member not via instance reference Key: SPARK-17586 URL: https://issues.apache.org/jira/browse/SPARK-17586 Project: Spark Issue Type:

[jira] [Created] (SPARK-17585) PySpark SparkContext.addFile supports adding files recursively

2016-09-18 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-17585: --- Summary: PySpark SparkContext.addFile supports adding files recursively Key: SPARK-17585 URL: https://issues.apache.org/jira/browse/SPARK-17585 Project: Spark

[jira] [Created] (SPARK-17584) Add test coverage for TaskState and ExecutorState

2016-09-18 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-17584: -- Summary: Add test coverage for TaskState and ExecutorState Key: SPARK-17584 URL: https://issues.apache.org/jira/browse/SPARK-17584 Project: Spark

[jira] [Updated] (SPARK-17541) fix some DDL bugs about table management when same-name temp view exists

2016-09-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17541: Fix Version/s: 2.0.1 > fix some DDL bugs about table management when same-name temp view exists >

[jira] [Resolved] (SPARK-17541) fix some DDL bugs about table management when same-name temp view exists

2016-09-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17541. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15099

[jira] [Comment Edited] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-09-18 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500750#comment-15500750 ] Kevin Zhang edited comment on SPARK-12221 at 9/18/16 10:35 AM: --- hi, is

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-09-18 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500750#comment-15500750 ] Kevin Zhang commented on SPARK-12221: - hi, is there any plan to put this to trunk?? > Add CPU time

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-09-18 Thread Xiaomeng Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500745#comment-15500745 ] Xiaomeng Huang commented on SPARK-12221: hi, do you have any plans to put this to trunk? > Add

[jira] [Commented] (SPARK-17315) Add Kolmogorov-Smirnov Test to SparkR

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500729#comment-15500729 ] Apache Spark commented on SPARK-17315: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17583) Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17583: Assignee: (was: Apache Spark) > Remove unused rowSeparator variable and set

[jira] [Commented] (SPARK-17583) Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500632#comment-15500632 ] Apache Spark commented on SPARK-17583: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17583) Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

2016-09-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17583: Assignee: Apache Spark > Remove unused rowSeparator variable and set auto-expanding

[jira] [Created] (SPARK-17583) Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

2016-09-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17583: Summary: Remove unused rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV Key: SPARK-17583 URL:

[jira] [Updated] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-17582: -- Description: When executor is losted, SparkUI ExecutorsTab still show its executor info. class

[jira] [Updated] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-17582: -- Description: When executor is losted, SparkUI ExecutorsTab still show its executor info. class

[jira] [Created] (SPARK-17582) Error Executor info in SparkUI ExecutorsTab

2016-09-18 Thread xukun (JIRA)
xukun created SPARK-17582: - Summary: Error Executor info in SparkUI ExecutorsTab Key: SPARK-17582 URL: https://issues.apache.org/jira/browse/SPARK-17582 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500522#comment-15500522 ] Saisai Shao commented on SPARK-17566: - I've already submitted a PR under SPARK-17512, since this JIRA

[jira] [Comment Edited] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Zhenhua Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500502#comment-15500502 ] Zhenhua Xu edited comment on SPARK-17566 at 9/18/16 7:55 AM: - [~saisai_shao]

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Zhenhua Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500516#comment-15500516 ] Zhenhua Xu commented on SPARK-17566: Right, I was retyping the code in the comment editor on my

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500511#comment-15500511 ] Saisai Shao commented on SPARK-17566: - Shouldn't it be {{!isYarnCluster}}? Since we need to avoid

[jira] [Comment Edited] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Zhenhua Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500502#comment-15500502 ] Zhenhua Xu edited comment on SPARK-17566 at 9/18/16 7:46 AM: - [~saisai_shao]

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

2016-09-18 Thread Zhenhua Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500502#comment-15500502 ] Zhenhua Xu commented on SPARK-17566: [~saisai_shao] I did some debugging, the issue seems to be on

[jira] [Updated] (SPARK-17518) Block Users to Specify the Internal Data Source Provider Hive

2016-09-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17518: Assignee: Xiao Li (was: Wenchen Fan) > Block Users to Specify the Internal Data Source Provider

[jira] [Assigned] (SPARK-17518) Block Users to Specify the Internal Data Source Provider Hive

2016-09-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-17518: --- Assignee: Wenchen Fan > Block Users to Specify the Internal Data Source Provider Hive >

  1   2   >