[jira] [Commented] (SPARK-1097) ConcurrentModificationException

2014-04-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958671#comment-13958671 ] Tsuyoshi OZAWA commented on SPARK-1097: --- A patch by Nishkam on HADOOP-10456 has been

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

2014-06-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020336#comment-14020336 ] Tsuyoshi OZAWA commented on SPARK-1097: --- [~jblomo], thank you for reporting. This

[jira] [Updated] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2014-11-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4267: -- Description: Currently we're trying Spark on YARN included in Hadoop 2.5.1. Hadoop 2.5 uses

[jira] [Created] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2014-11-06 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created SPARK-4267: - Summary: Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later Key: SPARK-4267 URL: https://issues.apache.org/jira/browse/SPARK-4267 Project: Spark

[jira] [Updated] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2014-11-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4267: -- Description: Currently we're trying Spark on YARN included in Hadoop 2.5.1. Hadoop 2.5 uses

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2014-11-07 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201959#comment-14201959 ] Tsuyoshi OZAWA commented on SPARK-4267: --- [~sandyr] [~pwendell] do you have any

[jira] [Created] (SPARK-4651) Adding -Phadoop-2.5 and -Phadoop-2.6 to compile with newer versions of Hadoop

2014-11-28 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created SPARK-4651: - Summary: Adding -Phadoop-2.5 and -Phadoop-2.6 to compile with newer versions of Hadoop Key: SPARK-4651 URL: https://issues.apache.org/jira/browse/SPARK-4651

[jira] [Commented] (SPARK-4651) Adding -Phadoop-2.5 and -Phadoop-2.6 to compile with newer versions of Hadoop

2014-11-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228571#comment-14228571 ] Tsuyoshi OZAWA commented on SPARK-4651: --- I'll send PR via github soon. Adding

[jira] [Updated] (SPARK-4651) Adding -Phadoop-2.5 and -Phadoop-2.6 to compile Spark with newer versions of Hadoop

2014-11-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4651: -- Summary: Adding -Phadoop-2.5 and -Phadoop-2.6 to compile Spark with newer versions of Hadoop

[jira] [Commented] (SPARK-4651) Adding -Phadoop-2.5 and -Phadoop-2.6 to compile Spark with newer versions of Hadoop

2014-11-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228576#comment-14228576 ] Tsuyoshi OZAWA commented on SPARK-4651: --- [~srowen], oops, I've thought it's already

[jira] [Updated] (SPARK-4651) Adding -Phadoop-2.4+ to compile Spark with newer versions of Hadoop

2014-11-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4651: -- Summary: Adding -Phadoop-2.4+ to compile Spark with newer versions of Hadoop (was: Adding

[jira] [Created] (SPARK-4678) A SQL query with subquery fails

2014-12-01 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created SPARK-4678: - Summary: A SQL query with subquery fails Key: SPARK-4678 URL: https://issues.apache.org/jira/browse/SPARK-4678 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

2014-12-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4678: -- Summary: A SQL query with subquery fails with TreeNodeException (was: A SQL query with

[jira] [Updated] (SPARK-4839) Adding documentations about dynamicAllocation

2014-12-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4839: -- Component/s: Documentation Adding documentations about dynamicAllocation

[jira] [Updated] (SPARK-4839) Adding documentations about dynamic resource allocation

2014-12-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4839: -- Summary: Adding documentations about dynamic resource allocation (was: Adding documentations

[jira] [Commented] (SPARK-4140) Document the dynamic allocation feature

2014-12-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249499#comment-14249499 ] Tsuyoshi OZAWA commented on SPARK-4140: --- How about converting this issue into one of

[jira] [Updated] (SPARK-4915) Wrong class name of external shuffle service in the dynamic allocation

2014-12-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4915: -- Description: docs/job-scheduling.md says as follows: {quote} To enable this service, set

[jira] [Created] (SPARK-4915) Wrong class name of external shuffle service in the dynamic allocation

2014-12-21 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created SPARK-4915: - Summary: Wrong class name of external shuffle service in the dynamic allocation Key: SPARK-4915 URL: https://issues.apache.org/jira/browse/SPARK-4915 Project:

[jira] [Updated] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

2014-12-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated SPARK-4915: -- Summary: Wrong classname of external shuffle service in the doc for dynamic allocation (was:

[jira] [Commented] (SPARK-2546) Configuration object thread safety issue

2015-01-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286971#comment-14286971 ] Tsuyoshi OZAWA commented on SPARK-2546: --- Now HADOOP-11209, the problem reported by

[jira] [Commented] (SPARK-2546) Configuration object thread safety issue

2015-07-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627909#comment-14627909 ] Tsuyoshi Ozawa commented on SPARK-2546: --- [~anknai] cc: [~joshrosen] the problem is

[jira] [Commented] (SPARK-18345) Structured Streaming quick examples fails with default configuration

2016-11-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646551#comment-15646551 ] Tsuyoshi Ozawa commented on SPARK-18345: I would like to tackle this problem. I fixed it locally,

[jira] [Created] (SPARK-18345) Structured Streaming quick examples fails with default configuration

2016-11-07 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created SPARK-18345: -- Summary: Structured Streaming quick examples fails with default configuration Key: SPARK-18345 URL: https://issues.apache.org/jira/browse/SPARK-18345 Project:

[jira] [Updated] (SPARK-18399) Examples in SparkSQL/DataFrame guide fails with default configuration

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated SPARK-18399: --- Summary: Examples in SparkSQL/DataFrame guide fails with default configuration (was:

[jira] [Updated] (SPARK-18399) Examples in SparkSQL/DataFrame fails with default configuration

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated SPARK-18399: --- Summary: Examples in SparkSQL/DataFrame fails with default configuration (was: Examples in

[jira] [Commented] (SPARK-18399) Examples in SparkSQL/DataFrame fails with default configurations

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653729#comment-15653729 ] Tsuyoshi Ozawa commented on SPARK-18399: We should use absolute path with "file:///" prefix,

[jira] [Created] (SPARK-18399) Examples in SparkSQL/DataFrame fails with default configurations

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created SPARK-18399: -- Summary: Examples in SparkSQL/DataFrame fails with default configurations Key: SPARK-18399 URL: https://issues.apache.org/jira/browse/SPARK-18399 Project: Spark

[jira] [Comment Edited] (SPARK-18399) Examples in SparkSQL/DataFrame fails with default configurations

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653722#comment-15653722 ] Tsuyoshi Ozawa edited comment on SPARK-18399 at 11/10/16 10:46 AM: ---

[jira] [Closed] (SPARK-18399) Examples in SparkSQL/DataFrame guide fails with default configuration

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa closed SPARK-18399. -- Resolution: Not A Problem It's completely my bad! I had a hadoop configuration on my local.

[jira] [Closed] (SPARK-18345) Structured Streaming quick examples fails with default configuration

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa closed SPARK-18345. -- Resolution: Not A Bug Oh, my bad. This was by mistake of my configuration. After clearing

[jira] [Commented] (SPARK-18399) Examples in SparkSQL/DataFrame fails with default configurations

2016-11-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653722#comment-15653722 ] Tsuyoshi Ozawa commented on SPARK-18399: {code} scala> val df =

[jira] [Created] (SPARK-19207) LocalSparkSession should use Slf4JLoggerFactory.INSTANCE instead of creating new object via constructor

2017-01-13 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created SPARK-19207: -- Summary: LocalSparkSession should use Slf4JLoggerFactory.INSTANCE instead of creating new object via constructor Key: SPARK-19207 URL:

[jira] [Commented] (SPARK-19207) LocalSparkSession should use Slf4JLoggerFactory.INSTANCE instead of creating new object via constructor

2017-01-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821417#comment-15821417 ] Tsuyoshi Ozawa commented on SPARK-19207: I will send PR to fix this problem > LocalSparkSession