[jira] [Created] (SPARK-2720) spark-examples should depend on HBase modules for HBase 0.96+

2014-07-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-2720: - Summary: spark-examples should depend on HBase modules for HBase 0.96+ Key: SPARK-2720 URL: https://issues.apache.org/jira/browse/SPARK-2720 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2720) spark-examples should depend on HBase modules for HBase 0.96+

2014-07-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077740#comment-14077740 ] Ted Yu commented on SPARK-2720: --- 0.98 is currently the stable release of HBase. bq. It

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

2014-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2706: -- Attachment: spark-hive.err This file shows the error I got after applying tentative patch. Enable Spark to

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

2014-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2706: -- Attachment: spark-2706-v1.txt Tentative patch. I copied Hive 0.13.1 artifacts to local maven repo manually.

[jira] [Created] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-2771: - Summary: GenerateMIMAIgnore fails scalastyle check due to long line Key: SPARK-2771 URL: https://issues.apache.org/jira/browse/SPARK-2771 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2771: -- Attachment: spark-2771-v1.txt Patch v1 shortens line 118 to 100 chars wide. GenerateMIMAIgnore fails

[jira] [Created] (SPARK-2772) Spark Project SQL fails compilation

2014-07-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-2772: - Summary: Spark Project SQL fails compilation Key: SPARK-2772 URL: https://issues.apache.org/jira/browse/SPARK-2772 Project: Spark Issue Type: Bug Reporter:

[jira] [Resolved] (SPARK-2772) Spark Project SQL fails compilation

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-2772. --- Resolution: Not a Problem 'mvn install' solves the issue. Spark Project SQL fails compilation

[jira] [Resolved] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-2771. --- Resolution: Fixed GenerateMIMAIgnore fails scalastyle check due to long line

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088747#comment-14088747 ] Ted Yu commented on SPARK-1297: --- Thanks for checking, Reynold. Upgrading dependency to 0.98

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089331#comment-14089331 ] Ted Yu commented on SPARK-1297: --- We can add two profiles for 0.98: hbase-hadoop1 and

[jira] [Commented] (SPARK-2706) Enable Spark to support Hive 0.13

2014-08-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091514#comment-14091514 ] Ted Yu commented on SPARK-2706: --- Running Hive test, I got: {code} ^[[31m*** RUN ABORTED

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v2.txt Tentative patch adds hbase-hadoop2 profile. Upgrade HBase dependency to 0.98.0

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: (was: spark-1297-v2.txt) Upgrade HBase dependency to 0.98.0

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v2.txt Upgrade HBase dependency to 0.98.0 --

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v4.txt Patch v4 adds two profiles to examples/pom.xml : hbase-hadoop1 (default)

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092988#comment-14092988 ] Ted Yu commented on SPARK-1297: --- HBase client doesn't need to specify dependency on

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093012#comment-14093012 ] Ted Yu commented on SPARK-1297: --- https://github.com/apache/spark/pull/1893 Upgrade HBase

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093466#comment-14093466 ] Ted Yu commented on SPARK-1297: --- w.r.t. build, by default, hbase-hadoop1 would be used. If

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: pom.xml This is examples/pom.xml for spark-1.0.2 Upgrade HBase dependency to 0.98.0

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v5.txt Upgrade HBase dependency to 0.98.0 --

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113977#comment-14113977 ] Ted Yu commented on SPARK-1297: --- Patch v5 is the aggregate of the 4 commits in the pull

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114113#comment-14114113 ] Ted Yu commented on SPARK-1297: --- Here is sample command for building against 0.98 hbase:

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-09-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133250#comment-14133250 ] Ted Yu commented on SPARK-1297: --- Please note: spark-1297-v5.txt is a level 0 patch.

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v6.txt Patch v6 uses 0.98.5 hbase release. Upgrade HBase dependency to 0.98.0

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Attachment: spark-4066-v1.txt With attached patch, developer can specify the following on command line:

[jira] [Created] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-4066: - Summary: Make whether maven builds fails on scalastyle violation configurable Key: SPARK-4066 URL: https://issues.apache.org/jira/browse/SPARK-4066 Project: Spark Issue

[jira] [Commented] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183016#comment-14183016 ] Ted Yu commented on SPARK-4066: --- bq. -Dscalastyle.failOnViolation was already a built-in way

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v7.txt Upgrade HBase dependency to 0.98.0 --

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198510#comment-14198510 ] Ted Yu commented on SPARK-1297: --- Patch v7 uses 0.98.7 hbase release Upgrade HBase

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198701#comment-14198701 ] Ted Yu commented on SPARK-1297: --- Create a new pull request:

[jira] [Created] (SPARK-4455) Exclude dependency on hbase-annotations module

2014-11-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-4455: - Summary: Exclude dependency on hbase-annotations module Key: SPARK-4455 URL: https://issues.apache.org/jira/browse/SPARK-4455 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1127) Add saveAsHBase to PairRDDFunctions

2014-12-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1423#comment-1423 ] Ted Yu commented on SPARK-1127: --- According to Reynold, First half of the external data

[jira] [Created] (SPARK-5041) hive-exec jar should be generated with JDK 6

2014-12-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5041: - Summary: hive-exec jar should be generated with JDK 6 Key: SPARK-5041 URL: https://issues.apache.org/jira/browse/SPARK-5041 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2015-01-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286407#comment-14286407 ] Ted Yu commented on SPARK-1714: --- {code} if (completedContainer.getExitStatus ==

[jira] [Commented] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2015-01-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286416#comment-14286416 ] Ted Yu commented on SPARK-1714: --- allocatedHostToContainersMap.synchronized is absent for the

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-01-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5041: -- Labels: jdk1.7 maven (was: maven) hive-exec jar should be generated with JDK 6

[jira] [Created] (SPARK-5427) Add support for floor function in Spark SQL

2015-01-27 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5427: - Summary: Add support for floor function in Spark SQL Key: SPARK-5427 URL: https://issues.apache.org/jira/browse/SPARK-5427 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-01-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5041: -- Labels: maven (was: ) hive-exec jar should be generated with JDK 6

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Labels: math (was: ) Add support for floor function in Spark SQL ---

[jira] [Created] (SPARK-6085) Increase default value for memory overhead

2015-02-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-6085: - Summary: Increase default value for memory overhead Key: SPARK-6085 URL: https://issues.apache.org/jira/browse/SPARK-6085 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6085) Increase default value for memory overhead

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342398#comment-14342398 ] Ted Yu commented on SPARK-6085: --- In my opinion, priority for this JIRA should be Major.

[jira] [Commented] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339169#comment-14339169 ] Ted Yu commented on SPARK-6045: --- The logic of CassandraHadoopMigrator.scala is unknown.

[jira] [Created] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
Ted Yu created SPARK-6045: - Summary: RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset Key: SPARK-6045 URL: https://issues.apache.org/jira/browse/SPARK-6045 Project:

[jira] [Commented] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339147#comment-14339147 ] Ted Yu commented on SPARK-6045: --- https://github.com/apache/spark/pull/4794 RecordWriter

[jira] [Created] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-7107: - Summary: Add parameter for zookeeper.znode.parent to hbase_inputformat.py Key: SPARK-7107 URL: https://issues.apache.org/jira/browse/SPARK-7107 Project: Spark Issue

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-04-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-7107: -- Description: [~yeshavora] first reported encountering the following exception running hbase_inputformat.py :

[jira] [Commented] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-05-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523503#comment-14523503 ] Ted Yu commented on SPARK-5041: --- Considering '[discuss] ending support for Java 6'

[jira] [Created] (SPARK-7450) Use UNSAFE.getLong() to speed up BitSetMethods#anySet()

2015-05-07 Thread Ted Yu (JIRA)
Ted Yu created SPARK-7450: - Summary: Use UNSAFE.getLong() to speed up BitSetMethods#anySet() Key: SPARK-7450 URL: https://issues.apache.org/jira/browse/SPARK-7450 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Commented] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

2015-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540083#comment-14540083 ] Ted Yu commented on SPARK-7538: --- As mentioned by Cody Koeninger on the mailing list, using

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-04-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Created] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-8336: - Summary: Fix NullPointerException with functions.rand() Key: SPARK-8336 URL: https://issues.apache.org/jira/browse/SPARK-8336 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-07-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Commented] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558316#comment-14558316 ] Ted Yu commented on SPARK-7853: --- Subject says ClassNotFoundException. Which class couldn't

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-05-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Created] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10074: -- Summary: Include Float in @specialized annotation Key: SPARK-10074 URL: https://issues.apache.org/jira/browse/SPARK-10074 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701388#comment-14701388 ] Ted Yu commented on SPARK-10074: I would argue that Double should be taken out from

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701332#comment-14701332 ] Ted Yu commented on SPARK-10074: I performed the following search in Spark codebase:

[jira] [Created] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Ted Yu (JIRA)
Ted Yu created SPARK-9446: - Summary: Clear Active SparkContext in stop() method Key: SPARK-9446 URL: https://issues.apache.org/jira/browse/SPARK-9446 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-10074) Include Float in @specialized annotation

2015-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-10074. Resolution: Later Until the need comes. Include Float in @specialized annotation

[jira] [Resolved] (SPARK-11286) Make Outbox stopped exception singleton

2015-10-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11286. Resolution: Won't Fix > Make Outbox stopped exception singleton > ---

[jira] [Created] (SPARK-11286) Make Outbox stopped exception singleton

2015-10-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11286: -- Summary: Make Outbox stopped exception singleton Key: SPARK-11286 URL: https://issues.apache.org/jira/browse/SPARK-11286 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980484#comment-14980484 ] Ted Yu commented on SPARK-11371: Since I cannot assign the JIRA to myself, attaching patch shows my

[jira] [Updated] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11348: --- Attachment: spark-11348.txt > Replace addOnCompleteCallback with addTaskCompletionListener() in >

[jira] [Created] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11348: -- Summary: Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter Key: SPARK-11348 URL: https://issues.apache.org/jira/browse/SPARK-11348 Project:

[jira] [Updated] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11348: --- Priority: Minor (was: Trivial) > Replace addOnCompleteCallback with addTaskCompletionListener() in >

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Created] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11318: -- Summary: [DOC] Include hive profile in make-distribution.sh command Key: SPARK-11318 URL: https://issues.apache.org/jira/browse/SPARK-11318 Project: Spark Issue Type:

[jira] [Created] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11371: -- Summary: Make "mean" an alias for "avg" operator Key: SPARK-11371 URL: https://issues.apache.org/jira/browse/SPARK-11371 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11371: --- Attachment: spark-11371-v1.patch > Make "mean" an alias for "avg" operator >

[jira] [Updated] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11572: --- Component/s: Spark Core > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Created] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11572: -- Summary: Exit AsynchronousListenerBus thread when stop() is called Key: SPARK-11572 URL: https://issues.apache.org/jira/browse/SPARK-11572 Project: Spark Issue Type:

[jira] [Created] (SPARK-11682) Commons-collections object deserialization may expose remote command execution vulnerability

2015-11-11 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11682: -- Summary: Commons-collections object deserialization may expose remote command execution vulnerability Key: SPARK-11682 URL: https://issues.apache.org/jira/browse/SPARK-11682

[jira] [Resolved] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11699. Resolution: Duplicate Same as SPARK-11290 > TrackStateRDDSuite fails on Jenkins builds >

[jira] [Resolved] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11572. Resolution: Won't Fix > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Created] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11761: -- Summary: Prevent the call to StreamingContext#stop() in the listener bus's thread Key: SPARK-11761 URL: https://issues.apache.org/jira/browse/SPARK-11761 Project: Spark

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002256#comment-15002256 ] Ted Yu commented on SPARK-11661: Looks like org.apache.spark.streaming.rdd.TrackStateRDDSuite started to

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002290#comment-15002290 ] Ted Yu commented on SPARK-11661: Should have looked back further. But it seems the test failure is not

[jira] [Updated] (SPARK-11662) Call startExecutorDelegationTokenRenewer() ahead of client app submission

2015-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11662: --- Component/s: YARN > Call startExecutorDelegationTokenRenewer() ahead of client app submission >

[jira] [Created] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11699: -- Summary: TrackStateRDDSuite fails on Jenkins builds Key: SPARK-11699 URL: https://issues.apache.org/jira/browse/SPARK-11699 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-11662) Call startExecutorDelegationTokenRenewer() ahead of client app submission

2015-11-11 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11662: -- Summary: Call startExecutorDelegationTokenRenewer() ahead of client app submission Key: SPARK-11662 URL: https://issues.apache.org/jira/browse/SPARK-11662 Project: Spark

[jira] [Created] (SPARK-11615) Drop @VisibleForTesting annotation

2015-11-09 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11615: -- Summary: Drop @VisibleForTesting annotation Key: SPARK-11615 URL: https://issues.apache.org/jira/browse/SPARK-11615 Project: Spark Issue Type: Bug Reporter:

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981887#comment-14981887 ] Ted Yu commented on SPARK-11371: That's true. > Make "mean" an alias for "avg" operator >

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985424#comment-14985424 ] Ted Yu commented on SPARK-11371: [~sowen]: Do you think it is worth adding the alias ? Thanks > Make

[jira] [Commented] (SPARK-11435) Stop SparkContext at the end of subtest in SparkListenerSuite

2015-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984422#comment-14984422 ] Ted Yu commented on SPARK-11435: LocalSparkContext would close the SparkContext. > Stop SparkContext at

[jira] [Created] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-01 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11442: -- Summary: Reduce numSlices for local metrics test of SparkListenerSuite Key: SPARK-11442 URL: https://issues.apache.org/jira/browse/SPARK-11442 Project: Spark Issue

[jira] [Created] (SPARK-11435) Stop SparkContext at the end of subtest in SparkListenerSuite

2015-10-30 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11435: -- Summary: Stop SparkContext at the end of subtest in SparkListenerSuite Key: SPARK-11435 URL: https://issues.apache.org/jira/browse/SPARK-11435 Project: Spark Issue

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985438#comment-14985438 ] Ted Yu commented on SPARK-11371: [~rxin] [~yhuai]: Your comment is welcome. > Make "mean" an alias for

[jira] [Commented] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983392#comment-14983392 ] Ted Yu commented on SPARK-11348: Without this change, make-distribution.sh is likely to bump into issue

[jira] [Created] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11172: -- Summary: Close JsonParser/Generator in test Key: SPARK-11172 URL: https://issues.apache.org/jira/browse/SPARK-11172 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Resolved] (SPARK-11048) Use ForkJoinPool as executorService

2015-10-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11048. Resolution: Won't Fix > Use ForkJoinPool as executorService > --- > >

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Commented] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954202#comment-14954202 ] Ted Yu commented on SPARK-10985: I am bit confused by the assignment of this JIRA. Normally assignee is

[jira] [Created] (SPARK-11048) Use ForkJoinPool as executorService

2015-10-10 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11048: -- Summary: Use ForkJoinPool as executorService Key: SPARK-11048 URL: https://issues.apache.org/jira/browse/SPARK-11048 Project: Spark Issue Type: Improvement

  1   2   3   >