[jira] [Updated] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-12181: --- Component/s: Spark Core > Check Cached unaligned-access capability before using Unsafe >

[jira] [Created] (SPARK-12074) Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

2015-12-01 Thread Ted Yu (JIRA)
Ted Yu created SPARK-12074: -- Summary: Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray) Key: SPARK-12074 URL: https://issues.apache.org/jira/browse/SPARK-12074 Project: Spark

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-11-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029183#comment-15029183 ] Ted Yu commented on SPARK-11206: Looks like SQLListenerMemoryLeakSuite fails on maven Jenkins now. e.g.

[jira] [Commented] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024837#comment-15024837 ] Ted Yu commented on SPARK-11884: Is there interest in moving forward with the PR ? > Drop multiple

[jira] [Created] (SPARK-11971) Start py4j callback server for Java Gateway

2015-11-24 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11971: -- Summary: Start py4j callback server for Java Gateway Key: SPARK-11971 URL: https://issues.apache.org/jira/browse/SPARK-11971 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-11971) Start py4j callback server for Java Gateway

2015-11-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11971. Resolution: Not A Problem The callback server is started in _ensure_initialized of

[jira] [Created] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-11-20 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11884: -- Summary: Drop multiple columns in the DataFrame API Key: SPARK-11884 URL: https://issues.apache.org/jira/browse/SPARK-11884 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-11872) Prevent the call to SparkContext#stop() in the listener bus's thread

2015-11-19 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11872: -- Summary: Prevent the call to SparkContext#stop() in the listener bus's thread Key: SPARK-11872 URL: https://issues.apache.org/jira/browse/SPARK-11872 Project: Spark

[jira] [Resolved] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11572. Resolution: Won't Fix > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Created] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11761: -- Summary: Prevent the call to StreamingContext#stop() in the listener bus's thread Key: SPARK-11761 URL: https://issues.apache.org/jira/browse/SPARK-11761 Project: Spark

[jira] [Resolved] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11699. Resolution: Duplicate Same as SPARK-11290 > TrackStateRDDSuite fails on Jenkins builds >

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002256#comment-15002256 ] Ted Yu commented on SPARK-11661: Looks like org.apache.spark.streaming.rdd.TrackStateRDDSuite started to

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002290#comment-15002290 ] Ted Yu commented on SPARK-11661: Should have looked back further. But it seems the test failure is not

[jira] [Created] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11699: -- Summary: TrackStateRDDSuite fails on Jenkins builds Key: SPARK-11699 URL: https://issues.apache.org/jira/browse/SPARK-11699 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-11682) Commons-collections object deserialization may expose remote command execution vulnerability

2015-11-11 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11682: -- Summary: Commons-collections object deserialization may expose remote command execution vulnerability Key: SPARK-11682 URL: https://issues.apache.org/jira/browse/SPARK-11682

[jira] [Updated] (SPARK-11662) Call startExecutorDelegationTokenRenewer() ahead of client app submission

2015-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11662: --- Component/s: YARN > Call startExecutorDelegationTokenRenewer() ahead of client app submission >

[jira] [Created] (SPARK-11662) Call startExecutorDelegationTokenRenewer() ahead of client app submission

2015-11-11 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11662: -- Summary: Call startExecutorDelegationTokenRenewer() ahead of client app submission Key: SPARK-11662 URL: https://issues.apache.org/jira/browse/SPARK-11662 Project: Spark

[jira] [Created] (SPARK-11615) Drop @VisibleForTesting annotation

2015-11-09 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11615: -- Summary: Drop @VisibleForTesting annotation Key: SPARK-11615 URL: https://issues.apache.org/jira/browse/SPARK-11615 Project: Spark Issue Type: Bug Reporter:

[jira] [Updated] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11572: --- Component/s: Spark Core > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Created] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-08 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11572: -- Summary: Exit AsynchronousListenerBus thread when stop() is called Key: SPARK-11572 URL: https://issues.apache.org/jira/browse/SPARK-11572 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985424#comment-14985424 ] Ted Yu commented on SPARK-11371: [~sowen]: Do you think it is worth adding the alias ? Thanks > Make

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985438#comment-14985438 ] Ted Yu commented on SPARK-11371: [~rxin] [~yhuai]: Your comment is welcome. > Make "mean" an alias for

[jira] [Commented] (SPARK-11435) Stop SparkContext at the end of subtest in SparkListenerSuite

2015-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984422#comment-14984422 ] Ted Yu commented on SPARK-11435: LocalSparkContext would close the SparkContext. > Stop SparkContext at

[jira] [Created] (SPARK-11442) Reduce numSlices for local metrics test of SparkListenerSuite

2015-11-01 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11442: -- Summary: Reduce numSlices for local metrics test of SparkListenerSuite Key: SPARK-11442 URL: https://issues.apache.org/jira/browse/SPARK-11442 Project: Spark Issue

[jira] [Created] (SPARK-11435) Stop SparkContext at the end of subtest in SparkListenerSuite

2015-10-30 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11435: -- Summary: Stop SparkContext at the end of subtest in SparkListenerSuite Key: SPARK-11435 URL: https://issues.apache.org/jira/browse/SPARK-11435 Project: Spark Issue

[jira] [Commented] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983392#comment-14983392 ] Ted Yu commented on SPARK-11348: Without this change, make-distribution.sh is likely to bump into issue

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980484#comment-14980484 ] Ted Yu commented on SPARK-11371: Since I cannot assign the JIRA to myself, attaching patch shows my

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981887#comment-14981887 ] Ted Yu commented on SPARK-11371: That's true. > Make "mean" an alias for "avg" operator >

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Created] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11371: -- Summary: Make "mean" an alias for "avg" operator Key: SPARK-11371 URL: https://issues.apache.org/jira/browse/SPARK-11371 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-10-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11371: --- Attachment: spark-11371-v1.patch > Make "mean" an alias for "avg" operator >

[jira] [Updated] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11348: --- Attachment: spark-11348.txt > Replace addOnCompleteCallback with addTaskCompletionListener() in >

[jira] [Created] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11348: -- Summary: Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter Key: SPARK-11348 URL: https://issues.apache.org/jira/browse/SPARK-11348 Project:

[jira] [Updated] (SPARK-11348) Replace addOnCompleteCallback with addTaskCompletionListener() in UnsafeExternalSorter

2015-10-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-11348: --- Priority: Minor (was: Trivial) > Replace addOnCompleteCallback with addTaskCompletionListener() in >

[jira] [Created] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11318: -- Summary: [DOC] Include hive profile in make-distribution.sh command Key: SPARK-11318 URL: https://issues.apache.org/jira/browse/SPARK-11318 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-11286) Make Outbox stopped exception singleton

2015-10-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11286. Resolution: Won't Fix > Make Outbox stopped exception singleton > ---

[jira] [Created] (SPARK-11286) Make Outbox stopped exception singleton

2015-10-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11286: -- Summary: Make Outbox stopped exception singleton Key: SPARK-11286 URL: https://issues.apache.org/jira/browse/SPARK-11286 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11172: -- Summary: Close JsonParser/Generator in test Key: SPARK-11172 URL: https://issues.apache.org/jira/browse/SPARK-11172 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Commented] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954202#comment-14954202 ] Ted Yu commented on SPARK-10985: I am bit confused by the assignment of this JIRA. Normally assignee is

[jira] [Resolved] (SPARK-11048) Use ForkJoinPool as executorService

2015-10-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11048. Resolution: Won't Fix > Use ForkJoinPool as executorService > --- > >

[jira] [Created] (SPARK-11048) Use ForkJoinPool as executorService

2015-10-10 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11048: -- Summary: Use ForkJoinPool as executorService Key: SPARK-11048 URL: https://issues.apache.org/jira/browse/SPARK-11048 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Updated] (SPARK-10787) Consider replacing ObjectOutputStream for serialization to prevent OOME

2015-10-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10787: --- Priority: Major (was: Minor) > Consider replacing ObjectOutputStream for serialization to prevent OOME >

[jira] [Updated] (SPARK-10787) Consider replacing ObjectOutputStream for serialization to prevent OOME

2015-10-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10787: --- Summary: Consider replacing ObjectOutputStream for serialization to prevent OOME (was: Reset

[jira] [Updated] (SPARK-10787) Consider replacing ObjectOutputStream for serialization to prevent OOME

2015-10-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10787: --- Description: In the thread, Spark ClosureCleaner or java serializer OOM when trying to grow

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-09-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Commented] (SPARK-10787) Reset ObjectOutputStream more often to prevent OOME

2015-09-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934292#comment-14934292 ] Ted Yu commented on SPARK-10787: I can think of two approaches: 1. Cloning ObjectOutputStream using weak

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-09-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-09-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Updated] (SPARK-10787) Reset ObjectOutputStream more often to prevent OOME

2015-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10787: --- Description: In the thread, Spark ClosureCleaner or java serializer OOM when trying to grow

[jira] [Created] (SPARK-10787) Reset ObjectOutputStream more often to prevent OOME

2015-09-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10787: -- Summary: Reset ObjectOutputStream more often to prevent OOME Key: SPARK-10787 URL: https://issues.apache.org/jira/browse/SPARK-10787 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10721) Log warning when file deletion fails

2015-09-20 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10721: -- Summary: Log warning when file deletion fails Key: SPARK-10721 URL: https://issues.apache.org/jira/browse/SPARK-10721 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-09-11 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10561: -- Summary: Provide tooling for auto-generating Spark SQL reference manual Key: SPARK-10561 URL: https://issues.apache.org/jira/browse/SPARK-10561 Project: Spark Issue

[jira] [Created] (SPARK-10546) Check partitionId's range in ExternalSorter#spill()

2015-09-10 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10546: -- Summary: Check partitionId's range in ExternalSorter#spill() Key: SPARK-10546 URL: https://issues.apache.org/jira/browse/SPARK-10546 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Resolved] (SPARK-10074) Include Float in @specialized annotation

2015-08-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-10074. Resolution: Later Until the need comes. Include Float in @specialized annotation

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701388#comment-14701388 ] Ted Yu commented on SPARK-10074: I would argue that Double should be taken out from

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701332#comment-14701332 ] Ted Yu commented on SPARK-10074: I performed the following search in Spark codebase:

[jira] [Created] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10074: -- Summary: Include Float in @specialized annotation Key: SPARK-10074 URL: https://issues.apache.org/jira/browse/SPARK-10074 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Ted Yu (JIRA)
Ted Yu created SPARK-9446: - Summary: Clear Active SparkContext in stop() method Key: SPARK-9446 URL: https://issues.apache.org/jira/browse/SPARK-9446 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-07-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-07-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Created] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-8336: - Summary: Fix NullPointerException with functions.rand() Key: SPARK-8336 URL: https://issues.apache.org/jira/browse/SPARK-8336 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-05-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Commented] (SPARK-7853) ClassNotFoundException for SparkSQL

2015-05-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558316#comment-14558316 ] Ted Yu commented on SPARK-7853: --- Subject says ClassNotFoundException. Which class couldn't

[jira] [Commented] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

2015-05-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540083#comment-14540083 ] Ted Yu commented on SPARK-7538: --- As mentioned by Cody Koeninger on the mailing list, using

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Created] (SPARK-7450) Use UNSAFE.getLong() to speed up BitSetMethods#anySet()

2015-05-07 Thread Ted Yu (JIRA)
Ted Yu created SPARK-7450: - Summary: Use UNSAFE.getLong() to speed up BitSetMethods#anySet() Key: SPARK-7450 URL: https://issues.apache.org/jira/browse/SPARK-7450 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-05-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523503#comment-14523503 ] Ted Yu commented on SPARK-5041: --- Considering '[discuss] ending support for Java 6'

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2015-04-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Description: Here is the thread Koert started:

[jira] [Created] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-7107: - Summary: Add parameter for zookeeper.znode.parent to hbase_inputformat.py Key: SPARK-7107 URL: https://issues.apache.org/jira/browse/SPARK-7107 Project: Spark Issue

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-7107: -- Description: [~yeshavora] first reported encountering the following exception running hbase_inputformat.py :

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-04-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Description: floor() function is supported in Hive SQL. This issue is to add floor() function to Spark SQL.

[jira] [Commented] (SPARK-6085) Increase default value for memory overhead

2015-03-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342398#comment-14342398 ] Ted Yu commented on SPARK-6085: --- In my opinion, priority for this JIRA should be Major.

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Labels: math (was: ) Add support for floor function in Spark SQL ---

[jira] [Created] (SPARK-6085) Increase default value for memory overhead

2015-02-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-6085: - Summary: Increase default value for memory overhead Key: SPARK-6085 URL: https://issues.apache.org/jira/browse/SPARK-6085 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339169#comment-14339169 ] Ted Yu commented on SPARK-6045: --- The logic of CassandraHadoopMigrator.scala is unknown.

[jira] [Created] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
Ted Yu created SPARK-6045: - Summary: RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset Key: SPARK-6045 URL: https://issues.apache.org/jira/browse/SPARK-6045 Project:

[jira] [Commented] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339147#comment-14339147 ] Ted Yu commented on SPARK-6045: --- https://github.com/apache/spark/pull/4794 RecordWriter

[jira] [Created] (SPARK-5427) Add support for floor function in Spark SQL

2015-01-27 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5427: - Summary: Add support for floor function in Spark SQL Key: SPARK-5427 URL: https://issues.apache.org/jira/browse/SPARK-5427 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2015-01-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286407#comment-14286407 ] Ted Yu commented on SPARK-1714: --- {code} if (completedContainer.getExitStatus ==

[jira] [Commented] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2015-01-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286416#comment-14286416 ] Ted Yu commented on SPARK-1714: --- allocatedHostToContainersMap.synchronized is absent for the

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-01-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5041: -- Labels: jdk1.7 maven (was: maven) hive-exec jar should be generated with JDK 6

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-01-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5041: -- Labels: maven (was: ) hive-exec jar should be generated with JDK 6

[jira] [Created] (SPARK-5041) hive-exec jar should be generated with JDK 6

2014-12-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5041: - Summary: hive-exec jar should be generated with JDK 6 Key: SPARK-5041 URL: https://issues.apache.org/jira/browse/SPARK-5041 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1127) Add saveAsHBase to PairRDDFunctions

2014-12-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1423#comment-1423 ] Ted Yu commented on SPARK-1127: --- According to Reynold, First half of the external data

[jira] [Created] (SPARK-4455) Exclude dependency on hbase-annotations module

2014-11-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-4455: - Summary: Exclude dependency on hbase-annotations module Key: SPARK-4455 URL: https://issues.apache.org/jira/browse/SPARK-4455 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v7.txt Upgrade HBase dependency to 0.98.0 --

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198510#comment-14198510 ] Ted Yu commented on SPARK-1297: --- Patch v7 uses 0.98.7 hbase release Upgrade HBase

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198701#comment-14198701 ] Ted Yu commented on SPARK-1297: --- Create a new pull request:

[jira] [Commented] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183016#comment-14183016 ] Ted Yu commented on SPARK-4066: --- bq. -Dscalastyle.failOnViolation was already a built-in way

[jira] [Updated] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-4066: -- Attachment: spark-4066-v1.txt With attached patch, developer can specify the following on command line:

[jira] [Created] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-23 Thread Ted Yu (JIRA)
Ted Yu created SPARK-4066: - Summary: Make whether maven builds fails on scalastyle violation configurable Key: SPARK-4066 URL: https://issues.apache.org/jira/browse/SPARK-4066 Project: Spark Issue

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-10-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v6.txt Patch v6 uses 0.98.5 hbase release. Upgrade HBase dependency to 0.98.0

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-09-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133250#comment-14133250 ] Ted Yu commented on SPARK-1297: --- Please note: spark-1297-v5.txt is a level 0 patch.

<    1   2   3   >