[jira] [Commented] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-07-11 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371504#comment-15371504 ] Timothy Hunter commented on SPARK-14816: Also, in `mllib-guide.md`, let's switch the order

[jira] [Commented] (SPARK-16313) Spark should not silently drop exceptions in file listing

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371505#comment-15371505 ] Apache Spark commented on SPARK-16313: -- User 'yhuai' has created a pull request for this issue:

[jira] [Created] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-11 Thread Timothy Hunter (JIRA)
Timothy Hunter created SPARK-16485: -- Summary: Additional fixes to Mllib 2.0 documentation Key: SPARK-16485 URL: https://issues.apache.org/jira/browse/SPARK-16485 Project: Spark Issue Type:

[jira] [Created] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog

2016-07-11 Thread Yongjia Wang (JIRA)
Yongjia Wang created SPARK-16484: Summary: Incremental Cardinality estimation operations with Hyperloglog Key: SPARK-16484 URL: https://issues.apache.org/jira/browse/SPARK-16484 Project: Spark

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:59 PM:

[jira] [Created] (SPARK-16483) Unifying struct fields and columns

2016-07-11 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-16483: --- Summary: Unifying struct fields and columns Key: SPARK-16483 URL: https://issues.apache.org/jira/browse/SPARK-16483 Project: Spark Issue Type: New

[jira] [Created] (SPARK-16482) If a table's schema is inferred at runtime, describe table command does not show the schema

2016-07-11 Thread Yin Huai (JIRA)
Yin Huai created SPARK-16482: Summary: If a table's schema is inferred at runtime, describe table command does not show the schema Key: SPARK-16482 URL: https://issues.apache.org/jira/browse/SPARK-16482

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:52 PM:

[jira] [Updated] (SPARK-16270) Implement xpath user defined functions

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16270: Fix Version/s: 2.0.0 > Implement xpath user defined functions >

[jira] [Updated] (SPARK-16270) Implement xpath user defined functions

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16270: Fix Version/s: (was: 2.1.0) > Implement xpath user defined functions >

[jira] [Updated] (SPARK-16318) xpath_int, xpath_short, xpath_long, xpath_float, xpath_double, xpath_string, and xpath

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16318: Fix Version/s: 2.0.0 > xpath_int, xpath_short, xpath_long, xpath_float, xpath_double,

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:27 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:20 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:18 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:16 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:09 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:08 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 7:09 PM:

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

2016-07-11 Thread Vladimir Feinberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371420#comment-15371420 ] Vladimir Feinberg commented on SPARK-10931: --- [~josephkb] Te intention of this JIRA is a bit

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos commented on SPARK-16480: - >From the logs above in the SIGTERM case the

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371401#comment-15371401 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 6:55 PM:

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371385#comment-15371385 ] Xin Ren commented on SPARK-16445: - great to know, I'll start on it, thanks Xiangrui > Multilayer

[jira] [Updated] (SPARK-16447) LDA wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16447: -- Assignee: Xusen Yin > LDA wrapper in SparkR > - > > Key:

[jira] [Commented] (SPARK-16447) LDA wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371384#comment-15371384 ] Xiangrui Meng commented on SPARK-16447: --- Assigned. Thanks! > LDA wrapper in SparkR >

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371382#comment-15371382 ] Xiangrui Meng commented on SPARK-16445: --- The target version is 2.1.0. So no strict deadline but

[jira] [Updated] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16445: -- Assignee: Xin Ren > Multilayer Perceptron Classifier wrapper in SparkR >

[jira] [Updated] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16444: -- Assignee: Miao Wang > Isotonic Regression wrapper in SparkR >

[jira] [Commented] (SPARK-16468) Confusing results when describe() used on DataFrame with chr columns

2016-07-11 Thread Neil Dewar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371335#comment-15371335 ] Neil Dewar commented on SPARK-16468: Thank you Shivaram `options("digits")` returns $digits [1] 7

[jira] [Closed] (SPARK-16427) Expand documentation on the various RDD storage levels

2016-07-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas closed SPARK-16427. Resolution: Invalid > Expand documentation on the various RDD storage levels >

[jira] [Commented] (SPARK-16427) Expand documentation on the various RDD storage levels

2016-07-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371321#comment-15371321 ] Nicholas Chammas commented on SPARK-16427: -- Oh nevermind, this information is all available

[jira] [Commented] (SPARK-16284) Implement reflect and java_method SQL function

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371304#comment-15371304 ] Apache Spark commented on SPARK-16284: -- User 'petermaxlee' has created a pull request for this

[jira] [Commented] (SPARK-15623) 2.0 python coverage ml.feature

2016-07-11 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371229#comment-15371229 ] Bryan Cutler commented on SPARK-15623: -- Hey [~holdenk], think I can close this off now or would you

[jira] [Commented] (SPARK-16468) Confusing results when describe() used on DataFrame with chr columns

2016-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371207#comment-15371207 ] Dongjoon Hyun commented on SPARK-16468: --- Hi, [~shivaram]. Thank you for pining me. My PR

[jira] [Resolved] (SPARK-16270) Implement xpath user defined functions

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16270. - Resolution: Fixed Assignee: Peter Lee Fix Version/s: 2.1.0 > Implement xpath

[jira] [Commented] (SPARK-16275) Implement all the Hive fallback functions

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371199#comment-15371199 ] Reynold Xin commented on SPARK-16275: - Note that some of these might result in slightly different

[jira] [Updated] (SPARK-16459) Prevent dropping current database

2016-07-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-16459: -- Fix Version/s: (was: 2.1.0) 2.0.0 > Prevent dropping current

[jira] [Commented] (SPARK-16468) Confusing results when describe() used on DataFrame with chr columns

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371188#comment-15371188 ] Shivaram Venkataraman commented on SPARK-16468: --- Are the character columns problem fixed by

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371163#comment-15371163 ] Shivaram Venkataraman commented on SPARK-16055: --- The if condition at

[jira] [Commented] (SPARK-6089) Size of task result fetched can't be found in UI

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371156#comment-15371156 ] Shivaram Venkataraman commented on SPARK-6089: -- You can check some of the PRs that added or

[jira] [Commented] (SPARK-15816) SQL server based on Postgres protocol

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371147#comment-15371147 ] Reynold Xin commented on SPARK-15816: - Yea definitely -- but you'd need to do enough prototyping to

[jira] [Commented] (SPARK-15816) SQL server based on Postgres protocol

2016-07-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371138#comment-15371138 ] Takeshi Yamamuro commented on SPARK-15816: -- [~rxin] Would it be better to make a design doc. for

[jira] [Resolved] (SPARK-16477) Bump master version to 2.1.0-SNAPSHOT

2016-07-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16477. - Resolution: Fixed Fix Version/s: 2.1.0 > Bump master version to 2.1.0-SNAPSHOT >

[jira] [Commented] (SPARK-16283) Implement percentile_approx SQL function

2016-07-11 Thread Tim Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371112#comment-15371112 ] Tim Hunter commented on SPARK-16283: We should, the algorithm picked is optimized for this use case.

[jira] [Commented] (SPARK-15816) SQL server based on Postgres protocol

2016-07-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371091#comment-15371091 ] Takeshi Yamamuro commented on SPARK-15816: -- I'm working on this prototype:

[jira] [Commented] (SPARK-16344) Array of struct with a single field name "element" can't be decoded from Parquet files written by Spark 1.6+

2016-07-11 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371013#comment-15371013 ] Ryan Blue commented on SPARK-16344: --- Sounds good to me! I like the idea of converting back to the

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370989#comment-15370989 ] Sean Owen commented on SPARK-16480: --- I've caught SIGINT in a program with sun.misc.Signal but it's

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370854#comment-15370854 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 2:46 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370854#comment-15370854 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 2:45 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370854#comment-15370854 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 2:36 PM:

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang edited comment on SPARK-3181 at 7/11/16 2:35 PM: - [~dbtsai]

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370854#comment-15370854 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 2:34 PM:

[jira] [Comment Edited] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang edited comment on SPARK-3181 at 7/11/16 2:31 PM: - [~dbtsai]

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370871#comment-15370871 ] Yanbo Liang commented on SPARK-3181: [~dbtsai] [~MechCoder] There is one problem need to be discussed:

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370854#comment-15370854 ] Stavros Kontopoulos commented on SPARK-16480: - Yes sc is null. I saw that part of the code.

[jira] [Commented] (SPARK-16435) Behavior changes if initialExecutor is less than minExecutor for dynamic allocation

2016-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370836#comment-15370836 ] Thomas Graves commented on SPARK-16435: --- Yeah I agree,I'm not as worried about this one as I am the

[jira] [Commented] (SPARK-16451) Spark-shell / pyspark should finish gracefully when "SaslException: GSS initiate failed" is hit

2016-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370832#comment-15370832 ] Thomas Graves commented on SPARK-16451: --- I think there are a bunch of cases where if the

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-07-11 Thread Sharad Sonker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370831#comment-15370831 ] Sharad Sonker commented on SPARK-4105: -- I'm using 1.5.1 and was also facing this exception. The issue

[jira] [Commented] (SPARK-16455) Add a new hook in CoarseGrainedSchedulerBackend in order to stop scheduling new tasks when cluster is restarting

2016-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370828#comment-15370828 ] Thomas Graves commented on SPARK-16455: --- | we are implementing a new mechanism which will let

[jira] [Created] (SPARK-16481) Spark does not update statistics when making use of Hive partitions

2016-07-11 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-16481: Summary: Spark does not update statistics when making use of Hive partitions Key: SPARK-16481 URL: https://issues.apache.org/jira/browse/SPARK-16481 Project:

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370784#comment-15370784 ] Sean Owen commented on SPARK-16480: --- Hm, if it happens with SIGINT then SIGTERM isn't the issue per se,

[jira] [Commented] (SPARK-15703) Spark UI doesn't show all tasks as completed when it should

2016-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370762#comment-15370762 ] Thomas Graves commented on SPARK-15703: --- sorry for my delay in responding, we reproduced this again

[jira] [Resolved] (SPARK-16459) Prevent dropping current database

2016-07-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16459. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 >

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 1:03 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 1:04 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 1:02 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 1:01 PM:

[jira] [Comment Edited] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos edited comment on SPARK-16480 at 7/11/16 12:52 PM:

[jira] [Updated] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16480: Description: A customer gets the following exception when tries to stop gracefully

[jira] [Commented] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370647#comment-15370647 ] Maciej Bryński commented on SPARK-16439: [~proflin] I don't know if waiting is right decision if

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370644#comment-15370644 ] Stavros Kontopoulos commented on SPARK-16480: - [~srowen] Ok i will fix the format. SIGINT

[jira] [Commented] (SPARK-16479) Add Asynchronous Actions Example

2016-07-11 Thread sandeep purohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370639#comment-15370639 ] sandeep purohit commented on SPARK-16479: - [~srowen] Its not related to document i add examples

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370623#comment-15370623 ] Liwei Lin edited comment on SPARK-16439 at 7/11/16 12:15 PM: - Hi [~dongjoon],

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370623#comment-15370623 ] Liwei Lin edited comment on SPARK-16439 at 7/11/16 12:14 PM: - Hi [~dongjoon],

[jira] [Commented] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370623#comment-15370623 ] Liwei Lin commented on SPARK-16439: --- Hi [~dongjoon], would mind leaving this open or two days or three?

[jira] [Resolved] (SPARK-16381) Update SQL examples and programming guide for R language binding

2016-07-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16381. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14082

[jira] [Updated] (SPARK-16479) Add Asynchronous Actions Example

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16479: -- Target Version/s: (was: 1.6.2) Labels: (was: beginner newbie) Fix Version/s:

[jira] [Updated] (SPARK-13569) Kafka DStreams from wildcard topic filters

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13569: -- Assignee: Cody Koeninger > Kafka DStreams from wildcard topic filters >

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370602#comment-15370602 ] Sean Owen commented on SPARK-16480: --- [~skonto] can you edit this down a bit / format it better? I'm

[jira] [Comment Edited] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370595#comment-15370595 ] Michał Wesołowski edited comment on SPARK-16478 at 7/11/16 11:49 AM: -

[jira] [Comment Edited] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370595#comment-15370595 ] Michał Wesołowski edited comment on SPARK-16478 at 7/11/16 11:47 AM: -

[jira] [Updated] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16480: Description: A customer gets the following exception when tries to stop gracefully

[jira] [Updated] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16480: Description: A customer gets the following exception when tries to stop gracefully

[jira] [Created] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-11 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-16480: --- Summary: Streaming checkpointing does not work well with SIGTERM Key: SPARK-16480 URL: https://issues.apache.org/jira/browse/SPARK-16480 Project: Spark

[jira] [Commented] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370595#comment-15370595 ] Michał Wesołowski commented on SPARK-16478: --- If you run code that I provided on databrics you

[jira] [Assigned] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16478: Assignee: (was: Apache Spark) > strongly connected components doesn't cache returned

[jira] [Commented] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370591#comment-15370591 ] Apache Spark commented on SPARK-16478: -- User 'wesolowskim' has created a pull request for this

[jira] [Assigned] (SPARK-16478) strongly connected components doesn't cache returned RDD

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16478: Assignee: Apache Spark > strongly connected components doesn't cache returned RDD >

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370577#comment-15370577 ] Sean Owen commented on SPARK-14813: --- OK, pedantically, I just want to make sure that: things that

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński edited comment on SPARK-16439 at 7/11/16 11:21 AM: -- OK.

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński edited comment on SPARK-16439 at 7/11/16 11:19 AM: -- OK.

[jira] [Assigned] (SPARK-16282) Implement percentile SQL function

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16282: Assignee: (was: Apache Spark) > Implement percentile SQL function >

[jira] [Assigned] (SPARK-16282) Implement percentile SQL function

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16282: Assignee: Apache Spark > Implement percentile SQL function >

[jira] [Commented] (SPARK-16282) Implement percentile SQL function

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370571#comment-15370571 ] Apache Spark commented on SPARK-16282: -- User 'jiangxb1987' has created a pull request for this

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński edited comment on SPARK-16439 at 7/11/16 11:04 AM: -- OK.

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński edited comment on SPARK-16439 at 7/11/16 11:04 AM: -- OK.

[jira] [Comment Edited] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński edited comment on SPARK-16439 at 7/11/16 11:02 AM: -- OK.

[jira] [Updated] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16439: --- Attachment: sample.png > Incorrect information in SQL Query details >

[jira] [Commented] (SPARK-16439) Incorrect information in SQL Query details

2016-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370555#comment-15370555 ] Maciej Bryński commented on SPARK-16439: OK. Got this. Using spark-shell {code} case class

[jira] [Commented] (SPARK-15923) Spark Application rest api returns "no such app: "

2016-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370547#comment-15370547 ] Steve Loughran commented on SPARK-15923: I do think the docs could be clarified a bit here; when

[jira] [Commented] (SPARK-16479) Add Asynchronous Actions Example

2016-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370536#comment-15370536 ] Apache Spark commented on SPARK-16479: -- User 'phalodi' has created a pull request for this issue:

<    1   2   3   >