[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Attachment: AbstractSparkJobRunner.java > Possible memory leak at SparkCont

[jira] [Created] (SPARK-11702) Guava ClassLoading Issue When Using Different Hive Metastore Version

2015-11-12 Thread Joey Paskhay (JIRA)
Joey Paskhay created SPARK-11702: Summary: Guava ClassLoading Issue When Using Different Hive Metastore Version Key: SPARK-11702 URL: https://issues.apache.org/jira/browse/SPARK-11702 Project: Spark

[jira] [Created] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2015-11-12 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-11701: - Summary: YARN - dynamic allocation and speculation active task accounting wrong Key: SPARK-11701 URL: https://issues.apache.org/jira/browse/SPARK-11701 Project: Spa

[jira] [Created] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
Kostas papageorgopoulos created SPARK-11700: --- Summary: Possible memory leak at SparkContext jobProgressListener stageIdToData map Key: SPARK-11700 URL: https://issues.apache.org/jira/browse/SPARK-11700

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Description: I have created a java webapp trying to abstractly Run some Spa

[jira] [Created] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11699: -- Summary: TrackStateRDDSuite fails on Jenkins builds Key: SPARK-11699 URL: https://issues.apache.org/jira/browse/SPARK-11699 Project: Spark Issue Type: Test R

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002385#comment-15002385 ] Cheng Lian commented on SPARK-11191: Spark SQL hasn't supported persisted functions y

[jira] [Commented] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

2015-11-12 Thread swetha k (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002384#comment-15002384 ] swetha k commented on SPARK-11620: -- [~hyukjin.kwon] We are using Spark 1.4.1 in one of

[jira] [Resolved] (SPARK-9039) Jobs page shows nonsensical task-progress-bar numbers when speculation occurs

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9039. -- Resolution: Cannot Reproduce > Jobs page shows nonsensical task-progress-bar numbers when speculation oc

[jira] [Updated] (SPARK-10911) Executors should System.exit on clean shutdown

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10911: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Executors should System.exit

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-11-12 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002340#comment-15002340 ] Narine Kokhlikyan commented on SPARK-5575: -- Here is the jira for extending the ou

[jira] [Commented] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002333#comment-15002333 ] Apache Spark commented on SPARK-11696: -- User 'NarineK' has created a pull request fo

[jira] [Assigned] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11696: Assignee: (was: Apache Spark) > MLLIB:Optimization - Extend optimizer output for Gradi

[jira] [Assigned] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11696: Assignee: Apache Spark > MLLIB:Optimization - Extend optimizer output for GradientDescent

[jira] [Resolved] (SPARK-11673) Remove the normal Project physical operator (and keep TungstenProject)

2015-11-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11673. - Resolution: Fixed Fix Version/s: 1.6.0 > Remove the normal Project physical operator (and

[jira] [Commented] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002318#comment-15002318 ] Apache Spark commented on SPARK-11698: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11698: Assignee: (was: Apache Spark) > Add option to ignore kafka messages that are out of li

[jira] [Assigned] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11698: Assignee: Apache Spark > Add option to ignore kafka messages that are out of limit rate >

[jira] [Created] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11698: --- Summary: Add option to ignore kafka messages that are out of limit rate Key: SPARK-11698 URL: https://issues.apache.org/jira/browse/SPARK-11698 Project: Spark

[jira] [Commented] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002311#comment-15002311 ] Narine Kokhlikyan commented on SPARK-11696: --- I've done some investigations abou

[jira] [Updated] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Sam Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Fang updated SPARK-11697: - Summary: Spark submit can't load user config file using Standalone cluster (was: Spark submit can't load

[jira] [Created] (SPARK-11697) Spark submit can't load file when specify with --files using Standalone cluster

2015-11-12 Thread Sam Fang (JIRA)
Sam Fang created SPARK-11697: Summary: Spark submit can't load file when specify with --files using Standalone cluster Key: SPARK-11697 URL: https://issues.apache.org/jira/browse/SPARK-11697 Project: Spar

[jira] [Updated] (SPARK-11696) MLlib:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-11696: -- Summary: MLlib:Optimization - Extend optimizer output for GradientDescent and LBFGS (w

[jira] [Updated] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-11696: -- Summary: MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS (w

[jira] [Created] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2015-11-12 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-11696: - Summary: MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS Key: SPARK-11696 URL: https://issues.apache.org/jira/browse/SPARK-11696

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002290#comment-15002290 ] Ted Yu commented on SPARK-11661: Should have looked back further. But it seems the test

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002268#comment-15002268 ] Yin Huai commented on SPARK-11661: -- It started to fail before my pr (see https://amplab

[jira] [Assigned] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11191: Assignee: (was: Apache Spark) > [1.5] Can't create UDF's using hive thrift service > -

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002270#comment-15002270 ] Apache Spark commented on SPARK-11191: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11191: Assignee: Apache Spark > [1.5] Can't create UDF's using hive thrift service >

[jira] [Updated] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11661: - Fix Version/s: (was: 1.7.0) > We should still pushdown filters returned by a data source's unhandledF

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002263#comment-15002263 ] Yin Huai commented on SPARK-11661: -- Does that use any data source at all? > We should s

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002256#comment-15002256 ] Ted Yu commented on SPARK-11661: Looks like org.apache.spark.streaming.rdd.TrackStateRDDS

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Study Hsueh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002208#comment-15002208 ] Study Hsueh commented on SPARK-11191: - I think you also need to lookup permanent user

[jira] [Assigned] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11695: Assignee: Apache Spark > Set s3a credentials by default similarly to s3 and s3n >

[jira] [Commented] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002151#comment-15002151 ] Apache Spark commented on SPARK-11695: -- User 'Zariel' has created a pull request for

[jira] [Assigned] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11695: Assignee: (was: Apache Spark) > Set s3a credentials by default similarly to s3 and s3n

[jira] [Created] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Chris Bannister (JIRA)
Chris Bannister created SPARK-11695: --- Summary: Set s3a credentials by default similarly to s3 and s3n Key: SPARK-11695 URL: https://issues.apache.org/jira/browse/SPARK-11695 Project: Spark

[jira] [Updated] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

2015-11-12 Thread Chris Bannister (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Bannister updated SPARK-11695: Component/s: Spark Core > Set s3a credentials by default similarly to s3 and s3n >

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002139#comment-15002139 ] Apache Spark commented on SPARK-10186: -- User 'cloud-fan' has created a pull request

[jira] [Comment Edited] (SPARK-9435) Java UDFs don't work with GROUP BY expressions

2015-11-12 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002126#comment-15002126 ] DOAN DuyHai edited comment on SPARK-9435 at 11/12/15 1:58 PM: --

[jira] [Commented] (SPARK-9435) Java UDFs don't work with GROUP BY expressions

2015-11-12 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002126#comment-15002126 ] DOAN DuyHai commented on SPARK-9435: Work-around: *define the UDF using the Scala API

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002047#comment-15002047 ] Cheng Lian commented on SPARK-11191: This issue consists of two bugs. One of them is

[jira] [Resolved] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos resolved SPARK-10909. - Resolution: Fixed Fix Version/s: 1.5.3 > Spark sql jdbc fails for

[jira] [Resolved] (SPARK-11680) graphx it's now surpport semantic graphs and have data lake?

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11680. --- Resolution: Invalid > graphx it's now surpport semantic graphs and have data lake? >

[jira] [Comment Edited] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001994#comment-15001994 ] Kostas papageorgopoulos edited comment on SPARK-10909 at 11/12/15 11:49 AM: ---

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-10909: Affects Version/s: 1.5.0 > Spark sql jdbc fails for Oracle NUMBER type colu

[jira] [Resolved] (SPARK-11682) Commons-collections object deserialization may expose remote command execution vulnerability

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11682. --- Resolution: Duplicate [~tedyu] I think you're familiar enough with this project to know to have a lo

[jira] [Commented] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001994#comment-15001994 ] Kostas papageorgopoulos commented on SPARK-10909: - This issue seems resol

[jira] [Updated] (SPARK-10909) Spark sql jdbc fails for Oracle NUMBER type columns

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-10909: Affects Version/s: 1.5.2 > Spark sql jdbc fails for Oracle NUMBER type colu

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001986#comment-15001986 ] Apache Spark commented on SPARK-11583: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-11694) Parquet logical types are not being tested properly

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11694: Assignee: (was: Apache Spark) > Parquet logical types are not being tested properly >

[jira] [Commented] (SPARK-11694) Parquet logical types are not being tested properly

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001930#comment-15001930 ] Apache Spark commented on SPARK-11694: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-11694) Parquet logical types are not being tested properly

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11694: Assignee: Apache Spark > Parquet logical types are not being tested properly > ---

[jira] [Created] (SPARK-11694) Parquet logical types are not being tested properly

2015-11-12 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-11694: Summary: Parquet logical types are not being tested properly Key: SPARK-11694 URL: https://issues.apache.org/jira/browse/SPARK-11694 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-11676) Parquet filter tests all pass if filters are not really pushed down

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11676: Assignee: (was: Apache Spark) > Parquet filter tests all pass if filters are not reall

[jira] [Assigned] (SPARK-11676) Parquet filter tests all pass if filters are not really pushed down

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11676: Assignee: Apache Spark > Parquet filter tests all pass if filters are not really pushed do

[jira] [Commented] (SPARK-11676) Parquet filter tests all pass if filters are not really pushed down

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001913#comment-15001913 ] Apache Spark commented on SPARK-11676: -- User 'HyukjinKwon' has created a pull reques

[jira] [Comment Edited] (SPARK-11693) spark kafka direct streaming exception

2015-11-12 Thread xiaoxiaoluo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001877#comment-15001877 ] xiaoxiaoluo edited comment on SPARK-11693 at 11/12/15 9:48 AM:

[jira] [Commented] (SPARK-5968) Parquet warning in spark-shell

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001885#comment-15001885 ] Cheng Lian commented on SPARK-5968: --- As explained in the JIRA description, this issue sh

[jira] [Commented] (SPARK-11693) spark kafka direct streaming exception

2015-11-12 Thread xiaoxiaoluo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001877#comment-15001877 ] xiaoxiaoluo commented on SPARK-11693: - Should we catch this exception from this file

[jira] [Created] (SPARK-11693) spark kafka direct streaming exception

2015-11-12 Thread xiaoxiaoluo (JIRA)
xiaoxiaoluo created SPARK-11693: --- Summary: spark kafka direct streaming exception Key: SPARK-11693 URL: https://issues.apache.org/jira/browse/SPARK-11693 Project: Spark Issue Type: Question

[jira] [Assigned] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11692: Assignee: (was: Apache Spark) > Support for Parquet logical types, JSON and BSON (embe

[jira] [Assigned] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11692: Assignee: Apache Spark > Support for Parquet logical types, JSON and BSON (embedded types)

[jira] [Commented] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001870#comment-15001870 ] Apache Spark commented on SPARK-11692: -- User 'HyukjinKwon' has created a pull reques

[jira] [Updated] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11692: - Summary: Support for Parquet logical types, JSON and BSON (embedded types) (was: Support for Pa

[jira] [Commented] (SPARK-9435) Java UDFs don't work with GROUP BY expressions

2015-11-12 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001866#comment-15001866 ] DOAN DuyHai commented on SPARK-9435: Same error for me: {code:java} // Regist

[jira] [Commented] (SPARK-11692) Support for Parquet logical types, JSON and BISON (embedded types)

2015-11-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001855#comment-15001855 ] Hyukjin Kwon commented on SPARK-11692: -- I will work on this. > Support for Parquet

[jira] [Resolved] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11661. Resolution: Fixed Fix Version/s: 1.6.0 1.7.0 Issue resolved by pull reque

[jira] [Created] (SPARK-11692) Support for Parquet logical types, JSON and BISON (embedded types)

2015-11-12 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-11692: Summary: Support for Parquet logical types, JSON and BISON (embedded types) Key: SPARK-11692 URL: https://issues.apache.org/jira/browse/SPARK-11692 Project: Spark

[jira] [Assigned] (SPARK-11691) Allow to specify compression codec in HadoopFsRelation when saving

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11691: Assignee: (was: Apache Spark) > Allow to specify compression codec in HadoopFsRelation

[jira] [Commented] (SPARK-11691) Allow to specify compression codec in HadoopFsRelation when saving

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001834#comment-15001834 ] Apache Spark commented on SPARK-11691: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-11691) Allow to specify compression codec in HadoopFsRelation when saving

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11691: Assignee: Apache Spark > Allow to specify compression codec in HadoopFsRelation when savin

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-12 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001815#comment-15001815 ] Naden Franciscus commented on SPARK-11617: -- Can confirm both of these issues. Co

<    1   2   3