[jira] [Created] (SPARK-11758) Missing Index column while creating a DataFrame from Pandas

2015-11-16 Thread Leandro Ferrado (JIRA)
Leandro Ferrado created SPARK-11758: --- Summary: Missing Index column while creating a DataFrame from Pandas Key: SPARK-11758 URL: https://issues.apache.org/jira/browse/SPARK-11758 Project: Spark

[jira] [Created] (SPARK-11759) Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found

2015-11-16 Thread Luis Alves (JIRA)
Luis Alves created SPARK-11759: -- Summary: Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found Key: SPARK-11759 URL: https://issues.apache.org/jira/browse/SPARK-11759

[jira] [Commented] (SPARK-11202) Unsupported dataType

2015-11-16 Thread F Jimenez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006897#comment-15006897 ] F Jimenez commented on SPARK-11202: --- I have noticed the following commit that may have solved the

[jira] [Updated] (SPARK-11752) fix timezone problem for DateTimeUtils.getSeconds

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11752: --- Fix Version/s: (was: 1.5.2) 1.5.3 > fix timezone problem for

[jira] [Commented] (SPARK-11665) Support other distance metrics for bisecting k-means

2015-11-16 Thread Jun Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006793#comment-15006793 ] Jun Zheng commented on SPARK-11665: --- If no one else is interested, can you assign to me? > Support

[jira] [Resolved] (SPARK-11572) Exit AsynchronousListenerBus thread when stop() is called

2015-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11572. Resolution: Won't Fix > Exit AsynchronousListenerBus thread when stop() is called >

[jira] [Resolved] (SPARK-11522) input_file_name() returns "" for external tables

2015-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11522. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9542

[jira] [Resolved] (SPARK-11743) Add UserDefinedType support to RowEncoder

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11743. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9712

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

2015-11-16 Thread Kristina Plazonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006824#comment-15006824 ] Kristina Plazonic commented on SPARK-10935: --- [~xusen] Thanks for pinging. Yes, I think I

[jira] [Resolved] (SPARK-11752) fix timezone problem for DateTimeUtils.getSeconds

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11752. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-11-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006828#comment-15006828 ] Pedro Vilaça commented on SPARK-8332: - We're facing the same problem with a spark streaming job and I

[jira] [Updated] (SPARK-11522) input_file_name() returns "" for external tables

2015-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11522: - Assignee: Xin Wu > input_file_name() returns "" for external tables >

[jira] [Commented] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-16 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006895#comment-15006895 ] Kostas papageorgopoulos commented on SPARK-11700: - One workaround to minimize the effect

[jira] [Created] (SPARK-11760) SQL Catalyst data time test fails

2015-11-16 Thread JIRA
Jean-Baptiste Onofré created SPARK-11760: Summary: SQL Catalyst data time test fails Key: SPARK-11760 URL: https://issues.apache.org/jira/browse/SPARK-11760 Project: Spark Issue

[jira] [Resolved] (SPARK-11044) Parquet writer version fixed as version1

2015-11-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11044. Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9060

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006672#comment-15006672 ] Apache Spark commented on SPARK-11191: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-11757) Incorrect join output for joining two dataframes loaded from Parquet format

2015-11-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Petri Kärkäs updated SPARK-11757: - Description: Reading in dataframes from Parquet format in s3, and executing a join between them

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006654#comment-15006654 ] Apache Spark commented on SPARK-11530: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11530) Return eigenvalues with PCA model

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11530: Assignee: Apache Spark > Return eigenvalues with PCA model >

[jira] [Assigned] (SPARK-11530) Return eigenvalues with PCA model

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11530: Assignee: (was: Apache Spark) > Return eigenvalues with PCA model >

[jira] [Created] (SPARK-11757) Incorrect join output for joining two dataframes loaded from Parquet format

2015-11-16 Thread JIRA
Petri Kärkäs created SPARK-11757: Summary: Incorrect join output for joining two dataframes loaded from Parquet format Key: SPARK-11757 URL: https://issues.apache.org/jira/browse/SPARK-11757 Project:

[jira] [Resolved] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11692. Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9658

[jira] [Updated] (SPARK-11044) Parquet writer version fixed as version1

2015-11-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11044: --- Assignee: Hyukjin Kwon > Parquet writer version fixed as version1 >

[jira] [Updated] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

2015-11-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11692: --- Assignee: Hyukjin Kwon > Support for Parquet logical types, JSON and BSON (embedded types) >

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007071#comment-15007071 ] Yin Huai commented on SPARK-10181: -- [~bolke] I have merged it into branch-1.5. It will be release with

[jira] [Assigned] (SPARK-11760) SQL Catalyst data time test fails

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11760: Assignee: (was: Apache Spark) > SQL Catalyst data time test fails >

[jira] [Assigned] (SPARK-11760) SQL Catalyst data time test fails

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11760: Assignee: Apache Spark > SQL Catalyst data time test fails >

[jira] [Commented] (SPARK-11760) SQL Catalyst data time test fails

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006932#comment-15006932 ] Apache Spark commented on SPARK-11760: -- User 'jbonofre' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11089: Assignee: Cheng Lian (was: Apache Spark) > Add a option for thrift-server to share a

[jira] [Assigned] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11089: Assignee: Apache Spark (was: Cheng Lian) > Add a option for thrift-server to share a

[jira] [Commented] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007010#comment-15007010 ] Apache Spark commented on SPARK-11089: -- User 'liancheng' has created a pull request for this issue:

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007038#comment-15007038 ] Maciej Szymkiewicz commented on SPARK-11281: [~shivaram] I've tested both current master and

[jira] [Resolved] (SPARK-11760) SQL Catalyst data time test fails

2015-11-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved SPARK-11760. -- Resolution: Invalid It has already been fixed by: {code} commit

[jira] [Updated] (SPARK-11759) Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found

2015-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11759: -- Component/s: Mesos Deploy > Spark task on mesos with docker fails with sh: 1:

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006966#comment-15006966 ] Shivaram Venkataraman commented on SPARK-11281: --- Does the example posted in the description

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006955#comment-15006955 ] Shivaram Venkataraman commented on SPARK-11281: --- [~sunrui] [~zero323] Is there a test case

[jira] [Updated] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11281: -- Assignee: Maciej Szymkiewicz > Issue with creating and collecting DataFrame using environments >

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006960#comment-15006960 ] Maciej Szymkiewicz commented on SPARK-11281: [~shivaram] No, there isn't. I removed this one

[jira] [Reopened] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-11281: --- Assignee: (was: Maciej Szymkiewicz) > Issue with creating and

[jira] [Commented] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006979#comment-15006979 ] Apache Spark commented on SPARK-11716: -- User 'jbonofre' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006998#comment-15006998 ] Marcelo Vanzin edited comment on SPARK-11617 at 11/16/15 5:53 PM: -- Can

[jira] [Updated] (SPARK-10181) HiveContext is not used with keytab principal but with user principal/unix username

2015-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10181: - Fix Version/s: 1.5.3 > HiveContext is not used with keytab principal but with user principal/unix >

[jira] [Commented] (SPARK-11512) Bucket Join

2015-11-16 Thread Alex Nastetsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006975#comment-15006975 ] Alex Nastetsky commented on SPARK-11512: There are 3 situations: 1) dataset A and dataset B are

[jira] [Commented] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-16 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006978#comment-15006978 ] shane knapp commented on SPARK-11655: - just wanted to say that things are definitely looking a LOT

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007064#comment-15007064 ] Shivaram Venkataraman commented on SPARK-11281: --- Thats cool ! lets keep this open till we

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

2015-11-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007131#comment-15007131 ] Joseph K. Bradley commented on SPARK-11569: --- To choose the right API, my first comments are: *

[jira] [Updated] (SPARK-11044) Parquet writer version fixed as version1

2015-11-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11044: --- Fix Version/s: 1.6.0 > Parquet writer version fixed as version1 >

[jira] [Updated] (SPARK-11743) Add UserDefinedType support to RowEncoder

2015-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11743: -- Assignee: Liang-Chi Hsieh > Add UserDefinedType support to RowEncoder >

[jira] [Updated] (SPARK-11752) fix timezone problem for DateTimeUtils.getSeconds

2015-11-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11752: -- Assignee: Wenchen Fan > fix timezone problem for DateTimeUtils.getSeconds >

[jira] [Assigned] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11716: Assignee: (was: Apache Spark) > UDFRegistration Drops Input Type Information >

[jira] [Assigned] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11716: Assignee: Apache Spark > UDFRegistration Drops Input Type Information >

[jira] [Issue Comment Deleted] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-11281: --- Comment: was deleted (was: [~sunrui], [~shivaram] I don't think it is resolved by

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006998#comment-15006998 ] Marcelo Vanzin commented on SPARK-11617: Can you post the exception if they're different than the

[jira] [Commented] (SPARK-11713) Initial RDD for updateStateByKey for pyspark

2015-11-16 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007004#comment-15007004 ] Bryan Cutler commented on SPARK-11713: -- I could work on this > Initial RDD for updateStateByKey for

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11553: - Target Version/s: 1.6.0 Priority: Blocker (was: Minor) > row.getInt(i) if

[jira] [Resolved] (SPARK-11718) Explicit killing executor dies silent without get response information

2015-11-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11718. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.6.0 > Explicit

[jira] [Updated] (SPARK-11684) Update user guide to show new features in SparkR:::glm and SparkR:::summary

2015-11-16 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11684: -- Shepherd: Xiangrui Meng > Update user guide to show new features in SparkR:::glm and

[jira] [Commented] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007482#comment-15007482 ] Apache Spark commented on SPARK-11439: -- User 'nakul02' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11439: Assignee: Apache Spark > Optimization of creating sparse feature without dense one >

[jira] [Created] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

2015-11-16 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11762: -- Summary: TransportResponseHandler should consider open streams when counting outstanding requests Key: SPARK-11762 URL: https://issues.apache.org/jira/browse/SPARK-11762

[jira] [Reopened] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-11016: Assignee: (was: Liang-Chi Hsieh) https://github.com/apache/spark/pull/9243 is reverted >

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007565#comment-15007565 ] Davies Liu commented on SPARK-11016: [~charles.al...@acxiom.com] Could you send your patch to

[jira] [Commented] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007481#comment-15007481 ] Felix Cheung commented on SPARK-11756: -- [~yanboliang] Could you please clarify what is the issue?

[jira] [Resolved] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11390. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9679

[jira] [Updated] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11756: - Component/s: SparkR > SparkR can not output help information for SparkR:::summary correctly >

[jira] [Commented] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-16 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007487#comment-15007487 ] Nakul Jindal commented on SPARK-11439: -- Thanks [~lewuathe]. I've also updated the comment in the

[jira] [Commented] (SPARK-11747) Can not specify input path in python logistic_regression example under ml

2015-11-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007528#comment-15007528 ] Joseph K. Bradley commented on SPARK-11747: --- Although there are some examples which are

[jira] [Updated] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11390: - Assignee: Zee Chen > Query plan with/without filterPushdown indistinguishable >

[jira] [Assigned] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11439: Assignee: (was: Apache Spark) > Optimization of creating sparse feature without dense

[jira] [Reopened] (SPARK-11271) MapStatus too large for driver

2015-11-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-11271: https://github.com/apache/spark/pull/9243 is reverted > MapStatus too large for driver >

[jira] [Resolved] (SPARK-6328) Python API for StreamingListener

2015-11-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6328. -- Resolution: Fixed Fix Version/s: 1.6.0 > Python API for StreamingListener >

[jira] [Updated] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-16 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11720: -- Component/s: ML > Return Double.NaN instead of null for Mean and Average when count = 0 >

[jira] [Updated] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-16 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11720: -- Assignee: Jihong MA > Return Double.NaN instead of null for Mean and Average when count = 0 >

[jira] [Assigned] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11761: Assignee: Apache Spark > Prevent the call to StreamingContext#stop() in the listener

[jira] [Assigned] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11761: Assignee: (was: Apache Spark) > Prevent the call to StreamingContext#stop() in the

[jira] [Commented] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007215#comment-15007215 ] Apache Spark commented on SPARK-11761: -- User 'tedyu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11754) consolidate `ExpressionEncoder.tuple` and `Encoders.tuple`

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11754. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9729

[jira] [Updated] (SPARK-11754) consolidate `ExpressionEncoder.tuple` and `Encoders.tuple`

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11754: - Assignee: Wenchen Fan > consolidate `ExpressionEncoder.tuple` and `Encoders.tuple` >

[jira] [Updated] (SPARK-11732) MiMa excludes miss private classes

2015-11-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11732: -- Target Version/s: 1.6.0 > MiMa excludes miss private classes > -- > >

[jira] [Updated] (SPARK-11732) MiMa excludes miss private classes

2015-11-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11732: -- Assignee: Tim Hunter > MiMa excludes miss private classes > -- > >

[jira] [Resolved] (SPARK-11731) Enable batching on Driver WriteAheadLog by default

2015-11-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11731. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > Enable

[jira] [Created] (SPARK-11761) Prevent the call to StreamingContext#stop() in the listener bus's thread

2015-11-16 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11761: -- Summary: Prevent the call to StreamingContext#stop() in the listener bus's thread Key: SPARK-11761 URL: https://issues.apache.org/jira/browse/SPARK-11761 Project: Spark

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

2015-11-16 Thread Daniel Jalova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007220#comment-15007220 ] Daniel Jalova commented on SPARK-11319: --- Seems that this is possible in the Scala API too. >

[jira] [Updated] (SPARK-6328) Python API for StreamingListener

2015-11-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6328: - Assignee: Yifan Wang > Python API for StreamingListener > > >

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007272#comment-15007272 ] Apache Spark commented on SPARK-11281: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-16 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007315#comment-15007315 ] Marcelo Vanzin commented on SPARK-11617: BTW, I updated the PR with a test case that fails with

[jira] [Commented] (SPARK-9065) Add the ability to specify message handler function in python similar to Scala/Java

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007192#comment-15007192 ] Apache Spark commented on SPARK-9065: - User 'zsxwing' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

2015-11-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11633: Comment: was deleted (was: Which version are you using? I did hit an error, but it is a different error:

[jira] [Reopened] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-9603: -- We still have some failures on Jenkins as reported in

[jira] [Resolved] (SPARK-11742) Show batch failures in the Streaming UI landing page

2015-11-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11742. --- Resolution: Fixed Fix Version/s: 1.6.0 > Show batch failures in the Streaming UI

[jira] [Updated] (SPARK-11259) Params.validateParams() should be called automatically

2015-11-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11259: -- Target Version/s: 1.6.1, 1.7.0 > Params.validateParams() should be called

[jira] [Resolved] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11553. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9642

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-11-16 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007640#comment-15007640 ] Charles Allen commented on SPARK-11016: --- [~davies] Was in a meeting, looks like you got it :) >

[jira] [Assigned] (SPARK-11766) JSON serialization of Vectors

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11766: Assignee: Xiangrui Meng (was: Apache Spark) > JSON serialization of Vectors >

[jira] [Updated] (SPARK-11742) Show batch failures in the Streaming UI landing page

2015-11-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11742: -- Assignee: Shixiong Zhu > Show batch failures in the Streaming UI landing page >

[jira] [Commented] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007604#comment-15007604 ] Apache Spark commented on SPARK-11762: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11762: Assignee: (was: Apache Spark) > TransportResponseHandler should consider open streams

[jira] [Assigned] (SPARK-11762) TransportResponseHandler should consider open streams when counting outstanding requests

2015-11-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11762: Assignee: Apache Spark > TransportResponseHandler should consider open streams when

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

2015-11-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Target Version/s: 1.6.0 Priority: Blocker (was: Major) Issue Type:

[jira] [Created] (SPARK-11763) Refactoring to create template for Estimator, Model pairs

2015-11-16 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11763: - Summary: Refactoring to create template for Estimator, Model pairs Key: SPARK-11763 URL: https://issues.apache.org/jira/browse/SPARK-11763 Project: Spark

  1   2   3   >