[jira] [Reopened] (SPARK-3593) Support Sorting of Binary Type Data

2014-11-05 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Ramana G reopened SPARK-3593: - Reopened to assign to myself Support Sorting of Binary Type Data

[jira] [Resolved] (SPARK-3593) Support Sorting of Binary Type Data

2014-11-05 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Ramana G resolved SPARK-3593. - Resolution: Fixed Support Sorting of Binary Type Data

[jira] [Created] (SPARK-4243) Spark SQL SELECT COUNT DISTINCT optimization

2014-11-05 Thread JIRA
Bojan Kostić created SPARK-4243: --- Summary: Spark SQL SELECT COUNT DISTINCT optimization Key: SPARK-4243 URL: https://issues.apache.org/jira/browse/SPARK-4243 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-2468) Netty-based block server / client module

2014-11-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2468. Resolution: Fixed Fix Version/s: 1.2.0 Netty-based block server / client module

[jira] [Updated] (SPARK-4171) StreamingContext.actorStream throws serializationError

2014-11-05 Thread Shiti Saxena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4171: Component/s: Streaming StreamingContext.actorStream throws serializationError

[jira] [Created] (SPARK-4244) ConstantFolding has to be done before initialize the Generic UDF

2014-11-05 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-4244: Summary: ConstantFolding has to be done before initialize the Generic UDF Key: SPARK-4244 URL: https://issues.apache.org/jira/browse/SPARK-4244 Project: Spark

[jira] [Commented] (SPARK-4244) ConstantFolding has to be done before initialize the Generic UDF

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197902#comment-14197902 ] Apache Spark commented on SPARK-4244: - User 'chenghao-intel' has created a pull

[jira] [Created] (SPARK-4245) Fix containsNull of the result ArrayType of CreateArray expression.

2014-11-05 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-4245: Summary: Fix containsNull of the result ArrayType of CreateArray expression. Key: SPARK-4245 URL: https://issues.apache.org/jira/browse/SPARK-4245 Project: Spark

[jira] [Commented] (SPARK-4232) Truncate table not works when specific the table from non-current database session

2014-11-05 Thread XiaoJing wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197986#comment-14197986 ] XiaoJing wang commented on SPARK-4232: -- This bug is also found in the hive.Need to

[jira] [Resolved] (SPARK-4029) Update streaming driver to reliably save and recover received block metadata on driver failures

2014-11-05 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4029. -- Resolution: Fixed Fix Version/s: 1.2.0 Update streaming driver to reliably save and

[jira] [Created] (SPARK-4246) Add testsuite with end-to-end testing of driver failure

2014-11-05 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-4246: Summary: Add testsuite with end-to-end testing of driver failure Key: SPARK-4246 URL: https://issues.apache.org/jira/browse/SPARK-4246 Project: Spark Issue

[jira] [Updated] (SPARK-3110) Add a ha mode in YARN mode to keep executors in between restarts

2014-11-05 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-3110: - Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-3129) Add a ha mode in

[jira] [Created] (SPARK-4247) thriftserver user is ultraman when execute create table ultraman_tmp.12 as select channel, subchannel from custom.common_pc_pv where logdate = '2014110210' and logda

2014-11-05 Thread qiaohaijun (JIRA)
qiaohaijun created SPARK-4247: - Summary: thriftserver user is ultraman when execute create table ultraman_tmp.12 as select channel, subchannel from custom.common_pc_pv where logdate = '2014110210' and logdate = '2014110210' limit 10; then get

[jira] [Updated] (SPARK-4247) thriftserver user is ultraman when execute create table ultraman_tmp.12 as select channel, subchannel from custom.common_pc_pv where logdate = '2014110210' and logda

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Summary: thriftserver user is ultraman when execute create table ultraman_tmp.12 as select channel,

[jira] [Commented] (SPARK-4247) thriftserver user is ultraman when execute create table ultraman_tmp.12 as select channel, subchannel from custom.common_pc_pv where logdate = '2014110210' and log

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198012#comment-14198012 ] qiaohaijun commented on SPARK-4247: --- Error:

[jira] [Updated] (SPARK-4247) beeline execute create table as

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Summary: beeline execute create table as (was: thriftserver user is ultraman when execute create

[jira] [Updated] (SPARK-4247) beeline execute create table as

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Affects Version/s: 1.1.1 beeline execute create table as

[jira] [Commented] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

2014-11-05 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198030#comment-14198030 ] shengli commented on SPARK-4217: This is a bug in Hive0.11 , Hive0.12 Hive0.13 works same

[jira] [Updated] (SPARK-4247) beeline execute create table as

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Component/s: SQL beeline execute create table as

[jira] [Updated] (SPARK-4247) use beeline execute create table as thriftserver is not use hive user ,but the new hdfs dir's owner is hive

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Summary: use beeline execute create table as thriftserver is not use hive user ,but the new hdfs

[jira] [Updated] (SPARK-4247) use beeline execute create table as thriftserver is not use hive user ,but the new hdfs dir's owner is hive

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Environment: java: 1.7 hadoop: 2.3.0-cdh5.0.0 spark: branch-1.1 lastest thriftserver with hive 0.12

[jira] [Updated] (SPARK-4247) use beeline execute create table as thriftserver is not use hive user ,but the new hdfs dir's owner is hive

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Description: 2014-11-03 20:12:52,498 INFO [pool-10-thread-3] hive.metastore

[jira] [Updated] (SPARK-4247) use beeline execute create table as thriftserver is not use hive user ,but the new hdfs dir's owner is hive

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Description: thriftserver start cmd: sudo -u ultraman sh start-thriftserver.sh --- beeline start cmd:

[jira] [Created] (SPARK-4248) not support add jar

2014-11-05 Thread qiaohaijun (JIRA)
qiaohaijun created SPARK-4248: - Summary: not support add jar Key: SPARK-4248 URL: https://issues.apache.org/jira/browse/SPARK-4248 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-4248) [SQL] spark sql not support add jar

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4248: -- Summary: [SQL] spark sql not support add jar (was: not support add jar ) [SQL] spark sql not support

[jira] [Updated] (SPARK-4247) [SQL] use beeline execute create table as thriftserver is not use hive user ,but the new hdfs dir's owner is hive

2014-11-05 Thread qiaohaijun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiaohaijun updated SPARK-4247: -- Summary: [SQL] use beeline execute create table as thriftserver is not use hive user ,but the new

[jira] [Closed] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

2014-11-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-4217. - Resolution: Invalid Result of SparkSQL is incorrect after a table join and group by operation

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

2014-11-05 Thread Vincent Botta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198321#comment-14198321 ] Vincent Botta commented on SPARK-4210: -- [~manishamde]: Indeed it will lead to

[jira] [Comment Edited] (SPARK-4210) Add Extra-Trees algorithm to MLlib

2014-11-05 Thread Vincent Botta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198321#comment-14198321 ] Vincent Botta edited comment on SPARK-4210 at 11/5/14 12:25 PM:

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

2014-11-05 Thread Vincent Botta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198327#comment-14198327 ] Vincent Botta commented on SPARK-4210: -- [~josephkb]: I’m not sure yet. I’d rather go

[jira] [Created] (SPARK-4249) A problem of EdgePartitionBuilder in Graphx

2014-11-05 Thread Cookies (JIRA)
Cookies created SPARK-4249: -- Summary: A problem of EdgePartitionBuilder in Graphx Key: SPARK-4249 URL: https://issues.apache.org/jira/browse/SPARK-4249 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4249) A problem of EdgePartitionBuilder in Graphx

2014-11-05 Thread Cookies (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cookies updated SPARK-4249: --- Description:

[jira] [Updated] (SPARK-4249) A problem of EdgePartitionBuilder in Graphx

2014-11-05 Thread Cookies (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cookies updated SPARK-4249: --- Description:

[jira] [Updated] (SPARK-4249) A problem of EdgePartitionBuilder in Graphx

2014-11-05 Thread Cookies (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cookies updated SPARK-4249: --- Description:

[jira] [Commented] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

2014-11-05 Thread peter.zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198347#comment-14198347 ] peter.zhang commented on SPARK-4217: Thanks for attention and discussion, I worked out

[jira] [Updated] (SPARK-1406) PMML model evaluation support via MLib

2014-11-05 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenzo Selvaggio updated SPARK-1406: -- Attachment: (was: kmeans.xml) PMML model evaluation support via MLib

[jira] [Updated] (SPARK-1406) PMML model evaluation support via MLib

2014-11-05 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenzo Selvaggio updated SPARK-1406: -- Attachment: MyJPMMLEval.java SPARK-1406.pdf kmeans.xml

[jira] [Commented] (SPARK-4232) Truncate table not works when specific the table from non-current database session

2014-11-05 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198430#comment-14198430 ] shengli commented on SPARK-4232: There is also a workaround with modify hive code, you can

[jira] [Comment Edited] (SPARK-4232) Truncate table not works when specific the table from non-current database session

2014-11-05 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198430#comment-14198430 ] shengli edited comment on SPARK-4232 at 11/5/14 2:32 PM: - There is

[jira] [Comment Edited] (SPARK-4232) Truncate table not works when specific the table from non-current database session

2014-11-05 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198430#comment-14198430 ] shengli edited comment on SPARK-4232 at 11/5/14 2:35 PM: - There is

[jira] [Created] (SPARK-4250) Create constant null value for Hive Inspectors

2014-11-05 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-4250: Summary: Create constant null value for Hive Inspectors Key: SPARK-4250 URL: https://issues.apache.org/jira/browse/SPARK-4250 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4251) Add Restricted Boltzmann machine(RBM) algorithm to MLlib

2014-11-05 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-4251: -- Summary: Add Restricted Boltzmann machine(RBM) algorithm to MLlib Key: SPARK-4251 URL: https://issues.apache.org/jira/browse/SPARK-4251 Project: Spark Issue

[jira] [Created] (SPARK-4252) SparkSQL behaves differently from Hive when encountering illegal record

2014-11-05 Thread patrickliu (JIRA)
patrickliu created SPARK-4252: - Summary: SparkSQL behaves differently from Hive when encountering illegal record Key: SPARK-4252 URL: https://issues.apache.org/jira/browse/SPARK-4252 Project: Spark

[jira] [Created] (SPARK-4253) Ignore spark.driver.host in yarn-cluster mode

2014-11-05 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-4253: -- Summary: Ignore spark.driver.host in yarn-cluster mode Key: SPARK-4253 URL: https://issues.apache.org/jira/browse/SPARK-4253 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4253) Ignore spark.driver.host in yarn-cluster mode

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198508#comment-14198508 ] Apache Spark commented on SPARK-4253: - User 'WangTaoTheTonic' has created a pull

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: spark-1297-v7.txt Upgrade HBase dependency to 0.98.0 --

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198514#comment-14198514 ] Sean Owen commented on SPARK-1297: -- Ted are you updating a pull request? patches aren't

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198510#comment-14198510 ] Ted Yu commented on SPARK-1297: --- Patch v7 uses 0.98.7 hbase release Upgrade HBase

[jira] [Commented] (SPARK-3971) Failed to deserialize Vector in cluster mode

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198556#comment-14198556 ] Apache Spark commented on SPARK-3971: - User 'liancheng' has created a pull request for

[jira] [Closed] (SPARK-4252) SparkSQL behaves differently from Hive when encountering illegal record

2014-11-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-4252. - Resolution: Duplicate Had an offline discussion with [~patrickliu], the Hive version he was using is

[jira] [Commented] (SPARK-4252) SparkSQL behaves differently from Hive when encountering illegal record

2014-11-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198568#comment-14198568 ] Cheng Lian commented on SPARK-4252: --- [~patrickliu] Hadn't asked for more details before

[jira] [Commented] (SPARK-4252) SparkSQL behaves differently from Hive when encountering illegal record

2014-11-05 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198570#comment-14198570 ] Venkata Ramana G commented on SPARK-4252: - Same When i executed over hive 0.12

[jira] [Commented] (SPARK-4100) JSON RDD schema inference causes whole RDD to be realized

2014-11-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198591#comment-14198591 ] Yin Huai commented on SPARK-4100: - [~kul] Yes, it is expected behavior. Since fields and

[jira] [Updated] (SPARK-4100) JSON RDD schema inference causes whole RDD to be realized

2014-11-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4100: Target Version/s: (was: 1.2.0) JSON RDD schema inference causes whole RDD to be realized

[jira] [Commented] (SPARK-4250) Create constant null value for Hive Inspectors

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198605#comment-14198605 ] Apache Spark commented on SPARK-4250: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-4234) Always do paritial aggregation

2014-11-05 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198694#comment-14198694 ] Venkata Ramana G commented on SPARK-4234: - As I understand currently HiveUDAF and

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198703#comment-14198703 ] Apache Spark commented on SPARK-1297: - User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198701#comment-14198701 ] Ted Yu commented on SPARK-1297: --- Create a new pull request:

[jira] [Resolved] (SPARK-4148) PySpark's sample uses the same seed for all partitions

2014-11-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4148. -- Resolution: Fixed Fix Version/s: 1.1.1 Issue resolved by pull request 3104

[jira] [Resolved] (SPARK-4197) Gradient Boosting API cleanups

2014-11-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4197. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3094

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-11-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198852#comment-14198852 ] Marcelo Vanzin commented on SPARK-1537: --- I believe with YARN-2033 and YARN-2423 I

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

2014-11-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198939#comment-14198939 ] Joseph K. Bradley commented on SPARK-4210: -- The API and internal implementation

[jira] [Commented] (SPARK-3884) If deploy mode is cluster, --driver-memory shouldn't apply to client JVM

2014-11-05 Thread Greg Hill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198945#comment-14198945 ] Greg Hill commented on SPARK-3884: -- For example: {noformat} spark-submit --master

[jira] [Commented] (SPARK-4254) MovieLensALS example fails from including Params in closure

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198944#comment-14198944 ] Apache Spark commented on SPARK-4254: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

2014-11-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198990#comment-14198990 ] Joseph K. Bradley commented on SPARK-4210: -- One more thought: If this is your

[jira] [Created] (SPARK-4255) Table striping is incorrect on page load

2014-11-05 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-4255: - Summary: Table striping is incorrect on page load Key: SPARK-4255 URL: https://issues.apache.org/jira/browse/SPARK-4255 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4255) Table striping is incorrect on page load

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199058#comment-14199058 ] Apache Spark commented on SPARK-4255: - User 'kayousterhout' has created a pull request

[jira] [Created] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

2014-11-05 Thread Andrew Bullen (JIRA)
Andrew Bullen created SPARK-4256: Summary: MLLib BinaryClassificationMetricComputers try to divide by zero Key: SPARK-4256 URL: https://issues.apache.org/jira/browse/SPARK-4256 Project: Spark

[jira] [Commented] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199103#comment-14199103 ] Apache Spark commented on SPARK-4256: - User 'abull' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

2014-11-05 Thread Andrew Bullen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Bullen updated SPARK-4256: - Comment: was deleted (was: Submitted Pull Request with fix:

[jira] [Commented] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

2014-11-05 Thread Andrew Bullen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199104#comment-14199104 ] Andrew Bullen commented on SPARK-4256: -- Submitted Pull Request with fix:

[jira] [Commented] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199137#comment-14199137 ] Apache Spark commented on SPARK-4079: - User 'ksakellis' has created a pull request for

[jira] [Commented] (SPARK-4092) Input metrics don't work for coalesce()'d RDD's

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199181#comment-14199181 ] Apache Spark commented on SPARK-4092: - User 'ksakellis' has created a pull request for

[jira] [Updated] (SPARK-4243) Spark SQL SELECT COUNT DISTINCT optimization

2014-11-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4243: Description: Spark SQL runs slow when using this code: {code} val sqlContext = new

[jira] [Updated] (SPARK-4222) FixedLengthBinaryRecordReader should readFully

2014-11-05 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4222: - Assignee: Jascha Swisher FixedLengthBinaryRecordReader should readFully

[jira] [Resolved] (SPARK-4222) FixedLengthBinaryRecordReader should readFully

2014-11-05 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-4222. -- Resolution: Fixed Fix Version/s: 1.2.0 FixedLengthBinaryRecordReader should readFully

[jira] [Created] (SPARK-4257) Spark master can only be accessed by hostname

2014-11-05 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4257: - Summary: Spark master can only be accessed by hostname Key: SPARK-4257 URL: https://issues.apache.org/jira/browse/SPARK-4257 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3797: -- Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[jira] [Closed] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3797. Resolution: Fixed Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[jira] [Closed] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3797. Resolution: Fixed Fix Version/s: 1.2.0 Run the shuffle service inside the YARN NodeManager as an

[jira] [Commented] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

2014-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199386#comment-14199386 ] Apache Spark commented on SPARK-4180: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-4258) NPE with new Parquet Filters

2014-11-05 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-4258: --- Summary: NPE with new Parquet Filters Key: SPARK-4258 URL: https://issues.apache.org/jira/browse/SPARK-4258 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4040) Update spark documentation for local mode and spark-streaming.

2014-11-05 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4040: - Assignee: jay vyas Update spark documentation for local mode and spark-streaming.

[jira] [Closed] (SPARK-3174) Provide elastic scaling within a Spark application

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3174. Resolution: Fixed Fix Version/s: 1.2.0 The initial implementation is now complete as all subtasks

[jira] [Resolved] (SPARK-4040) Update spark documentation for local mode and spark-streaming.

2014-11-05 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-4040. -- Resolution: Fixed Update spark documentation for local mode and spark-streaming.

[jira] [Closed] (SPARK-3796) Create shuffle service for external block storage

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3796. Create shuffle service for external block storage -

[jira] [Closed] (SPARK-3223) runAsSparkUser cannot change HDFS write permission properly in mesos cluster mode

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3223. Resolution: Fixed Fix Version/s: (was: 1.0.3) 1.1.0

[jira] [Resolved] (SPARK-3223) runAsSparkUser cannot change HDFS write permission properly in mesos cluster mode

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-3223. -- Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.1.1 Target

[jira] [Closed] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-11-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4158. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee: Brenden Matthews

[jira] [Created] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
Fan Jiang created SPARK-4259: Summary: Add Spectral Clustering Algorithm with Gaussian Similarity Function Key: SPARK-4259 URL: https://issues.apache.org/jira/browse/SPARK-4259 Project: Spark

[jira] [Created] (SPARK-4260) Httpbroadcast should set connection timeout.

2014-11-05 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-4260: - Summary: Httpbroadcast should set connection timeout. Key: SPARK-4260 URL: https://issues.apache.org/jira/browse/SPARK-4260 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

[jira] [Updated] (SPARK-4259) Add Spectral Clustering Algorithm with Gaussian Similarity Function

2014-11-05 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-4259: - Description: In recent years, spectral clustering has become one of the most popular modern clustering

  1   2   >