[jira] [Commented] (SPARK-7158) collect and take return different results

2015-04-27 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513623#comment-14513623 ] Chen Song commented on SPARK-7158: -- Should we execute the query in cache method?

[jira] [Assigned] (SPARK-7165) Sort Merge Join for outer joins

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7165: --- Assignee: Apache Spark Sort Merge Join for outer joins ---

[jira] [Updated] (SPARK-7097) Partitioned tables should only consider referred partitions in query during size estimation for checking against autoBroadcastJoinThreshold

2015-04-27 Thread Yash Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Datta updated SPARK-7097: -- Description: Currently when deciding about whether to create HashJoin or ShuffleHashJoin, the size

[jira] [Updated] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-04-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6505: -- Assignee: (was: Cheng Hao) Remove the reflection call in HiveFunctionWrapper

[jira] [Updated] (SPARK-7162) spark-shell launcher failure in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7162: --- Description: {code:none} HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/

[jira] [Updated] (SPARK-7162) spark-shell launcher failure in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7162: --- Description: {code:none} HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/

[jira] [Created] (SPARK-7164) Does spark has the commands such as yarn rmadmin -refreshNodes when remove a node from local cluster

2015-04-27 Thread pengyunli (JIRA)
pengyunli created SPARK-7164: Summary: Does spark has the commands such as yarn rmadmin -refreshNodes when remove a node from local cluster Key: SPARK-7164 URL: https://issues.apache.org/jira/browse/SPARK-7164

[jira] [Created] (SPARK-7165) Sort Merge Join for outer joins

2015-04-27 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-7165: -- Summary: Sort Merge Join for outer joins Key: SPARK-7165 URL: https://issues.apache.org/jira/browse/SPARK-7165 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Qingyang Hong (JIRA)
Qingyang Hong created SPARK-7166: Summary: Add filter by location boundingbox in TwitterInputDStream.scala Key: SPARK-7166 URL: https://issues.apache.org/jira/browse/SPARK-7166 Project: Spark

[jira] [Commented] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2015-04-27 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513780#comment-14513780 ] zhengruifeng commented on SPARK-7008: - AdaGrad works pretty well in practice, but I

[jira] [Commented] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513881#comment-14513881 ] Apache Spark commented on SPARK-7166: - User 'yang0228' has created a pull request for

[jira] [Assigned] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7166: --- Assignee: Apache Spark Add filter by location boundingbox in TwitterInputDStream.scala

[jira] [Assigned] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7166: --- Assignee: (was: Apache Spark) Add filter by location boundingbox in

[jira] [Created] (SPARK-7167) Receivers are not distributed efficiently

2015-04-27 Thread Marius Soutier (JIRA)
Marius Soutier created SPARK-7167: - Summary: Receivers are not distributed efficiently Key: SPARK-7167 URL: https://issues.apache.org/jira/browse/SPARK-7167 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

2015-04-27 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-7167: -- Summary: Receivers are not distributed efficiently when starting from checkpoint (was:

[jira] [Comment Edited] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

2015-04-27 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510381#comment-14510381 ] pin_zhang edited comment on SPARK-6923 at 4/27/15 9:43 AM: --- Hi,

[jira] [Commented] (SPARK-7008) An implementation of Factorization Machine (LibFM)

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513856#comment-14513856 ] Guoqiang Li commented on SPARK-7008: [~mengxr] what's your view for [~podongfeng]

[jira] [Commented] (SPARK-7165) Sort Merge Join for outer joins

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513832#comment-14513832 ] Apache Spark commented on SPARK-7165: - User 'adrian-wang' has created a pull request

[jira] [Assigned] (SPARK-7165) Sort Merge Join for outer joins

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7165: --- Assignee: (was: Apache Spark) Sort Merge Join for outer joins

[jira] [Updated] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-04-27 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6613: -- Affects Version/s: 1.2.2 Starting stream from checkpoint causes Streaming tab to throw error

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514841#comment-14514841 ] Marcelo Vanzin commented on SPARK-7108: --- bq. then why does spark.local.dir even

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514862#comment-14514862 ] Patrick Wendell commented on SPARK-7108: I see - when I wrote that, I meant it to

[jira] [Updated] (SPARK-5905) Improve RowMatrix user guide and doc.

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5905: - Target Version/s: 1.4.0 (was: 1.3.0) Improve RowMatrix user guide and doc.

[jira] [Resolved] (SPARK-5300) Spark loads file partitions in inconsistent order on native filesystems

2015-04-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs resolved SPARK-5300. --- Resolution: Won't Fix I submitted a fix at the FileSystem level based on comments in the mailing

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514822#comment-14514822 ] Patrick Wendell commented on SPARK-7108: Yes - the case I'm referring to is the

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-27 Thread Rakesh Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514905#comment-14514905 ] Rakesh Chalasani commented on SPARK-5256: - Just a thought, as much as I know,

[jira] [Resolved] (SPARK-6856) Make RDD information more useful in SparkR

2015-04-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6856. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed by

[jira] [Resolved] (SPARK-984) SPARK_TOOLS_JAR not set if multiple tools jars exists

2015-04-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-984. -- Resolution: Fixed Fix Version/s: 1.4.0 SPARK_TOOLS_JAR not set if multiple tools jars exists

[jira] [Comment Edited] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514822#comment-14514822 ] Patrick Wendell edited comment on SPARK-7108 at 4/27/15 7:50 PM:

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514836#comment-14514836 ] Marcelo Vanzin commented on SPARK-7108: --- bq. It might be that we just document as

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514865#comment-14514865 ] Patrick Wendell commented on SPARK-7108: Actually to correct what I said - it is

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514963#comment-14514963 ] Joseph K. Bradley commented on SPARK-5256: -- I'd disagree. There are almost

[jira] [Created] (SPARK-7176) Add validation functionality to individual Param

2015-04-27 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7176: Summary: Add validation functionality to individual Param Key: SPARK-7176 URL: https://issues.apache.org/jira/browse/SPARK-7176 Project: Spark Issue

[jira] [Resolved] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7107. Resolution: Fixed Fix Version/s: 1.4.0 Add parameter for zookeeper.znode.parent to

[jira] [Commented] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-04-27 Thread Punya Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515066#comment-14515066 ] Punya Biswal commented on SPARK-6907: - Would it make sense to do this as a separate

[jira] [Commented] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513610#comment-14513610 ] Apache Spark commented on SPARK-7160: - User 'rayortigas' has created a pull request

[jira] [Assigned] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7160: --- Assignee: (was: Apache Spark) Support converting DataFrames to typed RDDs.

[jira] [Created] (SPARK-7163) minor refactory for HiveQl

2015-04-27 Thread Fei Wang (JIRA)
Fei Wang created SPARK-7163: --- Summary: minor refactory for HiveQl Key: SPARK-7163 URL: https://issues.apache.org/jira/browse/SPARK-7163 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-04-27 Thread Guillaume EYNARD (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513761#comment-14513761 ] Guillaume EYNARD commented on SPARK-4105: - I have this issue using spark1.2.0+

[jira] [Created] (SPARK-7161) Provide REST api to download event logs from History Server

2015-04-27 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-7161: --- Summary: Provide REST api to download event logs from History Server Key: SPARK-7161 URL: https://issues.apache.org/jira/browse/SPARK-7161 Project: Spark

[jira] [Created] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-04-27 Thread Ray Ortigas (JIRA)
Ray Ortigas created SPARK-7160: -- Summary: Support converting DataFrames to typed RDDs. Key: SPARK-7160 URL: https://issues.apache.org/jira/browse/SPARK-7160 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7158) collect and take return different results

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513665#comment-14513665 ] Apache Spark commented on SPARK-7158: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-7158) collect and take return different results

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7158: --- Assignee: Apache Spark collect and take return different results

[jira] [Updated] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7162: --- Summary: Launcher error in yarn-client (was: spark-shell launcher error in yarn-client) Launcher

[jira] [Updated] (SPARK-5100) Spark Thrift server monitor page

2015-04-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5100: -- Assignee: Yi Tian Spark Thrift server monitor page

[jira] [Updated] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-04-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7160: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 Support converting DataFrames to

[jira] [Resolved] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-04-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6505. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5660

[jira] [Updated] (SPARK-6505) Remove the reflection call in HiveFunctionWrapper

2015-04-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6505: -- Fix Version/s: (was: 1.6.0) 1.4.0 Remove the reflection call in

[jira] [Assigned] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7160: --- Assignee: Apache Spark Support converting DataFrames to typed RDDs.

[jira] [Commented] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513624#comment-14513624 ] Apache Spark commented on SPARK-1556: - User 'CodingCat' has created a pull request for

[jira] [Updated] (SPARK-7162) spark-shell launcher failure in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7162: --- Description: {code:none} HADOOP_CONF_DIR=/usr/local/CDH5/hadoop-2.3.0-cdh5.0.1/etc/hadoop/

[jira] [Assigned] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7162: --- Assignee: Apache Spark Launcher error in yarn-client -

[jira] [Assigned] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7162: --- Assignee: (was: Apache Spark) Launcher error in yarn-client

[jira] [Commented] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513692#comment-14513692 ] Apache Spark commented on SPARK-7162: - User 'witgo' has created a pull request for

[jira] [Commented] (SPARK-7035) Drop __getattr__ on pyspark.sql.DataFrame

2015-04-27 Thread Kalle Jepsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513633#comment-14513633 ] Kalle Jepsen commented on SPARK-7035: - [~rxin] Sure, I'll try to prepare one today.

[jira] [Created] (SPARK-7162) spark-shell launcher failure in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-7162: -- Summary: spark-shell launcher failure in yarn-client Key: SPARK-7162 URL: https://issues.apache.org/jira/browse/SPARK-7162 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7158) collect and take return different results

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7158: --- Assignee: (was: Apache Spark) collect and take return different results

[jira] [Commented] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

2015-04-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513672#comment-14513672 ] Reynold Xin commented on SPARK-6970: [~blue666man] would you like to submit a patch

[jira] [Updated] (SPARK-7162) spark-shell launcher error in yarn-client

2015-04-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7162: --- Summary: spark-shell launcher error in yarn-client (was: spark-shell launcher failure in

[jira] [Commented] (SPARK-7163) minor refactory for HiveQl

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513677#comment-14513677 ] Apache Spark commented on SPARK-7163: - User 'scwf' has created a pull request for this

[jira] [Assigned] (SPARK-7163) minor refactory for HiveQl

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7163: --- Assignee: Apache Spark minor refactory for HiveQl --

[jira] [Comment Edited] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

2015-04-27 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513976#comment-14513976 ] Marius Soutier edited comment on SPARK-7167 at 4/27/15 12:09 PM:

[jira] [Commented] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

2015-04-27 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513976#comment-14513976 ] Marius Soutier commented on SPARK-7167: --- Maybe the slowdown is only incidental,

[jira] [Assigned] (SPARK-3382) GradientDescent convergence tolerance

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3382: --- Assignee: (was: Apache Spark) GradientDescent convergence tolerance

[jira] [Assigned] (SPARK-3382) GradientDescent convergence tolerance

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3382: --- Assignee: Apache Spark GradientDescent convergence tolerance

[jira] [Updated] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

2015-04-27 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-7167: -- Attachment: Screen Shot 2015-04-27 at 14.10.05.jpg Receivers are not distributed efficiently

[jira] [Commented] (SPARK-3561) Allow for pluggable execution contexts in Spark

2015-04-27 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514062#comment-14514062 ] Oleg Zhurakousky commented on SPARK-3561: - Here is an interesting read that

[jira] [Resolved] (SPARK-7028) Add filterNot to RDD

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7028. -- Resolution: Won't Fix Add filterNot to RDD Key: SPARK-7028

[jira] [Updated] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7166: - Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) Please set type/priority

[jira] [Updated] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6653: - Priority: Minor (was: Major) Affects Version/s: (was: 1.3.0)

[jira] [Updated] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7167: - Priority: Minor (was: Major) Receivers aren't the workers. Can this be the cause of slowing down

[jira] [Resolved] (SPARK-7014) Support loading VW formatted data.

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7014. -- Resolution: Won't Fix Support loading VW formatted data. --

[jira] [Commented] (SPARK-7112) Add a tracker to track the direct streams

2015-04-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514116#comment-14514116 ] François Garillot commented on SPARK-7112: -- Perhaps you'd want to drop a line or

[jira] [Updated] (SPARK-7161) Provide REST api to download event logs from History Server

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7161: - Component/s: Streaming Priority: Minor (was: Major) Affects Version/s: 1.3.1

[jira] [Assigned] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6653: --- Assignee: Apache Spark New configuration property to specify port for sparkYarnAM actor

[jira] [Commented] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513936#comment-14513936 ] Apache Spark commented on SPARK-6653: - User 'zuxqoj' has created a pull request for

[jira] [Updated] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7162: - Priority: Minor (was: Major) Looks OK but these dirs typically do not contain subdirectories. Launcher

[jira] [Resolved] (SPARK-7164) Does spark has the commands such as yarn rmadmin -refreshNodes when remove a node from local cluster

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7164. -- Resolution: Invalid Fix Version/s: (was: 1.3.1) Target Version/s: (was: 1.3.1)

[jira] [Assigned] (SPARK-7168) Update plugin versions in Maven build and centralize versions

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7168: --- Assignee: Apache Spark (was: Sean Owen) Update plugin versions in Maven build and

[jira] [Assigned] (SPARK-7168) Update plugin versions in Maven build and centralize versions

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7168: --- Assignee: Sean Owen (was: Apache Spark) Update plugin versions in Maven build and

[jira] [Commented] (SPARK-7168) Update plugin versions in Maven build and centralize versions

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513966#comment-14513966 ] Apache Spark commented on SPARK-7168: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6653: --- Assignee: (was: Apache Spark) New configuration property to specify port for

[jira] [Resolved] (SPARK-7166) Add filter by location boundingbox in TwitterInputDStream.scala

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7166. -- Resolution: Duplicate Also a duplicate. Please search JIRA first. [~qingyangh] you should read

[jira] [Created] (SPARK-7168) Update plugin versions in Maven build and centralize versions

2015-04-27 Thread Sean Owen (JIRA)
Sean Owen created SPARK-7168: Summary: Update plugin versions in Maven build and centralize versions Key: SPARK-7168 URL: https://issues.apache.org/jira/browse/SPARK-7168 Project: Spark Issue

[jira] [Assigned] (SPARK-6030) SizeEstimator gives wrong result for Integer object on 64bit JVM with UseCompressedOops on

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6030: --- Assignee: Apache Spark SizeEstimator gives wrong result for Integer object on 64bit JVM

[jira] [Commented] (SPARK-7112) Add a tracker to track the direct streams

2015-04-27 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514144#comment-14514144 ] Saisai Shao commented on SPARK-7112: I think I mentioned the need for the direct

[jira] [Commented] (SPARK-4449) specify port range in spark

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514208#comment-14514208 ] Apache Spark commented on SPARK-4449: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-6030) SizeEstimator gives wrong result for Integer object on 64bit JVM with UseCompressedOops on

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6030: --- Assignee: (was: Apache Spark) SizeEstimator gives wrong result for Integer object on

[jira] [Assigned] (SPARK-6943) Graphically show RDD's included in a stage

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6943: --- Assignee: Andrew Or (was: Apache Spark) Graphically show RDD's included in a stage

[jira] [Resolved] (SPARK-7162) Launcher error in yarn-client

2015-04-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7162. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Guoqiang Li Resolved by

[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage

2015-04-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515872#comment-14515872 ] Apache Spark commented on SPARK-6943: - User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-6943) Graphically show RDD's included in a stage

2015-04-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6943: - Attachment: with-closures.png with-stack-trace.png Graphically show RDD's included in a

[jira] [Closed] (SPARK-5516) ActorSystemImpl: Uncaught fatal error from thread [sparkDriver-akka.actor.default-dispatcher-22] shutting down ActorSystem [sparkDriver] java.lang.OutOfMemoryError: Java h

2015-04-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-5516. Resolution: Unresolved Closing this due to no activity. ActorSystemImpl: Uncaught fatal error

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516072#comment-14516072 ] Joseph K. Bradley commented on SPARK-5556: -- I updated the target version for

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5556: - Target Version/s: 1.5.0 (was: 1.4.0) Latent Dirichlet Allocation (LDA) using Gibbs

[jira] [Updated] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-04-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1655: - Target Version/s: 1.5.0 (was: 1.4.0) In naive Bayes, store conditional probabilities

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-04-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3181: - Target Version/s: 1.5.0 (was: 1.4.0) Add Robust Regression Algorithm with Huber Estimator

[jira] [Commented] (SPARK-6940) PySpark CrossValidator

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516083#comment-14516083 ] Joseph K. Bradley commented on SPARK-6940: -- I just updated this to be for

[jira] [Updated] (SPARK-5114) Should Evaluator be a PipelineStage

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5114: - Target Version/s: 1.5.0 (was: 1.4.0) Should Evaluator be a PipelineStage

[jira] [Updated] (SPARK-4526) Gradient should be added batch computing interface

2015-04-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4526: - Target Version/s: 1.5.0 (was: 1.4.0) Gradient should be added batch computing interface

  1   2   3   4   >