[jira] [Created] (SPARK-3277) LZ4 compression cause the the ExternalSort exception

2014-08-27 Thread hzw (JIRA)
hzw created SPARK-3277: -- Summary: LZ4 compression cause the the ExternalSort exception Key: SPARK-3277 URL: https://issues.apache.org/jira/browse/SPARK-3277 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-2636) no where to get job identifier while submit spark job through spark API

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113400#comment-14113400 ] Apache Spark commented on SPARK-2636: - User 'lirui-intel' has created a pull request f

[jira] [Updated] (SPARK-2288) Hide ShuffleBlockManager behind ShuffleManager

2014-08-27 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Liu updated SPARK-2288: --- Attachment: shuffleblockmanager.pdf > Hide ShuffleBlockManager behind ShuffleManager > --

[jira] [Commented] (SPARK-2594) Add CACHE TABLE AS SELECT ...

2014-08-27 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113342#comment-14113342 ] Ravindra Pesala commented on SPARK-2594: Please assign this to me. > Add CACHE TA

[jira] [Created] (SPARK-3276) Provide a API to specify whether the old files need to be ignored in file input text DStream

2014-08-27 Thread Jack Hu (JIRA)
Jack Hu created SPARK-3276: -- Summary: Provide a API to specify whether the old files need to be ignored in file input text DStream Key: SPARK-3276 URL: https://issues.apache.org/jira/browse/SPARK-3276 Projec

[jira] [Created] (SPARK-3275) Socket receiver can not recover when the socket server restarted

2014-08-27 Thread Jack Hu (JIRA)
Jack Hu created SPARK-3275: -- Summary: Socket receiver can not recover when the socket server restarted Key: SPARK-3275 URL: https://issues.apache.org/jira/browse/SPARK-3275 Project: Spark Issue Ty

[jira] [Updated] (SPARK-3274) Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream

2014-08-27 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Hu updated SPARK-3274: --- Description: Reproduce code: scontext .socketTextStream("localhost", 1)

[jira] [Created] (SPARK-3274) Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream

2014-08-27 Thread Jack Hu (JIRA)
Jack Hu created SPARK-3274: -- Summary: Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream Key: SPARK-3274 URL: https://issues.apache.org/jira/browse/SPARK-3274

[jira] [Commented] (SPARK-3273) The spark version in the welcome message of spark-shell is not correct

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113312#comment-14113312 ] Apache Spark commented on SPARK-3273: - User 'witgo' has created a pull request for thi

[jira] [Updated] (SPARK-3273) The spark version in the welcome message of spark-shell is not correct

2014-08-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-3273: --- Summary: The spark version in the welcome message of spark-shell is not correct (was: The spark vers

[jira] [Created] (SPARK-3273) The spark version in the welcome message of the spark-shell is not correct

2014-08-27 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3273: -- Summary: The spark version in the welcome message of the spark-shell is not correct Key: SPARK-3273 URL: https://issues.apache.org/jira/browse/SPARK-3273 Project: Spark

[jira] [Updated] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-1297: -- Attachment: pom.xml This is examples/pom.xml for spark-1.0.2 > Upgrade HBase dependency to 0.98.0 > --

[jira] [Comment Edited] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113260#comment-14113260 ] Qiping Li edited comment on SPARK-2207 at 8/28/14 3:44 AM: --- To s

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113294#comment-14113294 ] Matei Zaharia commented on SPARK-3215: -- Okay, so my suggestion is do it separately fi

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113283#comment-14113283 ] Joseph K. Bradley commented on SPARK-3155: -- It would be best if so, but that code

[jira] [Updated] (SPARK-3271) Delete unused methods in Utils

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3271: - Assignee: wangfei > Delete unused methods in Utils > -- > >

[jira] [Commented] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113260#comment-14113260 ] Qiping Li commented on SPARK-2207: -- To support minimum instances per node parameter, I t

[jira] [Created] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-27 Thread Qiping Li (JIRA)
Qiping Li created SPARK-3272: Summary: Calculate prediction for nodes separately from calculating information gain for splits in decision tree Key: SPARK-3272 URL: https://issues.apache.org/jira/browse/SPARK-3272

[jira] [Updated] (SPARK-3265) Allow using custom ipython executable with pyspark

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3265: - Affects Version/s: 1.1.0 > Allow using custom ipython executable with pyspark > -

[jira] [Resolved] (SPARK-3265) Allow using custom ipython executable with pyspark

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3265. -- Resolution: Fixed Fix Version/s: (was: 1.0.2) 1.2.0

[jira] [Resolved] (SPARK-3271) Delete unused methods in Utils

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3271. -- Resolution: Fixed > Delete unused methods in Utils > -- > >

[jira] [Created] (SPARK-3271) Delete unused methods in Utils

2014-08-27 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3271: Summary: Delete unused methods in Utils Key: SPARK-3271 URL: https://issues.apache.org/jira/browse/SPARK-3271 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113224#comment-14113224 ] Qiping Li commented on SPARK-3155: -- Joseph has submitted PR [#2125|https://github.com/apa

[jira] [Comment Edited] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113224#comment-14113224 ] Qiping Li edited comment on SPARK-3155 at 8/28/14 2:18 AM: --- Jose

[jira] [Created] (SPARK-3270) Spark API for Embedded Applications

2014-08-27 Thread Michal Malohlava (JIRA)
Michal Malohlava created SPARK-3270: --- Summary: Spark API for Embedded Applications Key: SPARK-3270 URL: https://issues.apache.org/jira/browse/SPARK-3270 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-3168) The ServletContextHandler of webui lacks a SessionManager

2014-08-27 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113208#comment-14113208 ] meiyoula commented on SPARK-3168: - Single Sign On, referred to as the SSO, users need only

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113206#comment-14113206 ] Marcelo Vanzin commented on SPARK-3215: --- Matei, yes, all those things exist, but tha

[jira] [Commented] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113139#comment-14113139 ] Apache Spark commented on SPARK-3269: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Description: {{SparkSQLOperationManager.getNextRowSet}} allocates an {{ArrayBuffer[Row]}} as large as {

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Affects Version/s: (was: 1.2.0) (was: 1.1.0) 1.0.2

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Target Version/s: 1.1.0 (was: 1.1.1) > SparkSQLOperationManager.getNextRowSet OOMs when a large maxRow

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113121#comment-14113121 ] Matei Zaharia commented on SPARK-3215: -- The problem is just how different future or a

[jira] [Created] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3269: - Summary: SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set Key: SPARK-3269 URL: https://issues.apache.org/jira/browse/SPARK-3269 Project: Spark

[jira] [Commented] (SPARK-3261) KMeans clusterer can return duplicate cluster centers

2014-08-27 Thread Derrick Burns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113095#comment-14113095 ] Derrick Burns commented on SPARK-3261: -- This choice also adversely affects performanc

[jira] [Updated] (SPARK-3268) DoubleType should support modulus

2014-08-27 Thread Chris Grier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Grier updated SPARK-3268: --- Priority: Minor (was: Major) > DoubleType should support modulus >

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113062#comment-14113062 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Matei, sorry if I'm missing what you're

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2014-08-27 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113061#comment-14113061 ] Nicholas Chammas commented on SPARK-3044: - Hehe, I believe many people migrated ov

[jira] [Created] (SPARK-3268) DoubleType should support modulus

2014-08-27 Thread Chris Grier (JIRA)
Chris Grier created SPARK-3268: -- Summary: DoubleType should support modulus Key: SPARK-3268 URL: https://issues.apache.org/jira/browse/SPARK-3268 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113055#comment-14113055 ] Matei Zaharia commented on SPARK-3215: -- As I mentioned above, there's more to it than

[jira] [Updated] (SPARK-3168) The ServletContextHandler of webui lacks a SessionManager

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3168: --- Description: When i use CAS to realize single sign of webui, it occurs a exception: {code} WARN [qt

[jira] [Commented] (SPARK-3168) The ServletContextHandler of webui lacks a SessionManager

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113042#comment-14113042 ] Reynold Xin commented on SPARK-3168: Can you explain what CAS is and what do you mean

[jira] [Commented] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113032#comment-14113032 ] Reynold Xin commented on SPARK-2633: Hi guys, What if instead of a full fledged API t

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113029#comment-14113029 ] Reynold Xin commented on SPARK-3044: I thought everybody stopped using RSS when Google

[jira] [Created] (SPARK-3267) Deadlock between ScalaReflectionLock and Data type initialization

2014-08-27 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-3267: - Summary: Deadlock between ScalaReflectionLock and Data type initialization Key: SPARK-3267 URL: https://issues.apache.org/jira/browse/SPARK-3267 Project: Spark

[jira] [Commented] (SPARK-3187) Refactor and cleanup Yarn allocator code

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112970#comment-14112970 ] Apache Spark commented on SPARK-3187: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112958#comment-14112958 ] Marcelo Vanzin commented on SPARK-3215: --- I think the "what RPC to use" discussion is

[jira] [Commented] (SPARK-3265) Allow using custom ipython executable with pyspark

2014-08-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112955#comment-14112955 ] Andrew Or commented on SPARK-3265: -- https://github.com/apache/spark/pull/2167 > Allow us

[jira] [Updated] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2014-08-27 Thread Amey Chaugule (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amey Chaugule updated SPARK-3266: - Description: While I can compile my code, I see: Caused by: java.lang.NoSuchMethodError: org.ap

[jira] [Resolved] (SPARK-3235) In-Memory relation has a bad default size.

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3235. - Resolution: Fixed Fix Version/s: 1.1.0 > In-Memory relation has a bad default size

[jira] [Created] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2014-08-27 Thread Amey Chaugule (JIRA)
Amey Chaugule created SPARK-3266: Summary: JavaDoubleRDD doesn't contain max() Key: SPARK-3266 URL: https://issues.apache.org/jira/browse/SPARK-3266 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112943#comment-14112943 ] Matei Zaharia commented on SPARK-3215: -- I think we should try this externally first a

[jira] [Resolved] (SPARK-3065) Add Locale setting to HiveCompatibilitySuite

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3065. - Resolution: Fixed Fix Version/s: (was: 1.0.2) 1.1.0 > Add L

[jira] [Resolved] (SPARK-3236) Reading Parquet tables from Metastore mangles location

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3236. - Resolution: Fixed Fix Version/s: 1.1.0 > Reading Parquet tables from Metastore man

[jira] [Resolved] (SPARK-3252) Add missing condition in one SQL test

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3252. - Resolution: Fixed Fix Version/s: 1.1.0 > Add missing condition in one SQL test > -

[jira] [Created] (SPARK-3265) Allow using custom ipython executable with pyspark

2014-08-27 Thread Rob O'Dwyer (JIRA)
Rob O'Dwyer created SPARK-3265: -- Summary: Allow using custom ipython executable with pyspark Key: SPARK-3265 URL: https://issues.apache.org/jira/browse/SPARK-3265 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112931#comment-14112931 ] Evan Chan commented on SPARK-3215: -- [~vanzin] we should chat. I'm planning to move our

[jira] [Resolved] (SPARK-3243) spark.driver.* system properties are outdated if --driver-* options exist

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3243. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2154 [https://

[jira] [Resolved] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3213. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2163 [https://github.com

[jira] [Commented] (SPARK-3263) PR #720 broke GraphGenerator.logNormal

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112859#comment-14112859 ] Apache Spark commented on SPARK-3263: - User 'rnowling' has created a pull request for

[jira] [Updated] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2207: - Assignee: Qiping Li (was: Manish Amde) > Add minimum information gain and minimum instances per

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112855#comment-14112855 ] Shivaram Venkataraman commented on SPARK-3215: -- This looks very interesting -

[jira] [Commented] (SPARK-3264) Allow users to set executor Spark home in Mesos

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112811#comment-14112811 ] Apache Spark commented on SPARK-3264: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-3264) Allow users to set executor Spark home in Mesos

2014-08-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-3264: Summary: Allow users to set executor Spark home in Mesos Key: SPARK-3264 URL: https://issues.apache.org/jira/browse/SPARK-3264 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112803#comment-14112803 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Matei, Both suggestions came up during

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112791#comment-14112791 ] Matei Zaharia commented on SPARK-3215: -- Hey Marcelo, while this could be useful for S

[jira] [Commented] (SPARK-3061) Maven build fails in Windows OS

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112784#comment-14112784 ] Apache Spark commented on SPARK-3061: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112780#comment-14112780 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Reynold, thanks for the comments. This

[jira] [Comment Edited] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112769#comment-14112769 ] Reynold Xin edited comment on SPARK-3215 at 8/27/14 8:27 PM: -

[jira] [Created] (SPARK-3263) PR #720 broke GraphGenerator.logNormal

2014-08-27 Thread RJ Nowling (JIRA)
RJ Nowling created SPARK-3263: - Summary: PR #720 broke GraphGenerator.logNormal Key: SPARK-3263 URL: https://issues.apache.org/jira/browse/SPARK-3263 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112769#comment-14112769 ] Reynold Xin commented on SPARK-3215: I looked at the document. The high level proposal

[jira] [Updated] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3213: -- Target Version/s: 1.1.0 > spark_ec2.py cannot find slave instances launched with "Launch More Like This

[jira] [Resolved] (SPARK-2871) Missing API in PySpark

2014-08-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2871. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2093 [https://github.com

[jira] [Resolved] (SPARK-3138) sqlContext.parquetFile should be able to take a single file as parameter

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3138. - Resolution: Fixed Fix Version/s: 1.1.0 > sqlContext.parquetFile should be able to

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Manish Amde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112752#comment-14112752 ] Manish Amde commented on SPARK-3155: [~chouqin] Thanks! I would suggest doing the naiv

[jira] [Commented] (SPARK-2895) Support mapPartitionsWithContext in Spark Java API

2014-08-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112756#comment-14112756 ] Reynold Xin commented on SPARK-2895: BTW feel free to submit a pull request on this.

[jira] [Resolved] (SPARK-3256) Enable :cp to add JARs in spark-shell (Scala 2.10)

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3256. -- Resolution: Fixed Fix Version/s: 1.2.0 > Enable :cp to add JARs in spark-shell (Scala 2.

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112748#comment-14112748 ] Joseph K. Bradley commented on SPARK-3213: -- Testing now... > spark_ec2.py cannot

[jira] [Updated] (SPARK-3256) Enable :cp to add JARs in spark-shell (Scala 2.10)

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3256: - Assignee: Chip Senkbeil > Enable :cp to add JARs in spark-shell (Scala 2.10) > --

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

2014-08-27 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-2706: -- Attachment: v1.0.2.diff This is the patch against v1.0.2. I didn't fix the test cases. The regular test

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112735#comment-14112735 ] Joseph K. Bradley commented on SPARK-3155: -- That sounds good---thank you! > Supp

[jira] [Resolved] (SPARK-3197) Reduce the expression tree object creation from the aggregation functions (min/max)

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3197. - Resolution: Fixed Fix Version/s: 1.1.0 > Reduce the expression tree object creatio

[jira] [Resolved] (SPARK-3118) add "SHOW TBLPROPERTIES tblname;" and "SHOW COLUMNS (FROM|IN) table_name [(FROM|IN) db_name]" support

2014-08-27 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3118. - Resolution: Fixed Fix Version/s: 1.1.0 > add "SHOW TBLPROPERTIES tblname;" and "SH

[jira] [Updated] (SPARK-3259) User data should be given to the master

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3259: --- Assignee: Allan Douglas R. de Oliveira > User data should be given to the master > --

[jira] [Resolved] (SPARK-3259) User data should be given to the master

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3259. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2162 [https://

[jira] [Resolved] (SPARK-2608) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2608. Resolution: Fixed Resolved by: https://github.com/apache/spark/pull/2161 However, it would

[jira] [Created] (SPARK-3262) CREATE VIEW is not supported but the error message is not clear

2014-08-27 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-3262: Summary: CREATE VIEW is not supported but the error message is not clear Key: SPARK-3262 URL: https://issues.apache.org/jira/browse/SPARK-3262 Project: Spark

[jira] [Updated] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3213: --- Priority: Major (was: Blocker) > spark_ec2.py cannot find slave instances launched with "Lau

[jira] [Updated] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3213: --- Priority: Critical (was: Major) > spark_ec2.py cannot find slave instances launched with "La

[jira] [Created] (SPARK-3261) KMeans clusterer can return duplicate cluster centers

2014-08-27 Thread Derrick Burns (JIRA)
Derrick Burns created SPARK-3261: Summary: KMeans clusterer can return duplicate cluster centers Key: SPARK-3261 URL: https://issues.apache.org/jira/browse/SPARK-3261 Project: Spark Issue Typ

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances launched with "Launch More Like This"

2014-08-27 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112652#comment-14112652 ] Vida Ha commented on SPARK-3213: I have a pull request that fixes the issue by copying the

[jira] [Created] (SPARK-3260) Yarn - pass acls along with executor launch

2014-08-27 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-3260: Summary: Yarn - pass acls along with executor launch Key: SPARK-3260 URL: https://issues.apache.org/jira/browse/SPARK-3260 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3260) Yarn - pass acls along with executor launch

2014-08-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-3260: - Target Version/s: 1.1.1, 1.2.0 (was: 1.2.0) > Yarn - pass acls along with executor launch >

[jira] [Comment Edited] (SPARK-2501) Handle stage re-submissions properly in the UI

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112624#comment-14112624 ] Patrick Wendell edited comment on SPARK-2501 at 8/27/14 6:45 PM: ---

[jira] [Assigned] (SPARK-2501) Handle stage re-submissions properly in the UI

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-2501: -- Assignee: Patrick Wendell (was: Masayoshi TSUZUKI) > Handle stage re-submissions prope

[jira] [Comment Edited] (SPARK-2501) Handle stage re-submissions properly in the UI

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112624#comment-14112624 ] Patrick Wendell edited comment on SPARK-2501 at 8/27/14 6:45 PM: ---

[jira] [Resolved] (SPARK-2501) Handle stage re-submissions properly in the UI

2014-08-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2501. Resolution: Fixed Fix Version/s: 1.1.0 Fixed as a result of SPARK-3020 > Handle sta

[jira] [Commented] (SPARK-3259) User data should be given to the master

2014-08-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112616#comment-14112616 ] Apache Spark commented on SPARK-3259: - User 'douglaz' has created a pull request for t

[jira] [Created] (SPARK-3259) User data should be given to the master

2014-08-27 Thread Allan Douglas R. de Oliveira (JIRA)
Allan Douglas R. de Oliveira created SPARK-3259: --- Summary: User data should be given to the master Key: SPARK-3259 URL: https://issues.apache.org/jira/browse/SPARK-3259 Project: Spark

[jira] [Created] (SPARK-3258) Python API for streaming MLlib algorithms

2014-08-27 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-3258: Summary: Python API for streaming MLlib algorithms Key: SPARK-3258 URL: https://issues.apache.org/jira/browse/SPARK-3258 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-3256) Enable :cp to add JARs in spark-shell (Scala 2.10)

2014-08-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3256: - Fix Version/s: (was: 1.2.0) > Enable :cp to add JARs in spark-shell (Scala 2.10) > --

  1   2   >