[jira] [Commented] (SPARK-7042) Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x

2015-05-29 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564339#comment-14564339 ] Konstantin Shaposhnikov commented on SPARK-7042: I've created a pull

[jira] [Updated] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7939: -- Labels: 1.4.1 (was: ) Make URL partition recognition return String by default for all partition

[jira] [Resolved] (SPARK-7912) Make OneHotEncoder more optimistic about the input

2015-05-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7912. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6466

[jira] [Commented] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564366#comment-14564366 ] Sean Owen commented on SPARK-7941: -- Which cache files are you referring to (what

[jira] [Commented] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564376#comment-14564376 ] Cory Nguyen commented on SPARK-7941: The location in /mnt or /mnt1 =

[jira] [Created] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-05-29 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-7942: --- Summary: Receiver's life cycle is inconsistent with streaming job. Key: SPARK-7942 URL: https://issues.apache.org/jira/browse/SPARK-7942 Project: Spark Issue

[jira] [Updated] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7934: --- Description: The conf/spark-defaults.conf {noformat} spark.executor.extraJavaOptions -XX:+UseG1GC

[jira] [Updated] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7934: --- Description: The conf/spark-defaults.conf {noformat} spark.executor.extraJavaOptions -XX:+UseG1GC

[jira] [Commented] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-05-29 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564411#comment-14564411 ] SaintBacchus commented on SPARK-7942: - [~tdas] Should we add a logic to shut down the

[jira] [Commented] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564412#comment-14564412 ] Jianshi Huang commented on SPARK-7939: -- That would be nice, also consider disabling

[jira] [Resolved] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7934. -- Resolution: Invalid OK, but you already reopened it. I agree that this is not actionable now. The error

[jira] [Comment Edited] (SPARK-7541) Check model save/load for MLlib 1.4

2015-05-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564263#comment-14564263 ] yuhao yang edited comment on SPARK-7541 at 5/29/15 6:40 AM:

[jira] [Commented] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564330#comment-14564330 ] Cheng Lian commented on SPARK-7939: --- We can probably provide a data source option to

[jira] [Comment Edited] (SPARK-7541) Check model save/load for MLlib 1.4

2015-05-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564296#comment-14564296 ] yuhao yang edited comment on SPARK-7541 at 5/29/15 7:14 AM:

[jira] [Updated] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cory Nguyen updated SPARK-7941: --- Attachment: screenshot-1.png Cache Cleanup Failure when job is killed by Spark

[jira] [Comment Edited] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564376#comment-14564376 ] Cory Nguyen edited comment on SPARK-7941 at 5/29/15 8:02 AM: -

[jira] [Updated] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cory Nguyen updated SPARK-7941: --- Description: Problem/Bug: If a job is running and Spark kills the job intentionally, the cache files

[jira] [Commented] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564386#comment-14564386 ] Guoqiang Li commented on SPARK-7934: OK, the information is a little less, but I can

[jira] [Updated] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-7934: --- Description: The conf/spark-defaults.conf {noformat} spark.executor.extraJavaOptions -XX:+UseG1GC

[jira] [Commented] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564409#comment-14564409 ] Guoqiang Li commented on SPARK-7934: cc [~srowen] In some cases, Spark hangs in

[jira] [Commented] (SPARK-7042) Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564336#comment-14564336 ] Apache Spark commented on SPARK-7042: - User 'kostya-sh' has created a pull request for

[jira] [Created] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
Cory Nguyen created SPARK-7941: -- Summary: Cache Cleanup Failure when job is killed by Spark Key: SPARK-7941 URL: https://issues.apache.org/jira/browse/SPARK-7941 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7934. -- Resolution: Invalid This doesn't describe a problem specifically enough to act on this, and the logs

[jira] [Commented] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564396#comment-14564396 ] Sean Owen commented on SPARK-7941: -- I am not an expert on this bit of YARN, but, this

[jira] [Reopened] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li reopened SPARK-7934: In some cases, Spark hangs in yarn-client mode. ---

[jira] [Updated] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-05-29 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-7942: Description: Streaming consider the receiver as a common spark job, thus if an error occurs in the

[jira] [Commented] (SPARK-7725) --py-files doesn't seem to work in YARN cluster mode

2015-05-29 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564421#comment-14564421 ] Shay Rojansky commented on SPARK-7725: -- Here you go:

[jira] [Commented] (SPARK-7725) --py-files doesn't seem to work in YARN cluster mode

2015-05-29 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564415#comment-14564415 ] Shawn Guo commented on SPARK-7725: -- Could you paste the discussion url? I met same issue

[jira] [Updated] (SPARK-7913) Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer and AppendOnlyMap

2015-05-29 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7913: Description: We can change the growing strategy to increase the maximum capacity of

[jira] [Resolved] (SPARK-7929) Remove Bagel examples

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7929. Resolution: Fixed Fix Version/s: 1.4.0 Remove Bagel examples -

[jira] [Resolved] (SPARK-7927) Enforce whitespace for more tokens in style checker

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7927. Resolution: Fixed Fix Version/s: 1.4.0 Enforce whitespace for more tokens in style checker

[jira] [Commented] (SPARK-7541) Check model save/load for MLlib 1.4

2015-05-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564263#comment-14564263 ] yuhao yang commented on SPARK-7541: --- ||model||Scala UT ||

[jira] [Assigned] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7936: --- Assignee: Apache Spark Add configuration for initial size of hash for aggregation and limit

[jira] [Commented] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564270#comment-14564270 ] Apache Spark commented on SPARK-7936: - User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7936: --- Assignee: (was: Apache Spark) Add configuration for initial size of hash for

[jira] [Created] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7938: -- Summary: Use errorprone in Spark Key: SPARK-7938 URL: https://issues.apache.org/jira/browse/SPARK-7938 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-7936) Add configuration for initial size and limit of hash for aggregation

2015-05-29 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-7936: - Summary: Add configuration for initial size and limit of hash for aggregation (was: Add configuration for

[jira] [Updated] (SPARK-7939) Make URL partition recognition return String by default for all partition column types and values

2015-05-29 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang updated SPARK-7939: - Summary: Make URL partition recognition return String by default for all partition column types

[jira] [Assigned] (SPARK-7940) Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7940: --- Assignee: Apache Spark (was: Reynold Xin) Enforce whitespace checking for DO, TRY, CATCH,

[jira] [Commented] (SPARK-7927) Enforce whitespace for more tokens in style checker

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564251#comment-14564251 ] Apache Spark commented on SPARK-7927: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

2015-05-29 Thread Jianshi Huang (JIRA)
Jianshi Huang created SPARK-7937: Summary: Cannot compare Hive named_struct. (when using argmax, argmin) Key: SPARK-7937 URL: https://issues.apache.org/jira/browse/SPARK-7937 Project: Spark

[jira] [Updated] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

2015-05-29 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang updated SPARK-7937: - Description: Imagine the following SQL: Intention: get last used bank account country.

[jira] [Updated] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

2015-05-29 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang updated SPARK-7937: - Description: Imagine the following SQL: Intention: get last used bank account country. ``` sql

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564266#comment-14564266 ] Josh Rosen commented on SPARK-7708: --- Also, it looks like Chill is still using Kryo 2.2.1

[jira] [Updated] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7938: --- Labels: starter (was: ) Use errorprone in Spark --- Key:

[jira] [Commented] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-29 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564271#comment-14564271 ] Navis commented on SPARK-7936: -- Added two configuration 1.

[jira] [Created] (SPARK-7939) Make URL partition recognition return String by default for all partition column values

2015-05-29 Thread Jianshi Huang (JIRA)
Jianshi Huang created SPARK-7939: Summary: Make URL partition recognition return String by default for all partition column values Key: SPARK-7939 URL: https://issues.apache.org/jira/browse/SPARK-7939

[jira] [Commented] (SPARK-6806) SparkR examples in programming guide

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564293#comment-14564293 ] Apache Spark commented on SPARK-6806: - User 'shivaram' has created a pull request for

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564300#comment-14564300 ] Josh Rosen commented on SPARK-7938: --- If possible, we should also integrate this into our

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-05-29 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564292#comment-14564292 ] Yijie Shen commented on SPARK-7938: --- I'd love to take this :) Use errorprone in Spark

[jira] [Created] (SPARK-7940) Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH

2015-05-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7940: -- Summary: Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH Key: SPARK-7940 URL: https://issues.apache.org/jira/browse/SPARK-7940 Project: Spark

[jira] [Assigned] (SPARK-7940) Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7940: --- Assignee: Reynold Xin (was: Apache Spark) Enforce whitespace checking for DO, TRY, CATCH,

[jira] [Commented] (SPARK-7940) Enforce whitespace checking for DO, TRY, CATCH, FINALLY, MATCH

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564309#comment-14564309 ] Apache Spark commented on SPARK-7940: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

2015-05-29 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564267#comment-14564267 ] Jianshi Huang commented on SPARK-7937: -- Blog for describing Hive's argmax, argmin

[jira] [Commented] (SPARK-7541) Check model save/load for MLlib 1.4

2015-05-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564296#comment-14564296 ] yuhao yang commented on SPARK-7541: --- Oh, checked means I found no python support for

[jira] [Resolved] (SPARK-7948) Serdes Command not working in Spark 1.3.1

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7948. -- Resolution: Duplicate [~mallieswari] Please review

[jira] [Assigned] (SPARK-7949) update document with some missing save/load

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7949: --- Assignee: (was: Apache Spark) update document with some missing save/load

[jira] [Assigned] (SPARK-7949) update document with some missing save/load

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7949: --- Assignee: Apache Spark update document with some missing save/load

[jira] [Comment Edited] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564696#comment-14564696 ] Alexander Nakos edited comment on SPARK-7944 at 5/29/15 12:23 PM:

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564643#comment-14564643 ] Sean Owen commented on SPARK-7944: -- Can you give more detail, like what you tried to run

[jira] [Updated] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7945: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) (Let's set type/priority

[jira] [Commented] (SPARK-7949) update document with some missing save/load

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564692#comment-14564692 ] Apache Spark commented on SPARK-7949: - User 'hhbyyh' has created a pull request for

[jira] [Updated] (SPARK-7947) Serdes Command not working

2015-05-29 Thread Mallieswari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mallieswari updated SPARK-7947: --- Summary: Serdes Command not working (was: Serdes Command not working) Serdes Command not working

[jira] [Updated] (SPARK-7949) update document with some missing save/load

2015-05-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-7949: -- Description: As part of 7541, add save load for examples: KMeansModel PowerIterationClusteringModel

[jira] [Created] (SPARK-7948) Serdes Command not working in Spark 1.3.1

2015-05-29 Thread Mallieswari (JIRA)
Mallieswari created SPARK-7948: -- Summary: Serdes Command not working in Spark 1.3.1 Key: SPARK-7948 URL: https://issues.apache.org/jira/browse/SPARK-7948 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7947) Serdes Command not working in Spark 1.3.1

2015-05-29 Thread Mallieswari (JIRA)
Mallieswari created SPARK-7947: -- Summary: Serdes Command not working in Spark 1.3.1 Key: SPARK-7947 URL: https://issues.apache.org/jira/browse/SPARK-7947 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7947) Serdes Command not working

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7947: - Description: I have configured spark sql and executed the *hive serde* command like below {code}

[jira] [Created] (SPARK-7949) update document with some missing save/load

2015-05-29 Thread yuhao yang (JIRA)
yuhao yang created SPARK-7949: - Summary: update document with some missing save/load Key: SPARK-7949 URL: https://issues.apache.org/jira/browse/SPARK-7949 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564696#comment-14564696 ] Alexander Nakos commented on SPARK-7944: Surely - sorry about that. I started up

[jira] [Updated] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7946: - Component/s: MLlib Set component please

[jira] [Comment Edited] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564696#comment-14564696 ] Alexander Nakos edited comment on SPARK-7944 at 5/29/15 12:26 PM:

[jira] [Updated] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Nakos updated SPARK-7944: --- Attachment: spark_shell_output.txt Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class

[jira] [Updated] (SPARK-7913) Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer and AppendOnlyMap

2015-05-29 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7913: Summary: Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer

[jira] [Updated] (SPARK-7863) SimpleDateParam should not use SimpleDateFormat in multiple threads because SimpleDateFormat is not thread-safe

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7863: - Priority: Minor (was: Major) SimpleDateParam should not use SimpleDateFormat in multiple threads

[jira] [Updated] (SPARK-7863) SimpleDateParam should not use SimpleDateFormat in multiple threads because SimpleDateFormat is not thread-safe

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7863: - Assignee: Shixiong Zhu SimpleDateParam should not use SimpleDateFormat in multiple threads because

[jira] [Comment Edited] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564459#comment-14564459 ] Cory Nguyen edited comment on SPARK-7941 at 5/29/15 9:28 AM: -

[jira] [Assigned] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7945: --- Assignee: Apache Spark Do trim to values of properties ---

[jira] [Created] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Tao Wang (JIRA)
Tao Wang created SPARK-7945: --- Summary: Do trim to values of properties Key: SPARK-7945 URL: https://issues.apache.org/jira/browse/SPARK-7945 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7946: --- Assignee: Apache Spark DecayFactor wrongly set in StreamingKMeans

[jira] [Commented] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564567#comment-14564567 ] Apache Spark commented on SPARK-7946: - User 'MechCoder' has created a pull request for

[jira] [Resolved] (SPARK-7863) SimpleDateParam should not use SimpleDateFormat in multiple threads because SimpleDateFormat is not thread-safe

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7863. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6406

[jira] [Created] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-05-29 Thread baishuo (JIRA)
baishuo created SPARK-7943: -- Summary: saveAsTable in DataFrameWriter can only add table to DataBase “default” Key: SPARK-7943 URL: https://issues.apache.org/jira/browse/SPARK-7943 Project: Spark

[jira] [Created] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
Alexander Nakos created SPARK-7944: -- Summary: Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path Key: SPARK-7944 URL: https://issues.apache.org/jira/browse/SPARK-7944 Project: Spark

[jira] [Assigned] (SPARK-7946) DecayFactor wrongly set in StreamingKMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7946: --- Assignee: (was: Apache Spark) DecayFactor wrongly set in StreamingKMeans

[jira] [Commented] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Cory Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564459#comment-14564459 ] Cory Nguyen commented on SPARK-7941: I'm not entirely sure what you meant by app data

[jira] [Commented] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564462#comment-14564462 ] Sean Owen commented on SPARK-7941: -- I see, scratch that. 'hadoop' is usually a user for

[jira] [Assigned] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7943: --- Assignee: (was: Apache Spark) saveAsTable in DataFrameWriter can only add table to

[jira] [Updated] (SPARK-7756) Ensure Spark runs clean on IBM Java implementation

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7756: - Affects Version/s: (was: 1.5.0) 1.4.0 Ensure Spark runs clean on IBM Java

[jira] [Resolved] (SPARK-7756) Ensure Spark runs clean on IBM Java implementation

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7756. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6282

[jira] [Updated] (SPARK-7756) Ensure Spark runs clean on IBM Java implementation

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7756: - Assignee: Tim Ellison Ensure Spark runs clean on IBM Java implementation

[jira] [Commented] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564483#comment-14564483 ] Apache Spark commented on SPARK-7943: - User 'baishuo' has created a pull request for

[jira] [Assigned] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7943: --- Assignee: Apache Spark saveAsTable in DataFrameWriter can only add table to DataBase

[jira] [Commented] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564495#comment-14564495 ] Apache Spark commented on SPARK-7221: - User 'animeshbaranawal' has created a pull

[jira] [Commented] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564559#comment-14564559 ] Apache Spark commented on SPARK-7945: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-7945) Do trim to values of properties

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7945: --- Assignee: (was: Apache Spark) Do trim to values of properties

[jira] [Commented] (SPARK-7934) In some cases, Spark hangs in yarn-client mode.

2015-05-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564562#comment-14564562 ] Guoqiang Li commented on SPARK-7934: [~srowen] I want to say that some reasons cause

[jira] [Commented] (SPARK-7680) Add a fake Receiver that generates random strings, useful for prototyping

2015-05-29 Thread Rohith Yeravothula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564815#comment-14564815 ] Rohith Yeravothula commented on SPARK-7680: --- can you please give some more

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564709#comment-14564709 ] Sean Owen commented on SPARK-7944: -- I assume the file does exist locally. I think --jars

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-05-29 Thread Alexander Nakos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564723#comment-14564723 ] Alexander Nakos commented on SPARK-7944: Yes, the file definitely exists locally.

[jira] [Assigned] (SPARK-4118) Create python bindings for Streaming KMeans

2015-05-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4118: --- Assignee: (was: Apache Spark) Create python bindings for Streaming KMeans

  1   2   >