[jira] [Assigned] (SPARK-12166) Unset hadoop related environment in testing

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12166: Assignee: Apache Spark > Unset hadoop related environment in testing > --

[jira] [Assigned] (SPARK-12166) Unset hadoop related environment in testing

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12166: Assignee: (was: Apache Spark) > Unset hadoop related environment in testing > ---

[jira] [Commented] (SPARK-12166) Unset hadoop related environment in testing

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044531#comment-15044531 ] Apache Spark commented on SPARK-12166: -- User 'zjffdu' has created a pull request for

[jira] [Updated] (SPARK-12166) Unset hadoop related environment in testing

2015-12-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12166: --- Priority: Minor (was: Major) > Unset hadoop related environment in testing > --

[jira] [Closed] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi closed SPARK-12167. - Resolution: Duplicate > Invoke the right sameResult function when plan is warpped with SubQueries > -

[jira] [Commented] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044488#comment-15044488 ] Yadong Qi commented on SPARK-12167: --- SPARK-11246 has already fixed it > Invoke the rig

[jira] [Comment Edited] (SPARK-6415) Spark Streaming fail-fast: Stop scheduling jobs when a batch fails, and kills the app

2015-12-06 Thread Yoel Amram (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044110#comment-15044110 ] Yoel Amram edited comment on SPARK-6415 at 12/7/15 7:06 AM: It

[jira] [Created] (SPARK-12174) Slow test: BlockManagerSuite."SPARK-9591: getRemoteBytes from another location when Exception throw"

2015-12-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12174: -- Summary: Slow test: BlockManagerSuite."SPARK-9591: getRemoteBytes from another location when Exception throw" Key: SPARK-12174 URL: https://issues.apache.org/jira/browse/SPARK-12174

[jira] [Updated] (SPARK-6990) Add Java linting script

2015-12-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6990: -- Assignee: Dmitry Erastov > Add Java linting script > --- > > Key: SP

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044418#comment-15044418 ] Shivaram Venkataraman commented on SPARK-12169: --- Thanks [~sunrui] for start

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12158: Component/s: (was: R) SparkR > [R] [SQL] Fix 'sample' functions that break R unit test

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044394#comment-15044394 ] Felix Cheung commented on SPARK-12169: -- For those who's reading - we shouldn't open

[jira] [Commented] (SPARK-12172) Remove SparkR internal RDD APIs

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044393#comment-15044393 ] Sun Rui commented on SPARK-12172: - Not sure if we want to remove RDD API. Need more discu

[jira] [Closed] (SPARK-12171) Support DataSet API in SparkR

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-12171. --- Resolution: Duplicate > Support DataSet API in SparkR > - > > Key

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044390#comment-15044390 ] Felix Cheung commented on SPARK-12169: -- Great thanks for opening this. I think we sh

[jira] [Updated] (SPARK-12171) Support DataSet API in SparkR

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-12171: Component/s: Spark Submit > Support DataSet API in SparkR > - > >

[jira] [Created] (SPARK-12171) Support DataSet API in SparkR

2015-12-06 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12171: --- Summary: Support DataSet API in SparkR Key: SPARK-12171 URL: https://issues.apache.org/jira/browse/SPARK-12171 Project: Spark Issue Type: New Feature Repor

[jira] [Updated] (SPARK-12171) Support DataSet API in SparkR

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-12171: Component/s: (was: Spark Submit) SparkR > Support DataSet API in SparkR >

[jira] [Created] (SPARK-12173) Consider supporting DataSet API in SparkR

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12173: Summary: Consider supporting DataSet API in SparkR Key: SPARK-12173 URL: https://issues.apache.org/jira/browse/SPARK-12173 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-12172) Remove SparkR internal RDD APIs

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12172: Summary: Remove SparkR internal RDD APIs Key: SPARK-12172 URL: https://issues.apache.org/jira/browse/SPARK-12172 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-12169: Issue Type: Improvement (was: Bug) > SparkR 2.0 > -- > > Key: SPARK-12169 >

[jira] [Created] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-06 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12170: --- Summary: Deprecate the JAVA-specific deserialized storage levels Key: SPARK-12170 URL: https://issues.apache.org/jira/browse/SPARK-12170 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12169: --- Summary: SparkR 2.0 Key: SPARK-12169 URL: https://issues.apache.org/jira/browse/SPARK-12169 Project: Spark Issue Type: Bug Components: SparkR Rep

[jira] [Assigned] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12168: Assignee: Apache Spark > Need test for conflicted function in R >

[jira] [Commented] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044379#comment-15044379 ] Apache Spark commented on SPARK-12168: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12168: Assignee: (was: Apache Spark) > Need test for conflicted function in R > -

[jira] [Updated] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Summary: Need test for conflicted function in R (was: Need test for masked function) > Need tes

[jira] [Updated] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Description: Currently it is hard to know if a function in base or stats packages are masked whe

[jira] [Created] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12168: Summary: Need test for masked function Key: SPARK-12168 URL: https://issues.apache.org/jira/browse/SPARK-12168 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-12-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044360#comment-15044360 ] Wenchen Fan commented on SPARK-12045: - 1. We need to process on UTF8String(an interna

[jira] [Commented] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

2015-12-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044348#comment-15044348 ] Josh Rosen commented on SPARK-12155: I think this is blocked by the fix for SPARK-121

[jira] [Assigned] (SPARK-12165) Execution memory requests may fail to evict storage blocks if storage memory usage is below max memory

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12165: Assignee: Josh Rosen (was: Apache Spark) > Execution memory requests may fail to evict st

[jira] [Commented] (SPARK-12165) Execution memory requests may fail to evict storage blocks if storage memory usage is below max memory

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044342#comment-15044342 ] Apache Spark commented on SPARK-12165: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12165) Execution memory requests may fail to evict storage blocks if storage memory usage is below max memory

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12165: Assignee: Apache Spark (was: Josh Rosen) > Execution memory requests may fail to evict st

[jira] [Assigned] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12167: Assignee: (was: Apache Spark) > Invoke the right sameResult function when plan is warp

[jira] [Commented] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044335#comment-15044335 ] Apache Spark commented on SPARK-12167: -- User 'watermen' has created a pull request f

[jira] [Assigned] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12167: Assignee: Apache Spark > Invoke the right sameResult function when plan is warpped with Su

[jira] [Created] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12167: - Summary: Invoke the right sameResult function when plan is warpped with SubQueries Key: SPARK-12167 URL: https://issues.apache.org/jira/browse/SPARK-12167 Project: Spark

[jira] [Commented] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044304#comment-15044304 ] Apache Spark commented on SPARK-12060: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-12125) pull out nondeterministic expressions from Join

2015-12-06 Thread iward (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044272#comment-15044272 ] iward commented on SPARK-12125: --- Ok,get.Thanks a lot. > pull out nondeterministic expressi

[jira] [Created] (SPARK-12166) Unset hadoop related environment in testing

2015-12-06 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12166: -- Summary: Unset hadoop related environment in testing Key: SPARK-12166 URL: https://issues.apache.org/jira/browse/SPARK-12166 Project: Spark Issue Type: Improvem

[jira] [Resolved] (SPARK-12152) Speed up Scalastyle by only running one SBT command instead of four

2015-12-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12152. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10151 [https://github.

[jira] [Commented] (SPARK-11046) Pass schema from R to JVM using JSON format

2015-12-06 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044249#comment-15044249 ] Sun Rui commented on SPARK-11046: - [~nakul02], yes, you are correct > Pass schema from R

[jira] [Created] (SPARK-12165) Execution memory requests may fail to evict storage blocks if storage memory usage is below max memory

2015-12-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12165: -- Summary: Execution memory requests may fail to evict storage blocks if storage memory usage is below max memory Key: SPARK-12165 URL: https://issues.apache.org/jira/browse/SPARK-12165

[jira] [Commented] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

2015-12-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044237#comment-15044237 ] Josh Rosen commented on SPARK-12155: I'm working on fixing this issue. I have a regre

[jira] [Assigned] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

2015-12-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12155: -- Assignee: Josh Rosen > Execution OOM after a relative large dataset cached in the cluster. > -

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-12-06 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044223#comment-15044223 ] hujiayin commented on SPARK-4036: - Hi Andrew, The code is implemented by Scala and integr

[jira] [Comment Edited] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-12-06 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044223#comment-15044223 ] hujiayin edited comment on SPARK-4036 at 12/7/15 1:00 AM: -- Hi And

[jira] [Commented] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

2015-12-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044145#comment-15044145 ] holdenk commented on SPARK-12040: - So this came out of wanting to have a matching API bet

[jira] [Commented] (SPARK-6415) Spark Streaming fail-fast: Stop scheduling jobs when a batch fails, and kills the app

2015-12-06 Thread Yoel Amram (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044110#comment-15044110 ] Yoel Amram commented on SPARK-6415: --- It would be useful to let the application decide wh

[jira] [Updated] (SPARK-12138) Escape \u in the generated comments.

2015-12-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12138: - Fix Version/s: 1.5.3 > Escape \u in the generated comments. > > >

[jira] [Updated] (SPARK-12138) Escape \u in the generated comments.

2015-12-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12138: - Assignee: Xiao Li > Escape \u in the generated comments. > > >

[jira] [Resolved] (SPARK-12138) Escape \u in the generated comments.

2015-12-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12138. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10155 [https://github.com/

[jira] [Assigned] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12159: Assignee: (was: Apache Spark) > Add user guide section for IndexToString transformer >

[jira] [Commented] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043995#comment-15043995 ] Apache Spark commented on SPARK-12159: -- User 'BenFradet' has created a pull request

[jira] [Assigned] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12159: Assignee: Apache Spark > Add user guide section for IndexToString transformer > --

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12164: Description: So far, we are using comma-separated decimal format to output the encoded contents. This way

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12164: Description: So far, we are using comma-separated decimal format to output the encoded contents. This way

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12164: Description: So far, we are using comma-separated decimal format to output the encoded contents. This way

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12164: Description: So far, we are using comma-separated decimal format to output the encoded contents. This way

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12164: Description: So far, we are using comma-separated decimal format to output the encoded contents. This way

[jira] [Assigned] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12164: Assignee: (was: Apache Spark) > [SQL] Display the binary/encoded values >

[jira] [Commented] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043983#comment-15043983 ] Apache Spark commented on SPARK-12164: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12164: Assignee: Apache Spark > [SQL] Display the binary/encoded values > ---

[jira] [Created] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-06 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12164: --- Summary: [SQL] Display the binary/encoded values Key: SPARK-12164 URL: https://issues.apache.org/jira/browse/SPARK-12164 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12056) NewHadoopRDD: TaskAttemptContext should be created only after calling setConf.

2015-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043949#comment-15043949 ] Apache Spark commented on SPARK-12056: -- User 'tedyu' has created a pull request for

[jira] [Updated] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12048: -- Assignee: R. H. > JDBCRDD calls close() twice - SQLite then throws an exception > -

[jira] [Resolved] (SPARK-12048) JDBCRDD calls close() twice - SQLite then throws an exception

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12048. --- Resolution: Fixed Fix Version/s: 1.6.1 1.5.3 2.0.0 Issue

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4231: - Assignee: Debasish Das > Add RankingMetrics to examples.MovieLensALS > ---

[jira] [Updated] (SPARK-12143) When column type is binary, select occurs ClassCastExcption in Beeline.

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12143: -- Component/s: SQL [~meiyoula] set component please and read https://cwiki.apache.org/confluence/display

[jira] [Updated] (SPARK-12156) SPARK_EXECUTOR_INSTANCES is not effective

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12156: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Fix Version/s: (wa

[jira] [Updated] (SPARK-12125) pull out nondeterministic expressions from Join

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12125: -- Component/s: SQL > pull out nondeterministic expressions from Join > --

[jira] [Updated] (SPARK-12125) pull out nondeterministic expressions from Join

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12125: -- Affects Version/s: (was: 1.5.1) (was: 1.5.0) Target Version/s: (wa

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12060: -- Fix Version/s: (was: 1.6.0) > Avoid memory copy in JavaSerializerInstance.serialize > -

[jira] [Updated] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9603: - Fix Version/s: (was: 1.6.0) > Re-enable complex R package test in SparkSubmitSuite > -

[jira] [Updated] (SPARK-12163) FPGrowth unusable on some datasets without extensive tweaking of the support threshold

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12163: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > FPGrowth unusable on some dat

[jira] [Created] (SPARK-12163) FPGrowth unusable on some datasets without extensive tweaking of the support threshold

2015-12-06 Thread Jaroslav Kuchar (JIRA)
Jaroslav Kuchar created SPARK-12163: --- Summary: FPGrowth unusable on some datasets without extensive tweaking of the support threshold Key: SPARK-12163 URL: https://issues.apache.org/jira/browse/SPARK-12163

[jira] [Commented] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-06 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043789#comment-15043789 ] Sasi commented on SPARK-12162: -- I'm running on JBoss Spark command that create temporary tab

[jira] [Commented] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043783#comment-15043783 ] Sean Owen commented on SPARK-12162: --- I see, you have the app driver in JBoss? I'm not c

[jira] [Commented] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-06 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043782#comment-15043782 ] Sasi commented on SPARK-12162: -- Hey, Thanks for the quick response. On my JBoss i'm running

[jira] [Updated] (SPARK-12153) Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12153: -- Labels: (was: patch) Priority: Minor (was: Major) (I don't think this can be considered major)

[jira] [Updated] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12136: -- Labels: starter (was: ) [~naveenminchu] Just read https://cwiki.apache.org/confluence/display/SPARK/C

[jira] [Resolved] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12162. --- Resolution: Not A Problem I think the answer is that you can't in general "embed" the Spark executor

[jira] [Created] (SPARK-12162) Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called

2015-12-06 Thread Sasi (JIRA)
Sasi created SPARK-12162: Summary: Embedded Spark on JBoss server cause crashing due system.exit when SparkUncaughtExceptionHandler called Key: SPARK-12162 URL: https://issues.apache.org/jira/browse/SPARK-12162