[jira] [Created] (SPARK-7073) Clean up Python data type hierarchy

Reynold Xin created SPARK-7073: -- Summary: Clean up Python data type hierarchy Key: SPARK-7073 URL: https://issues.apache.org/jira/browse/SPARK-7073 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7068) Remove PrimitiveType

[ https://issues.apache.org/jira/browse/SPARK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7068. Resolution: Fixed Fix Version/s: 1.4.0 > Remove PrimitiveType > > >

[jira] [Assigned] (SPARK-7069) Rename NativeType -> AtomicType

[ https://issues.apache.org/jira/browse/SPARK-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7069: --- Assignee: Apache Spark (was: Reynold Xin) > Rename NativeType -> AtomicType > --

[jira] [Commented] (SPARK-7069) Rename NativeType -> AtomicType

[ https://issues.apache.org/jira/browse/SPARK-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508556#comment-14508556 ] Apache Spark commented on SPARK-7069: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-7069) Rename NativeType -> AtomicType

[ https://issues.apache.org/jira/browse/SPARK-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7069: --- Assignee: Reynold Xin (was: Apache Spark) > Rename NativeType -> AtomicType > --

[jira] [Created] (SPARK-7072) Document fetching field values by name on sql.Row/DataFrame

vidmantas zemleris created SPARK-7072: - Summary: Document fetching field values by name on sql.Row/DataFrame Key: SPARK-7072 URL: https://issues.apache.org/jira/browse/SPARK-7072 Project: Spark

[jira] [Updated] (SPARK-7069) Rename NativeType -> AtomicType

[ https://issues.apache.org/jira/browse/SPARK-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7069: --- Summary: Rename NativeType -> AtomicType (was: Remove NativeType) > Rename NativeType -> AtomicType >

[jira] [Updated] (SPARK-7069) Rename NativeType -> AtomicType

[ https://issues.apache.org/jira/browse/SPARK-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7069: --- Description: I think our NativeType is really just AtomicTypes. Let's use that instead. was: Simil

[jira] [Commented] (SPARK-6989) Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various arcane compiler errors

[ https://issues.apache.org/jira/browse/SPARK-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508537#comment-14508537 ] Prashant Sharma commented on SPARK-6989: I can not reproduce in master. > Spark

[jira] [Updated] (SPARK-7071) use saveAsNewAPIHadoopFile for many times ,it will be throw :Delegation Token can be issued only with kerberos or web authentication

[ https://issues.apache.org/jira/browse/SPARK-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated SPARK-7071: --- Fix Version/s: 1.3.1 > use saveAsNewAPIHadoopFile for many times ,it will be throw :Delegation > Token can b

[jira] [Updated] (SPARK-7071) use saveAsNewAPIHadoopFile for many times ,it will be throw :Delegation Token can be issued only with kerberos or web authentication

[ https://issues.apache.org/jira/browse/SPARK-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated SPARK-7071: --- Description: Use saveAsNewAPIHadoopFile for job,after execute many times ,it may be give this error one times

[jira] [Created] (SPARK-7071) use saveAsNewAPIHadoopFile for many times ,it will be throw :Delegation Token can be issued only with kerberos or web authentication

yuemeng created SPARK-7071: -- Summary: use saveAsNewAPIHadoopFile for many times ,it will be throw :Delegation Token can be issued only with kerberos or web authentication Key: SPARK-7071 URL: https://issues.apache.org/j

[jira] [Commented] (SPARK-6529) Word2Vec transformer

[ https://issues.apache.org/jira/browse/SPARK-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508518#comment-14508518 ] Xiangrui Meng commented on SPARK-6529: -- Yes, we discussed this offline yesterday. I t

[jira] [Assigned] (SPARK-7070) LDA.setBeta calls itself

[ https://issues.apache.org/jira/browse/SPARK-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7070: --- Assignee: Apache Spark (was: Xiangrui Meng) > LDA.setBeta calls itself > ---

[jira] [Assigned] (SPARK-7070) LDA.setBeta calls itself

[ https://issues.apache.org/jira/browse/SPARK-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7070: --- Assignee: Xiangrui Meng (was: Apache Spark) > LDA.setBeta calls itself > ---

[jira] [Commented] (SPARK-7070) LDA.setBeta calls itself

[ https://issues.apache.org/jira/browse/SPARK-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508487#comment-14508487 ] Apache Spark commented on SPARK-7070: - User 'mengxr' has created a pull request for th

[jira] [Updated] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-7067: --- Description: In order to avoid breaking existing HiveQL queries, the current way we resolve column in

[jira] [Created] (SPARK-7070) LDA.setBeta calls itself

Xiangrui Meng created SPARK-7070: Summary: LDA.setBeta calls itself Key: SPARK-7070 URL: https://issues.apache.org/jira/browse/SPARK-7070 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-6612) Python KMeans parity

[ https://issues.apache.org/jira/browse/SPARK-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508477#comment-14508477 ] Apache Spark commented on SPARK-6612: - User 'FlytxtRnD' has created a pull request for

[jira] [Commented] (SPARK-7068) Remove PrimitiveType

[ https://issues.apache.org/jira/browse/SPARK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508471#comment-14508471 ] Apache Spark commented on SPARK-7068: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508473#comment-14508473 ] Kay Ousterhout commented on SPARK-5945: --- Good point -- that makes sense. I'm still

[jira] [Assigned] (SPARK-7068) Remove PrimitiveType

[ https://issues.apache.org/jira/browse/SPARK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7068: --- Assignee: Apache Spark (was: Reynold Xin) > Remove PrimitiveType > > >

[jira] [Updated] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-7067: --- Description: In order to avoid breaking existing HiveQL queries, the current way we resolve column in

[jira] [Assigned] (SPARK-7068) Remove PrimitiveType

[ https://issues.apache.org/jira/browse/SPARK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7068: --- Assignee: Reynold Xin (was: Apache Spark) > Remove PrimitiveType > > >

[jira] [Updated] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-7067: --- Description: In order to avoid breaking existing HiveQL queries, the current way we resolve column in

[jira] [Created] (SPARK-7069) Remove NativeType

Reynold Xin created SPARK-7069: -- Summary: Remove NativeType Key: SPARK-7069 URL: https://issues.apache.org/jira/browse/SPARK-7069 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-7068) Remove PrimitiveType

Reynold Xin created SPARK-7068: -- Summary: Remove PrimitiveType Key: SPARK-7068 URL: https://issues.apache.org/jira/browse/SPARK-7068 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-7067: --- Description: In order to avoid breaking existing HiveQL queries, the current way we resolve column in

[jira] [Created] (SPARK-7067) Can't resolve nested column in ORDER BY

Wenchen Fan created SPARK-7067: -- Summary: Can't resolve nested column in ORDER BY Key: SPARK-7067 URL: https://issues.apache.org/jira/browse/SPARK-7067 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508455#comment-14508455 ] Imran Rashid commented on SPARK-5945: - I think we want to do something more than just

[jira] [Resolved] (SPARK-7046) BlockResult shouldn't include an InputMetrics object (code cleanup)

[ https://issues.apache.org/jira/browse/SPARK-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-7046. --- Resolution: Fixed Fix Version/s: 1.4.0 > BlockResult shouldn't include an InputMetrics

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508445#comment-14508445 ] Qiping Li commented on SPARK-6932: -- The code of our prototype is at https://github.com/c

[jira] [Resolved] (SPARK-7066) VectorAssembler should use NumericType, not NativeType

[ https://issues.apache.org/jira/browse/SPARK-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7066. Resolution: Fixed Fix Version/s: 1.4.0 > VectorAssembler should use NumericType, not NativeTy

[jira] [Updated] (SPARK-7064) Adding binary sparse vector support

[ https://issues.apache.org/jira/browse/SPARK-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7064: --- Component/s: ML > Adding binary sparse vector support > --- >

[jira] [Updated] (SPARK-7065) Clear the cached locations mapping after every stage to avoid inconsistent status

[ https://issues.apache.org/jira/browse/SPARK-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7065: --- Component/s: Spark Core > Clear the cached locations mapping after every stage to avoid incons

[jira] [Commented] (SPARK-7065) Clear the cached locations mapping after every stage to avoid inconsistent status

[ https://issues.apache.org/jira/browse/SPARK-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508433#comment-14508433 ] Patrick Wendell commented on SPARK-7065: It would be helpful to have a bit more de

[jira] [Resolved] (SPARK-7062) Parquet compression does not work for Spark SQL loading

[ https://issues.apache.org/jira/browse/SPARK-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7062. Resolution: Duplicate > Parquet compression does not work for Spark SQL loading > --

[jira] [Updated] (SPARK-5517) Add input types for Java UDFs

[ https://issues.apache.org/jira/browse/SPARK-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5517: --- Parent Issue: SPARK-6116 (was: SPARK-5166) > Add input types for Java UDFs >

[jira] [Updated] (SPARK-4867) UDF clean up

[ https://issues.apache.org/jira/browse/SPARK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4867: --- Parent Issue: SPARK-6116 (was: SPARK-5166) > UDF clean up > > > Key: SPA

[jira] [Resolved] (SPARK-7054) Spark jobs hang for ~15 mins when a node goes down

[ https://issues.apache.org/jira/browse/SPARK-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7054. Resolution: Invalid Hey There, Please send this to the Spark users list to get feedback and

[jira] [Updated] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7063: --- Environment: IBM JDK > when lz4 compression is used, it causes core dump > ---

[jira] [Assigned] (SPARK-7056) Make the WriteAheadLog pluggable

[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7056: --- Assignee: Tathagata Das (was: Apache Spark) > Make the WriteAheadLog pluggable > ---

[jira] [Commented] (SPARK-7056) Make the WriteAheadLog pluggable

[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508360#comment-14508360 ] Apache Spark commented on SPARK-7056: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7056) Make the WriteAheadLog pluggable

[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7056: --- Assignee: Apache Spark (was: Tathagata Das) > Make the WriteAheadLog pluggable > ---

[jira] [Issue Comment Deleted] (SPARK-5295) Stabilize data types

[ https://issues.apache.org/jira/browse/SPARK-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5295: --- Comment: was deleted (was: User 'JaysonSunshine' has created a pull request for this issue: https://gi

[jira] [Updated] (SPARK-5295) Stabilize data types

[ https://issues.apache.org/jira/browse/SPARK-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5295: --- Parent Issue: SPARK-6116 (was: SPARK-5166) > Stabilize data types > > >

[jira] [Updated] (SPARK-5288) Stabilize Spark SQL data type API followup

[ https://issues.apache.org/jira/browse/SPARK-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5288: --- Parent Issue: SPARK-6116 (was: SPARK-5166) > Stabilize Spark SQL data type API followup > --

[jira] [Commented] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508345#comment-14508345 ] Apache Spark commented on SPARK-7026: - User 'adrian-wang' has created a pull request f

[jira] [Updated] (SPARK-7066) VectorAssembler should use NumericType, not NativeType

[ https://issues.apache.org/jira/browse/SPARK-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7066: --- Summary: VectorAssembler should use NumericType, not NativeType (was: VectorAssembler should use Nume

[jira] [Commented] (SPARK-7066) VectorAssembler should use NumericType and StringType, not NativeType

[ https://issues.apache.org/jira/browse/SPARK-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508340#comment-14508340 ] Apache Spark commented on SPARK-7066: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-7066) VectorAssembler should use NumericType and StringType, not NativeType

[ https://issues.apache.org/jira/browse/SPARK-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7066: --- Assignee: Reynold Xin (was: Apache Spark) > VectorAssembler should use NumericType and Strin

[jira] [Assigned] (SPARK-7066) VectorAssembler should use NumericType and StringType, not NativeType

[ https://issues.apache.org/jira/browse/SPARK-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7066: --- Assignee: Apache Spark (was: Reynold Xin) > VectorAssembler should use NumericType and Strin

[jira] [Created] (SPARK-7066) VectorAssembler should use NumericType and StringType, not NativeType

Reynold Xin created SPARK-7066: -- Summary: VectorAssembler should use NumericType and StringType, not NativeType Key: SPARK-7066 URL: https://issues.apache.org/jira/browse/SPARK-7066 Project: Spark

[jira] [Created] (SPARK-7065) Clear the cached locations mapping after every stage to avoid inconsistent status

Julien Pierre created SPARK-7065: Summary: Clear the cached locations mapping after every stage to avoid inconsistent status Key: SPARK-7065 URL: https://issues.apache.org/jira/browse/SPARK-7065 Proje

[jira] [Updated] (SPARK-7064) Adding binary sparse vector support

[ https://issues.apache.org/jira/browse/SPARK-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Pierre updated SPARK-7064: - Issue Type: Improvement (was: Bug) > Adding binary sparse vector support > --

[jira] [Created] (SPARK-7064) Adding binary sparse vector support

Julien Pierre created SPARK-7064: Summary: Adding binary sparse vector support Key: SPARK-7064 URL: https://issues.apache.org/jira/browse/SPARK-7064 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7063: --- Assignee: (was: Apache Spark) > when lz4 compression is used, it causes core dump > -

[jira] [Commented] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508323#comment-14508323 ] Apache Spark commented on SPARK-7063: - User 'linlin200605' has created a pull request

[jira] [Assigned] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7063: --- Assignee: Apache Spark > when lz4 compression is used, it causes core dump >

[jira] [Comment Edited] (SPARK-6967) Internal DateType not handled correctly in caching

[ https://issues.apache.org/jira/browse/SPARK-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499574#comment-14499574 ] Reynold Xin edited comment on SPARK-6967 at 4/23/15 2:19 AM: -

[jira] [Resolved] (SPARK-6967) Internal DateType not handled correctly in caching

[ https://issues.apache.org/jira/browse/SPARK-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6967. Resolution: Fixed Fix Version/s: 1.4.0 1.3.2 > Internal DateType not handl

[jira] [Commented] (SPARK-6891) ExecutorAllocationManager will request negative number executors

[ https://issues.apache.org/jira/browse/SPARK-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508308#comment-14508308 ] meiyoula commented on SPARK-6891: - I test the master branch of github. I think you can run

[jira] [Comment Edited] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508302#comment-14508302 ] Fei Wang edited comment on SPARK-5659 at 4/23/15 2:03 AM: -- my loc

[jira] [Comment Edited] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508302#comment-14508302 ] Fei Wang edited comment on SPARK-5659 at 4/23/15 2:02 AM: -- my loc

[jira] [Comment Edited] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508302#comment-14508302 ] Fei Wang edited comment on SPARK-5659 at 4/23/15 2:01 AM: -- my loc

[jira] [Commented] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508302#comment-14508302 ] Fei Wang commented on SPARK-5659: - my locally test with dev/run-tests also go into this is

[jira] [Commented] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508299#comment-14508299 ] Jenny MA commented on SPARK-7063: - will send out a pull request shortly. > when lz4 comp

[jira] [Commented] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508297#comment-14508297 ] Jenny MA commented on SPARK-7063: - we should bump the version to net.jpountz.lz4.lz4-1.3.0

[jira] [Created] (SPARK-7063) when lz4 compression is used, it causes core dump

Jenny MA created SPARK-7063: --- Summary: when lz4 compression is used, it causes core dump Key: SPARK-7063 URL: https://issues.apache.org/jira/browse/SPARK-7063 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6290) spark.ml.param.Params.checkInputColumn bug upon error

[ https://issues.apache.org/jira/browse/SPARK-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508278#comment-14508278 ] Joseph K. Bradley commented on SPARK-6290: -- There should be a complaint from with

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508271#comment-14508271 ] Zhichao Zhang commented on SPARK-5206: --- [~tdas], thanks for your reply. Looking for

[jira] [Commented] (SPARK-6378) srcAttr in graph.triplets don't update when the size of graph is huge

[ https://issues.apache.org/jira/browse/SPARK-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508262#comment-14508262 ] Liang-Chi Hsieh commented on SPARK-6378: After checking the codes, looks like that

[jira] [Created] (SPARK-7062) Parquet compression does not work for Spark SQL loading

Yi Yao created SPARK-7062: - Summary: Parquet compression does not work for Spark SQL loading Key: SPARK-7062 URL: https://issues.apache.org/jira/browse/SPARK-7062 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6290) spark.ml.param.Params.checkInputColumn bug upon error

[ https://issues.apache.org/jira/browse/SPARK-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508246#comment-14508246 ] Glenn Weidner commented on SPARK-6290: -- I would like to work on this. In a test scen

[jira] [Updated] (SPARK-6917) Broken data returned to PySpark dataframe if any large numbers used in Scala land

[ https://issues.apache.org/jira/browse/SPARK-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harry Brundage updated SPARK-6917: -- Description: When trying to access data stored in a Parquet file with an INT96 column (read: Ti

[jira] [Comment Edited] (SPARK-7056) Make the WriteAheadLog pluggable

[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507057#comment-14507057 ] Tathagata Das edited comment on SPARK-7056 at 4/23/15 12:44 AM:

[jira] [Updated] (SPARK-7056) Make the WriteAheadLog pluggable

[ https://issues.apache.org/jira/browse/SPARK-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7056: - Description: Users may want the WAL data to be written to non-HDFS data storage systems. To allow

[jira] [Updated] (SPARK-6827) Wrap FPGrowthModel.freqItemsets with namedtuples (or document the return type) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6827: - Fix Version/s: (was: 1.6.0) 1.4.0 > Wrap FPGrowthModel.freqItemsets with na

[jira] [Resolved] (SPARK-6827) Wrap FPGrowthModel.freqItemsets with namedtuples (or document the return type) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6827. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 5614 [https://githu

[jira] [Commented] (SPARK-7061) Case Classes Cannot be Repartitioned/Shuffled in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508170#comment-14508170 ] Russell Alexander Spitzer commented on SPARK-7061: -- Thanks! I didn't see

[jira] [Commented] (SPARK-7053) KafkaUtils.createStream leaks resources

[ https://issues.apache.org/jira/browse/SPARK-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508153#comment-14508153 ] Sean Owen commented on SPARK-7053: -- Fair point, that's hard to explain if you definitely

[jira] [Resolved] (SPARK-7061) Case Classes Cannot be Repartitioned/Shuffled in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7061. -- Resolution: Duplicate Search JIRA first if you please. I think you're just hitting something already re

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508091#comment-14508091 ] Kay Ousterhout commented on SPARK-5945: --- I realized there might be a cleaner solutio

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508041#comment-14508041 ] Imran Rashid commented on SPARK-5945: - good point about moving the design discussion t

[jira] [Resolved] (SPARK-7059) Create a DataFrame join API to facilitate equijoin and self join

[ https://issues.apache.org/jira/browse/SPARK-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7059. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5638 [https:/

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508022#comment-14508022 ] Kay Ousterhout commented on SPARK-5945: --- When there's a fetch failed exception, what

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508019#comment-14508019 ] Ilya Ganelin commented on SPARK-5945: - [~kayousterhout] - thanks for the review. If I

[jira] [Updated] (SPARK-7061) Case Classes Cannot be Repartitioned/Shuffled in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Alexander Spitzer updated SPARK-7061: - Description: Running the following code in the spark shell against a stan

[jira] [Created] (SPARK-7061) Case Classes Cannot be Repartitioned/Shuffled in Spark REPL

Russell Alexander Spitzer created SPARK-7061: Summary: Case Classes Cannot be Repartitioned/Shuffled in Spark REPL Key: SPARK-7061 URL: https://issues.apache.org/jira/browse/SPARK-7061 Pro

[jira] [Commented] (SPARK-6980) Akka timeout exceptions indicate which conf controls them

[ https://issues.apache.org/jira/browse/SPARK-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507968#comment-14507968 ] Harsh Gupta commented on SPARK-6980: Havent been successful in reproducing as yet . Wi

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507957#comment-14507957 ] Kay Ousterhout commented on SPARK-5945: --- Commenting here rather than on the github f

[jira] [Commented] (SPARK-6891) ExecutorAllocationManager will request negative number executors

[ https://issues.apache.org/jira/browse/SPARK-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507886#comment-14507886 ] Ilya Ganelin commented on SPARK-6891: - [~meiyoula] I'm running Spark 1.3 (from the rel

[jira] [Comment Edited] (SPARK-6891) ExecutorAllocationManager will request negative number executors

[ https://issues.apache.org/jira/browse/SPARK-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507886#comment-14507886 ] Ilya Ganelin edited comment on SPARK-6891 at 4/22/15 8:59 PM: --

[jira] [Commented] (SPARK-7053) KafkaUtils.createStream leaks resources

[ https://issues.apache.org/jira/browse/SPARK-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507857#comment-14507857 ] Platon Potapov commented on SPARK-7053: --- "why you're certain this doesn't take more

[jira] [Assigned] (SPARK-7059) Create a DataFrame join API to facilitate equijoin and self join

[ https://issues.apache.org/jira/browse/SPARK-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7059: --- Assignee: Apache Spark > Create a DataFrame join API to facilitate equijoin and self join > -

[jira] [Assigned] (SPARK-7059) Create a DataFrame join API to facilitate equijoin and self join

[ https://issues.apache.org/jira/browse/SPARK-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7059: --- Assignee: (was: Apache Spark) > Create a DataFrame join API to facilitate equijoin and se

[jira] [Commented] (SPARK-7059) Create a DataFrame join API to facilitate equijoin and self join

[ https://issues.apache.org/jira/browse/SPARK-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507838#comment-14507838 ] Apache Spark commented on SPARK-7059: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-7059) Create a DataFrame join API to facilitate equijoin and self join

[ https://issues.apache.org/jira/browse/SPARK-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7059: --- Summary: Create a DataFrame join API to facilitate equijoin and self join (was: Create a join API to

[jira] [Commented] (SPARK-4865) Include temporary tables in SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507833#comment-14507833 ] Michael Armbrust commented on SPARK-4865: - The fix version on the issue is set to

[jira] [Commented] (SPARK-7053) KafkaUtils.createStream leaks resources

[ https://issues.apache.org/jira/browse/SPARK-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507834#comment-14507834 ] Sean Owen commented on SPARK-7053: -- No it's simpler than that - I'm wondering why you're

  1   2   3   >