[jira] [Created] (SPARK-24181) Better error message for writing sorted data

DB Tsai created SPARK-24181: --- Summary: Better error message for writing sorted data Key: SPARK-24181 URL: https://issues.apache.org/jira/browse/SPARK-24181 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-24181) Better error message for writing sorted data

[ https://issues.apache.org/jira/browse/SPARK-24181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-24181: --- Assignee: DB Tsai > Better error message for writing sorted data >

[jira] [Updated] (SPARK-23775) Flaky test: DataFrameRangeSuite

[ https://issues.apache.org/jira/browse/SPARK-23775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23775: -- Description: DataFrameRangeSuite.test("Cancelling stage in a query with Range.") stays

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464153#comment-16464153 ] Albert Chan commented on SPARK-23780: - Thanks Ivan.  I'll give it a try. > Failed to use googleVis

[jira] [Updated] (SPARK-24179) History Server for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-24179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-24179: --- Issue Type: New Feature (was: Task) > History Server for Kubernetes >

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464262#comment-16464262 ] Apache Spark commented on SPARK-23935: -- User 'mn-mikke' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23935: Assignee: Apache Spark > High-order function: map_entries(map) → array> >

[jira] [Assigned] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23935: Assignee: (was: Apache Spark) > High-order function: map_entries(map) →

[jira] [Commented] (SPARK-23936) High-order function: map_concat(map1<K, V>, map2<K, V>, ..., mapN<K, V>) → map<K,V>

[ https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464245#comment-16464245 ] Bruce Robbins commented on SPARK-23936: --- [~ueshin] I have a question about map_concat's behavior

[jira] [Commented] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464141#comment-16464141 ] Marcelo Vanzin commented on SPARK-23020: If that still fails somewhere it means there is still a

[jira] [Commented] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464088#comment-16464088 ] Dongjoon Hyun commented on SPARK-23020: --- Hi, All. This seems to fail again in branch 2.3. Can we

[jira] [Assigned] (SPARK-24181) Better error message for writing sorted data

[ https://issues.apache.org/jira/browse/SPARK-24181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24181: Assignee: Apache Spark (was: DB Tsai) > Better error message for writing sorted data >

[jira] [Assigned] (SPARK-24181) Better error message for writing sorted data

[ https://issues.apache.org/jira/browse/SPARK-24181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24181: Assignee: DB Tsai (was: Apache Spark) > Better error message for writing sorted data >

[jira] [Commented] (SPARK-24181) Better error message for writing sorted data

[ https://issues.apache.org/jira/browse/SPARK-24181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464231#comment-16464231 ] Apache Spark commented on SPARK-24181: -- User 'dbtsai' has created a pull request for this issue:

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464553#comment-16464553 ] William Shen commented on SPARK-5928: - [~UZiVcbfPXaNrMtT], if you increase parallelism (having more

[jira] [Commented] (SPARK-15384) Codegen CompileException "mapelements_isNull" is not an rvalue

[ https://issues.apache.org/jira/browse/SPARK-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464581#comment-16464581 ] howie yu commented on SPARK-15384: -- Hi I have similar error at spark 2.3.0

[jira] [Created] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

bharath kumar avusherla created SPARK-24189: --- Summary: Spark Strcutured Streaming not working with the Kafka Transactions Key: SPARK-24189 URL: https://issues.apache.org/jira/browse/SPARK-24189

[jira] [Commented] (SPARK-24186) add array reverse and concat

[ https://issues.apache.org/jira/browse/SPARK-24186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464508#comment-16464508 ] Huaxin Gao commented on SPARK-24186: I will work on this. Thanks! > add array reverse and concat >

[jira] [Created] (SPARK-24187) add array join

Huaxin Gao created SPARK-24187: -- Summary: add array join Key: SPARK-24187 URL: https://issues.apache.org/jira/browse/SPARK-24187 Project: Spark Issue Type: Sub-task Components: SparkR

[jira] [Commented] (SPARK-24188) /api/v1/version not working

[ https://issues.apache.org/jira/browse/SPARK-24188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464536#comment-16464536 ] Apache Spark commented on SPARK-24188: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24188) /api/v1/version not working

[ https://issues.apache.org/jira/browse/SPARK-24188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24188: Assignee: (was: Apache Spark) > /api/v1/version not working >

[jira] [Assigned] (SPARK-24188) /api/v1/version not working

[ https://issues.apache.org/jira/browse/SPARK-24188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24188: Assignee: Apache Spark > /api/v1/version not working > --- > >

[jira] [Commented] (SPARK-24182) Improve error message for client mode when AM fails

[ https://issues.apache.org/jira/browse/SPARK-24182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464490#comment-16464490 ] Apache Spark commented on SPARK-24182: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24182) Improve error message for client mode when AM fails

[ https://issues.apache.org/jira/browse/SPARK-24182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24182: Assignee: Apache Spark > Improve error message for client mode when AM fails >

[jira] [Assigned] (SPARK-24182) Improve error message for client mode when AM fails

[ https://issues.apache.org/jira/browse/SPARK-24182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24182: Assignee: (was: Apache Spark) > Improve error message for client mode when AM fails >

[jira] [Resolved] (SPARK-24157) Enable no-data micro batches for streaming aggregation and deduplication

[ https://issues.apache.org/jira/browse/SPARK-24157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-24157. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21220

[jira] [Commented] (SPARK-24187) add array join

[ https://issues.apache.org/jira/browse/SPARK-24187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464511#comment-16464511 ] Huaxin Gao commented on SPARK-24187: I will work on this. Thanks! > add array join > --

[jira] [Resolved] (SPARK-7924) Consolidate example code in MLlib

[ https://issues.apache.org/jira/browse/SPARK-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7924. -- Resolution: Done > Consolidate example code in MLlib > - > >

[jira] [Assigned] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-18924: - Assignee: (was: Xiangrui Meng) > Improve collect/createDataFrame performance in

[jira] [Resolved] (SPARK-10383) Sync example code between API doc and user guide

[ https://issues.apache.org/jira/browse/SPARK-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10383. --- Resolution: Won't Do Target Version/s: (was: ) > Sync example code between API

[jira] [Created] (SPARK-24185) add flatten function

Huaxin Gao created SPARK-24185: -- Summary: add flatten function Key: SPARK-24185 URL: https://issues.apache.org/jira/browse/SPARK-24185 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-24185) add flatten function

[ https://issues.apache.org/jira/browse/SPARK-24185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464506#comment-16464506 ] Huaxin Gao commented on SPARK-24185: I will submit a PR soon. > add flatten function >

[jira] [Resolved] (SPARK-12285) MLlib user guide: umbrella for missing sections

[ https://issues.apache.org/jira/browse/SPARK-12285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12285. --- Resolution: Done > MLlib user guide: umbrella for missing sections >

[jira] [Resolved] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5874. -- Resolution: Done > How to improve the current ML pipeline API? >

[jira] [Created] (SPARK-24184) Allow escape comma in spark files

holdenk created SPARK-24184: --- Summary: Allow escape comma in spark files Key: SPARK-24184 URL: https://issues.apache.org/jira/browse/SPARK-24184 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-24186) add array reverse and concat

Huaxin Gao created SPARK-24186: -- Summary: add array reverse and concat Key: SPARK-24186 URL: https://issues.apache.org/jira/browse/SPARK-24186 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-24188) /api/v1/version not working

Marcelo Vanzin created SPARK-24188: -- Summary: /api/v1/version not working Key: SPARK-24188 URL: https://issues.apache.org/jira/browse/SPARK-24188 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly

[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24124. Resolution: Fixed Assignee: Thomas Graves Fix Version/s: 2.4.0 > Spark

[jira] [Commented] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464391#comment-16464391 ] Yanbo Liang commented on SPARK-23291: - This should be backported to Spark 2.3, as this is a bug fix

[jira] [Assigned] (SPARK-24137) [K8s] Mount temporary directories in emptydir volumes

[ https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24137: Assignee: Apache Spark > [K8s] Mount temporary directories in emptydir volumes >

[jira] [Assigned] (SPARK-24137) [K8s] Mount temporary directories in emptydir volumes

[ https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24137: Assignee: (was: Apache Spark) > [K8s] Mount temporary directories in emptydir volumes

[jira] [Commented] (SPARK-24137) [K8s] Mount temporary directories in emptydir volumes

[ https://issues.apache.org/jira/browse/SPARK-24137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464429#comment-16464429 ] Apache Spark commented on SPARK-24137: -- User 'mccheah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24135: Assignee: Apache Spark > [K8s] Executors that fail to start up because of init-container

[jira] [Commented] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464455#comment-16464455 ] Apache Spark commented on SPARK-24135: -- User 'mccheah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24135: Assignee: (was: Apache Spark) > [K8s] Executors that fail to start up because of

[jira] [Resolved] (SPARK-24039) remove restarting iterators hack

[ https://issues.apache.org/jira/browse/SPARK-24039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-24039. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21200

[jira] [Commented] (SPARK-23325) DataSourceV2 readers should always produce InternalRow.

[ https://issues.apache.org/jira/browse/SPARK-23325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464284#comment-16464284 ] Apache Spark commented on SPARK-23325: -- User 'rdblue' has created a pull request for this issue:

[jira] [Created] (SPARK-24183) add unit tests for ContinuousDataReader hook

Jose Torres created SPARK-24183: --- Summary: add unit tests for ContinuousDataReader hook Key: SPARK-24183 URL: https://issues.apache.org/jira/browse/SPARK-24183 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-24039) remove restarting iterators hack

[ https://issues.apache.org/jira/browse/SPARK-24039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-24039: - Assignee: Jose Torres > remove restarting iterators hack >

[jira] [Assigned] (SPARK-23657) Document InternalRow and expose it as a stable interface

[ https://issues.apache.org/jira/browse/SPARK-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23657: Assignee: (was: Apache Spark) > Document InternalRow and expose it as a stable

[jira] [Commented] (SPARK-23657) Document InternalRow and expose it as a stable interface

[ https://issues.apache.org/jira/browse/SPARK-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464477#comment-16464477 ] Apache Spark commented on SPARK-23657: -- User 'rdblue' has created a pull request for this issue:

[jira] [Created] (SPARK-24182) Improve error message for client mode when AM fails

Marcelo Vanzin created SPARK-24182: -- Summary: Improve error message for client mode when AM fails Key: SPARK-24182 URL: https://issues.apache.org/jira/browse/SPARK-24182 Project: Spark

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464448#comment-16464448 ] Apache Spark commented on SPARK-21274: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-24040) support single partition aggregates

[ https://issues.apache.org/jira/browse/SPARK-24040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24040: Assignee: (was: Apache Spark) > support single partition aggregates >

[jira] [Assigned] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21274: Assignee: (was: Apache Spark) > Implement EXCEPT ALL and INTERSECT ALL >

[jira] [Assigned] (SPARK-24040) support single partition aggregates

[ https://issues.apache.org/jira/browse/SPARK-24040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24040: Assignee: Apache Spark > support single partition aggregates >

[jira] [Assigned] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21274: Assignee: Apache Spark > Implement EXCEPT ALL and INTERSECT ALL >

[jira] [Commented] (SPARK-24040) support single partition aggregates

[ https://issues.apache.org/jira/browse/SPARK-24040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464449#comment-16464449 ] Apache Spark commented on SPARK-24040: -- User 'jose-torres' has created a pull request for this

[jira] [Commented] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464467#comment-16464467 ] Matt Cheah commented on SPARK-24135: Put up the PR< see above - created a separate setting for this

[jira] [Assigned] (SPARK-23657) Document InternalRow and expose it as a stable interface

[ https://issues.apache.org/jira/browse/SPARK-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23657: Assignee: Apache Spark > Document InternalRow and expose it as a stable interface >

[jira] [Assigned] (SPARK-24136) MemoryStreamDataReader.next should skip sleeping if record is available

[ https://issues.apache.org/jira/browse/SPARK-24136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24136: --- Assignee: Arun Mahadevan > MemoryStreamDataReader.next should skip sleeping if record is

[jira] [Deleted] (SPARK-24178) Upgrade spark's py4j to 0.10.7

[ https://issues.apache.org/jira/browse/SPARK-24178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-24178: - > Upgrade spark's py4j to 0.10.7 > -- > > Key:

[jira] [Created] (SPARK-24179) History Server for Kubernetes

Eric Charles created SPARK-24179: Summary: History Server for Kubernetes Key: SPARK-24179 URL: https://issues.apache.org/jira/browse/SPARK-24179 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-24088) only HadoopRDD leverage HDFS Cache as preferred location

[ https://issues.apache.org/jira/browse/SPARK-24088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463653#comment-16463653 ] Marco Gaido commented on SPARK-24088: - [~xiaojuwu] I don't understand which problem is stated here.

[jira] [Commented] (SPARK-24174) Expose Hadoop config as part of /environment API

[ https://issues.apache.org/jira/browse/SPARK-24174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463575#comment-16463575 ] Saisai Shao commented on SPARK-24174: - I believe Hadoop web UI already expose such configurations. It

[jira] [Assigned] (SPARK-24178) Upgrade spark's py4j to 0.10.7

[ https://issues.apache.org/jira/browse/SPARK-24178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24178: Assignee: (was: Apache Spark) > Upgrade spark's py4j to 0.10.7 >

[jira] [Commented] (SPARK-24178) Upgrade spark's py4j to 0.10.7

[ https://issues.apache.org/jira/browse/SPARK-24178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463535#comment-16463535 ] Apache Spark commented on SPARK-24178: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-24178) Upgrade spark's py4j to 0.10.7

[ https://issues.apache.org/jira/browse/SPARK-24178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24178: Assignee: Apache Spark > Upgrade spark's py4j to 0.10.7 > --

[jira] [Commented] (SPARK-24177) Spark returning inconsistent rows and data in a join query when run using Spark SQL (using SQLContext.sql(...))

[ https://issues.apache.org/jira/browse/SPARK-24177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463616#comment-16463616 ] Marco Gaido commented on SPARK-24177: - [~ajay_monga] please may you try with a higher spark version?

[jira] [Updated] (SPARK-24177) Spark returning inconsistent rows and data in a join query when run using Spark SQL (using SQLContext.sql(...))

[ https://issues.apache.org/jira/browse/SPARK-24177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Monga updated SPARK-24177: --- Description: Spark SQL is returning inconsistent result for a JOIN query. It returns different rows

[jira] [Created] (SPARK-24180) Using another dynamodb endpoint for kinesis

JEAN-SEBASTIEN NEY created SPARK-24180: -- Summary: Using another dynamodb endpoint for kinesis Key: SPARK-24180 URL: https://issues.apache.org/jira/browse/SPARK-24180 Project: Spark

[jira] [Assigned] (SPARK-23697) Accumulators of Spark 1.x no longer work with Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-23697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23697: --- Assignee: Wenchen Fan > Accumulators of Spark 1.x no longer work with Spark 2.x >

[jira] [Resolved] (SPARK-23697) Accumulators of Spark 1.x no longer work with Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-23697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23697. - Resolution: Fixed Fix Version/s: 2.3.1 2.1.3 2.4.0

[jira] [Resolved] (SPARK-24136) MemoryStreamDataReader.next should skip sleeping if record is available

[ https://issues.apache.org/jira/browse/SPARK-24136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-24136. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21207

[jira] [Commented] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly

[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463934#comment-16463934 ] Apache Spark commented on SPARK-24124: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly

[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24124: Assignee: (was: Apache Spark) > Spark history server should create

[jira] [Assigned] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly

[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24124: Assignee: Apache Spark > Spark history server should create spark.history.store.path and

[jira] [Created] (SPARK-24177) Spark returning inconsistent rows and data in a join query when run using Spark SQL (using SQLContext.sql(...))

Ajay Monga created SPARK-24177: -- Summary: Spark returning inconsistent rows and data in a join query when run using Spark SQL (using SQLContext.sql(...)) Key: SPARK-24177 URL:

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463487#comment-16463487 ] Albert Chan commented on SPARK-23780: - I have the same issue.  I trying Spark 2.3.0.  I tried

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463514#comment-16463514 ] Ivan Dzikovsky commented on SPARK-23780: [~achan] You can still use googleVis with Spark 2.3. To

[jira] [Commented] (SPARK-24177) Spark returning inconsistent rows and data in a join query when run using Spark SQL (using SQLContext.sql(...))

[ https://issues.apache.org/jira/browse/SPARK-24177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463494#comment-16463494 ] Ajay Monga commented on SPARK-24177: The suspicion has been strengthened by the fact that when the

[jira] [Created] (SPARK-24178) Upgrade spark's py4j to 0.10.7

Hyukjin Kwon created SPARK-24178: Summary: Upgrade spark's py4j to 0.10.7 Key: SPARK-24178 URL: https://issues.apache.org/jira/browse/SPARK-24178 Project: Spark Issue Type: Bug