[jira] [Created] (SPARK-27708) Add documentation for v2 data sources

Ryan Blue created SPARK-27708: - Summary: Add documentation for v2 data sources Key: SPARK-27708 URL: https://issues.apache.org/jira/browse/SPARK-27708 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-27703) kubernetes jobs are failing with Unsatisfiedlink error

[ https://issues.apache.org/jira/browse/SPARK-27703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal resolved SPARK-27703. Resolution: Duplicate > kubernetes jobs are failing with Unsatisfiedlink error >

[jira] [Updated] (SPARK-27709) AppStatusListener.cleanupExecutors should remove dead executors in an ordering that makes sense, not a random order

[ https://issues.apache.org/jira/browse/SPARK-27709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-27709: --- Description: When AppStatusListener removes dead executors in excess of

[jira] [Updated] (SPARK-27709) AppStatusListener.cleanupExecutors should remove dead executors in an ordering that makes sense, not a random order

[ https://issues.apache.org/jira/browse/SPARK-27709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-27709: --- Description: When AppStatusListener removes dead executors in excess of

[jira] [Created] (SPARK-27709) AppStatusListener.cleanupExecutors should remove dead executors in an ordering that makes sense, not a random order

Josh Rosen created SPARK-27709: -- Summary: AppStatusListener.cleanupExecutors should remove dead executors in an ordering that makes sense, not a random order Key: SPARK-27709 URL:

[jira] [Assigned] (SPARK-27711) InputFileBlockHolder should be unset at the end of tasks

[ https://issues.apache.org/jira/browse/SPARK-27711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27711: Assignee: Apache Spark > InputFileBlockHolder should be unset at the end of tasks >

[jira] [Assigned] (SPARK-27711) InputFileBlockHolder should be unset at the end of tasks

[ https://issues.apache.org/jira/browse/SPARK-27711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27711: Assignee: (was: Apache Spark) > InputFileBlockHolder should be unset at the end of

[jira] [Created] (SPARK-27711) InputFileBlockHolder should be unset at the end of tasks

Jose Torres created SPARK-27711: --- Summary: InputFileBlockHolder should be unset at the end of tasks Key: SPARK-27711 URL: https://issues.apache.org/jira/browse/SPARK-27711 Project: Spark Issue

[jira] [Commented] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839752#comment-16839752 ] Hieu Tri Huynh commented on SPARK-2387: --- [~lirui], [~sandyr], [~lianhuiwang], [~xuefuz],

[jira] [Commented] (SPARK-27671) Fix error when casting from a nested null in a struct

[ https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839609#comment-16839609 ] Dongjoon Hyun commented on SPARK-27671: --- Thanks, [~viirya]. For now, it looks okay to me. > Fix

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839674#comment-16839674 ] Marcelo Vanzin commented on SPARK-27681: bq. 2043 in method parameters, 1488 in method return

[jira] [Created] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

Josh Rosen created SPARK-27710: -- Summary: ClassNotFoundException: $line196400984558.$read$ in OuterScopes Key: SPARK-27710 URL: https://issues.apache.org/jira/browse/SPARK-27710 Project: Spark

[jira] [Commented] (SPARK-27689) Error to execute hive views with spark

[ https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839114#comment-16839114 ] Yuming Wang commented on SPARK-27689: - I can't reproduce it after translate to SQL, [~lambda] please

[jira] [Updated] (SPARK-27696) kubernetes driver pod not deleted after finish.

[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27696: - Description: When submit to k8s, driver pod not deleted after job completion.  While k8s checks driver

[jira] [Updated] (SPARK-6743) Join with empty projection on one side produces invalid results

[ https://issues.apache.org/jira/browse/SPARK-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6743: -- Labels: correctness (was: ) > Join with empty projection on one side produces invalid results >

[jira] [Commented] (SPARK-27689) Error to execute hive views with spark

[ https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839170#comment-16839170 ] Juan Antonio commented on SPARK-27689: -- Thanks Yuming Wang. First of all, I have executed the Sql

[jira] [Created] (SPARK-27698) Add new method for getting pushed down filters in Parquet file reader

Gengliang Wang created SPARK-27698: -- Summary: Add new method for getting pushed down filters in Parquet file reader Key: SPARK-27698 URL: https://issues.apache.org/jira/browse/SPARK-27698 Project:

[jira] [Updated] (SPARK-20356) Spark sql group by returns incorrect results after join + distinct transformations

[ https://issues.apache.org/jira/browse/SPARK-20356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-20356: --- Labels: correctness (was: ) > Spark sql group by returns incorrect results after join + distinct

[jira] [Updated] (SPARK-19017) NOT IN subquery with more than one column may return incorrect results

[ https://issues.apache.org/jira/browse/SPARK-19017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-19017: --- Labels: correctness (was: ) > NOT IN subquery with more than one column may return incorrect

[jira] [Updated] (SPARK-27696) kubernetes driver pod not deleted after finish.

[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27696: - Priority: Minor (was: Major) > kubernetes driver pod not deleted after finish. >

[jira] [Updated] (SPARK-18578) Full outer join in correlated subquery returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-18578: --- Labels: correctness (was: ) > Full outer join in correlated subquery returns incorrect results >

[jira] [Updated] (SPARK-27697) KubernetesClientApplication alway exit with 0

[ https://issues.apache.org/jira/browse/SPARK-27697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27697: - Priority: Minor (was: Major) > KubernetesClientApplication alway exit with 0 >

[jira] [Updated] (SPARK-18504) Scalar subquery with extra group by columns returning incorrect result

[ https://issues.apache.org/jira/browse/SPARK-18504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-18504: --- Labels: correctness (was: ) > Scalar subquery with extra group by columns returning incorrect

[jira] [Updated] (SPARK-18473) Correctness issue in INNER join result with window functions

[ https://issues.apache.org/jira/browse/SPARK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-18473: --- Labels: correctness (was: ) > Correctness issue in INNER join result with window functions >

[jira] [Updated] (SPARK-27698) Add new method for getting pushed down filters in Parquet file reader

[ https://issues.apache.org/jira/browse/SPARK-27698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-27698: --- Description: To return accurate pushed filters in Parquet file

[jira] [Created] (SPARK-27696) kubernetes driver pod not deleted after finish.

Henry Yu created SPARK-27696: Summary: kubernetes driver pod not deleted after finish. Key: SPARK-27696 URL: https://issues.apache.org/jira/browse/SPARK-27696 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-27697) KubernetesClientApplication alway exit with 0

Henry Yu created SPARK-27697: Summary: KubernetesClientApplication alway exit with 0 Key: SPARK-27697 URL: https://issues.apache.org/jira/browse/SPARK-27697 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-27698) Add new method for getting pushed down filters in Parquet file reader

[ https://issues.apache.org/jira/browse/SPARK-27698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27698: Assignee: (was: Apache Spark) > Add new method for getting pushed down filters in

[jira] [Assigned] (SPARK-27698) Add new method for getting pushed down filters in Parquet file reader

[ https://issues.apache.org/jira/browse/SPARK-27698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27698: Assignee: Apache Spark > Add new method for getting pushed down filters in Parquet file

[jira] [Commented] (SPARK-26278) V2 Streaming sources cannot be written to V1 sinks

[ https://issues.apache.org/jira/browse/SPARK-26278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839246#comment-16839246 ] Genmao Yu commented on SPARK-26278: --- [~jpolchlo] Could you please close this jira? This issue has been

[jira] [Commented] (SPARK-15463) Support for creating a dataframe from CSV in Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840018#comment-16840018 ] Ruslan Dautkhanov commented on SPARK-15463: --- [~hyukjin.kwon] would it be possible to make

[jira] [Resolved] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations

[ https://issues.apache.org/jira/browse/SPARK-24923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24923. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24570

[jira] [Created] (SPARK-27713) Move RecordBinaryComparator and unsafe sorters from catalyst project to core

Xianyin Xin created SPARK-27713: --- Summary: Move RecordBinaryComparator and unsafe sorters from catalyst project to core Key: SPARK-27713 URL: https://issues.apache.org/jira/browse/SPARK-27713 Project:

[jira] [Updated] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-27710: --- Issue Type: Bug (was: Improvement) > ClassNotFoundException: $line196400984558.$read$ in

[jira] [Updated] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-27714: Description: Now the join reorder logic is based on dynamic planning which can find the most

[jira] [Commented] (SPARK-27713) Move RecordBinaryComparator and unsafe sorters from catalyst project to core

[ https://issues.apache.org/jira/browse/SPARK-27713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839934#comment-16839934 ] Apache Spark commented on SPARK-27713: -- User 'xianyinxin' has created a pull request for this

[jira] [Assigned] (SPARK-27713) Move RecordBinaryComparator and unsafe sorters from catalyst project to core

[ https://issues.apache.org/jira/browse/SPARK-27713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27713: Assignee: (was: Apache Spark) > Move RecordBinaryComparator and unsafe sorters from

[jira] [Assigned] (SPARK-27713) Move RecordBinaryComparator and unsafe sorters from catalyst project to core

[ https://issues.apache.org/jira/browse/SPARK-27713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27713: Assignee: Apache Spark > Move RecordBinaryComparator and unsafe sorters from catalyst

[jira] [Commented] (SPARK-27684) Reduce ScalaUDF conversion overheads for primitives

[ https://issues.apache.org/jira/browse/SPARK-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839968#comment-16839968 ] Josh Rosen commented on SPARK-27684: I'm not planning to work on this right now, so this ticket is

[jira] [Created] (SPARK-27714) Support Join Reorder based on Genetic algorithm when the # of joined tables > 12

Xianyin Xin created SPARK-27714: --- Summary: Support Join Reorder based on Genetic algorithm when the # of joined tables > 12 Key: SPARK-27714 URL: https://issues.apache.org/jira/browse/SPARK-27714

[jira] [Updated] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-27714: Summary: Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12 (was:

[jira] [Comment Edited] (SPARK-23191) Workers registration failes in case of network drop

[ https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835256#comment-16835256 ] zuotingbing edited comment on SPARK-23191 at 5/15/19 3:07 AM: -- See these

[jira] [Updated] (SPARK-27712) createDataFrame() reorders row

[ https://issues.apache.org/jira/browse/SPARK-27712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-27712: --- Labels: correctness (was: ) > createDataFrame() reorders row > -- > >

[jira] [Assigned] (SPARK-24923) DataSourceV2: Add CTAS and RTAS logical operations

[ https://issues.apache.org/jira/browse/SPARK-24923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24923: --- Assignee: Ryan Blue > DataSourceV2: Add CTAS and RTAS logical operations >

[jira] [Updated] (SPARK-27708) Add documentation for v2 data sources

[ https://issues.apache.org/jira/browse/SPARK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-27708: Labels: documentation (was: docuentation) > Add documentation for v2 data sources >

[jira] [Commented] (SPARK-27339) Decimal up cast to higher scale fails while reading parquet to Dataset

[ https://issues.apache.org/jira/browse/SPARK-27339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839798#comment-16839798 ] Bill Schneider commented on SPARK-27339: Also noting that this is only an issue in cases where

[jira] [Commented] (SPARK-27708) Add documentation for v2 data sources

[ https://issues.apache.org/jira/browse/SPARK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839846#comment-16839846 ] Jacek Laskowski commented on SPARK-27708: - What's really needed? I've been reviewing the code of

[jira] [Created] (SPARK-27712) createDataFrame() reorders row

Tim Ludwinski created SPARK-27712: - Summary: createDataFrame() reorders row Key: SPARK-27712 URL: https://issues.apache.org/jira/browse/SPARK-27712 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27036) Even Broadcast thread is timed out, BroadCast Job is not aborted.

[ https://issues.apache.org/jira/browse/SPARK-27036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839848#comment-16839848 ] Apache Spark commented on SPARK-27036: -- User 'jiangxb1987' has created a pull request for this

[jira] [Comment Edited] (SPARK-18484) case class datasets - ability to specify decimal precision and scale

[ https://issues.apache.org/jira/browse/SPARK-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837269#comment-16837269 ] Bill Schneider edited comment on SPARK-18484 at 5/14/19 9:09 PM: - I

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839280#comment-16839280 ] Lukas Rytz commented on SPARK-27681: I think the best solution for 2.13, if we forget about 2.12,

[jira] [Created] (SPARK-27701) Extend NestedColumnAliasing to more nested field cases

Liang-Chi Hsieh created SPARK-27701: --- Summary: Extend NestedColumnAliasing to more nested field cases Key: SPARK-27701 URL: https://issues.apache.org/jira/browse/SPARK-27701 Project: Spark

[jira] [Commented] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

[ https://issues.apache.org/jira/browse/SPARK-27700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839290#comment-16839290 ] Udbhav Agrawal commented on SPARK-27700: I will raise a patch for this > SparkSubmit closes

[jira] [Created] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

Udbhav Agrawal created SPARK-27700: -- Summary: SparkSubmit closes with SocketTimeoutException in kubernetes mode. Key: SPARK-27700 URL: https://issues.apache.org/jira/browse/SPARK-27700 Project:

[jira] [Updated] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

[ https://issues.apache.org/jira/browse/SPARK-27700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-27700: --- Attachment: socket timeout > SparkSubmit closes with SocketTimeoutException in kubernetes

[jira] [Commented] (SPARK-27684) Reduce ScalaUDF conversion overheads for primitives

[ https://issues.apache.org/jira/browse/SPARK-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839297#comment-16839297 ] Marco Gaido commented on SPARK-27684: - I agree on this too. > Reduce ScalaUDF conversion overheads

[jira] [Assigned] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

[ https://issues.apache.org/jira/browse/SPARK-27700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27700: Assignee: (was: Apache Spark) > SparkSubmit closes with SocketTimeoutException in

[jira] [Assigned] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

[ https://issues.apache.org/jira/browse/SPARK-27700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27700: Assignee: Apache Spark > SparkSubmit closes with SocketTimeoutException in kubernetes

[jira] [Resolved] (SPARK-27685) `union` doesn't promote non-nullable columns of struct to nullable

[ https://issues.apache.org/jira/browse/SPARK-27685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-27685. - Resolution: Duplicate > `union` doesn't promote non-nullable columns of struct to nullable >

[jira] [Commented] (SPARK-27685) `union` doesn't promote non-nullable columns of struct to nullable

[ https://issues.apache.org/jira/browse/SPARK-27685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839295#comment-16839295 ] Marco Gaido commented on SPARK-27685: - This is a duplicate of SPARK-26812. > `union` doesn't

[jira] [Created] (SPARK-27702) Allow using some alternatives for service accounts

Udbhav Agrawal created SPARK-27702: -- Summary: Allow using some alternatives for service accounts Key: SPARK-27702 URL: https://issues.apache.org/jira/browse/SPARK-27702 Project: Spark Issue

[jira] [Created] (SPARK-27703) kubernetes jobs are filing with Unsatisfiedlink error

Udbhav Agrawal created SPARK-27703: -- Summary: kubernetes jobs are filing with Unsatisfiedlink error Key: SPARK-27703 URL: https://issues.apache.org/jira/browse/SPARK-27703 Project: Spark

[jira] [Assigned] (SPARK-27703) kubernetes jobs are failing with Unsatisfiedlink error

[ https://issues.apache.org/jira/browse/SPARK-27703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27703: Assignee: (was: Apache Spark) > kubernetes jobs are failing with Unsatisfiedlink

[jira] [Created] (SPARK-27704) Change default class loader to ParallelGC

Mihaly Toth created SPARK-27704: --- Summary: Change default class loader to ParallelGC Key: SPARK-27704 URL: https://issues.apache.org/jira/browse/SPARK-27704 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-27699) Partially push down disjunctive predicated in Parquet/Orc

Gengliang Wang created SPARK-27699: -- Summary: Partially push down disjunctive predicated in Parquet/Orc Key: SPARK-27699 URL: https://issues.apache.org/jira/browse/SPARK-27699 Project: Spark

[jira] [Commented] (SPARK-27549) Commit Kafka Source offsets to facilitate external tooling

[ https://issues.apache.org/jira/browse/SPARK-27549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839263#comment-16839263 ] Stavros Kontopoulos commented on SPARK-27549: - I will have a PR shortly im on it. > Commit

[jira] [Assigned] (SPARK-27699) Partially push down disjunctive predicated in Parquet/ORC

[ https://issues.apache.org/jira/browse/SPARK-27699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27699: Assignee: Apache Spark > Partially push down disjunctive predicated in Parquet/ORC >

[jira] [Assigned] (SPARK-27699) Partially push down disjunctive predicated in Parquet/ORC

[ https://issues.apache.org/jira/browse/SPARK-27699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27699: Assignee: (was: Apache Spark) > Partially push down disjunctive predicated in

[jira] [Commented] (SPARK-26338) Use scala-xml explicitly

[ https://issues.apache.org/jira/browse/SPARK-26338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839277#comment-16839277 ] Stavros Kontopoulos commented on SPARK-26338: - What is the issue here? > Use scala-xml

[jira] [Assigned] (SPARK-27702) Allow using some alternatives for service accounts

[ https://issues.apache.org/jira/browse/SPARK-27702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27702: Assignee: Apache Spark > Allow using some alternatives for service accounts >

[jira] [Assigned] (SPARK-27702) Allow using some alternatives for service accounts

[ https://issues.apache.org/jira/browse/SPARK-27702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27702: Assignee: (was: Apache Spark) > Allow using some alternatives for service accounts >

[jira] [Commented] (SPARK-26302) retainedBatches configuration can eat up memory on driver

[ https://issues.apache.org/jira/browse/SPARK-26302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839253#comment-16839253 ] Genmao Yu commented on SPARK-26302: --- Add some warning in documentation is reasonable. >

[jira] [Comment Edited] (SPARK-26302) retainedBatches configuration can eat up memory on driver

[ https://issues.apache.org/jira/browse/SPARK-26302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839253#comment-16839253 ] Genmao Yu edited comment on SPARK-26302 at 5/14/19 9:27 AM: Adding some

[jira] [Updated] (SPARK-27699) Partially push down disjunctive predicated in Parquet/ORC

[ https://issues.apache.org/jira/browse/SPARK-27699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-27699: --- Summary: Partially push down disjunctive predicated in Parquet/ORC (was: Partially push

[jira] [Assigned] (SPARK-27701) Extend NestedColumnAliasing to more nested field cases

[ https://issues.apache.org/jira/browse/SPARK-27701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27701: Assignee: (was: Apache Spark) > Extend NestedColumnAliasing to more nested field

[jira] [Assigned] (SPARK-27701) Extend NestedColumnAliasing to more nested field cases

[ https://issues.apache.org/jira/browse/SPARK-27701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27701: Assignee: Apache Spark > Extend NestedColumnAliasing to more nested field cases >

[jira] [Updated] (SPARK-27703) kubernetes jobs are failing with Unsatisfiedlink error

[ https://issues.apache.org/jira/browse/SPARK-27703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-27703: --- Summary: kubernetes jobs are failing with Unsatisfiedlink error (was: kubernetes jobs are

[jira] [Updated] (SPARK-27703) kubernetes jobs are failing with Unsatisfiedlink error

[ https://issues.apache.org/jira/browse/SPARK-27703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-27703: --- Description: I encountered this issue while using ctas parquet queries in kubernetes

[jira] [Assigned] (SPARK-27703) kubernetes jobs are failing with Unsatisfiedlink error

[ https://issues.apache.org/jira/browse/SPARK-27703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27703: Assignee: Apache Spark > kubernetes jobs are failing with Unsatisfiedlink error >

[jira] [Resolved] (SPARK-26278) V2 Streaming sources cannot be written to V1 sinks

[ https://issues.apache.org/jira/browse/SPARK-26278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justin Polchlopek resolved SPARK-26278. --- Resolution: Fixed Will take you at your word that it's all set, [~uncleGen].

[jira] [Resolved] (SPARK-27024) Executor interface for cluster managers to support GPU resources

[ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27024. --- Resolution: Fixed > Executor interface for cluster managers to support GPU resources >

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839341#comment-16839341 ] Lukas Rytz commented on SPARK-27681: Uh, I just did "find usages" in IntelliJ for the scala.Seq type

[jira] [Commented] (SPARK-27488) Driver interface to support GPU resources

[ https://issues.apache.org/jira/browse/SPARK-27488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839402#comment-16839402 ] Thomas Graves commented on SPARK-27488: --- With this Jira we need to move the function that does the

[jira] [Created] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

Henry Yu created SPARK-27705: Summary: kubernetes integration test break on osx when test PVTestsSuite Key: SPARK-27705 URL: https://issues.apache.org/jira/browse/SPARK-27705 Project: Spark

[jira] [Updated] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

[ https://issues.apache.org/jira/browse/SPARK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Yu updated SPARK-27705: - Priority: Minor (was: Major) > kubernetes integration test break on osx when test PVTestsSuite >

[jira] [Resolved] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27638. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24567

[jira] [Assigned] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27638: --- Assignee: peng bo > date format -M-dd string comparison not handled properly >

[jira] [Created] (SPARK-27707) Performance issue using explode

Ohad Raviv created SPARK-27707: -- Summary: Performance issue using explode Key: SPARK-27707 URL: https://issues.apache.org/jira/browse/SPARK-27707 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-27706) Add SQL metrics of numOutputRows for BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-27706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27706: Assignee: (was: Apache Spark) > Add SQL metrics of numOutputRows for

[jira] [Assigned] (SPARK-27706) Add SQL metrics of numOutputRows for BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-27706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27706: Assignee: Apache Spark > Add SQL metrics of numOutputRows for BroadcastExchangeExec >

[jira] [Commented] (SPARK-27707) Performance issue using explode

[ https://issues.apache.org/jira/browse/SPARK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839544#comment-16839544 ] Ohad Raviv commented on SPARK-27707: [~cloud_fan] - any chance you can take a look? > Performance

[jira] [Commented] (SPARK-23191) Workers registration failes in case of network drop

[ https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839435#comment-16839435 ] Neeraj Gupta commented on SPARK-23191: -- Hi [~Ngone51], In our case we were running the driver with

[jira] [Assigned] (SPARK-25719) Search functionality in datatables in stages page should search over formatted data rather than the raw data

[ https://issues.apache.org/jira/browse/SPARK-25719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25719: - Assignee: Parth Gandhi > Search functionality in datatables in stages page should search over

[jira] [Resolved] (SPARK-25719) Search functionality in datatables in stages page should search over formatted data rather than the raw data

[ https://issues.apache.org/jira/browse/SPARK-25719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25719. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24419

[jira] [Resolved] (SPARK-27680) Remove usage of Traversable

[ https://issues.apache.org/jira/browse/SPARK-27680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27680. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24584

[jira] [Updated] (SPARK-26812) PushProjectionThroughUnion nullability issue

[ https://issues.apache.org/jira/browse/SPARK-26812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-26812: --- Labels: correctness (was: ) > PushProjectionThroughUnion nullability issue >

[jira] [Commented] (SPARK-26812) PushProjectionThroughUnion nullability issue

[ https://issues.apache.org/jira/browse/SPARK-26812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839463#comment-16839463 ] Josh Rosen commented on SPARK-26812: Based on https://issues.apache.org/jira/browse/SPARK-27685,

[jira] [Created] (SPARK-27706) Add SQL metrics of numOutputRows for BroadcastExchangeExec

dzcxzl created SPARK-27706: -- Summary: Add SQL metrics of numOutputRows for BroadcastExchangeExec Key: SPARK-27706 URL: https://issues.apache.org/jira/browse/SPARK-27706 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27690) Remove materialized views first in `HiveClientImpl.reset`

[ https://issues.apache.org/jira/browse/SPARK-27690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27690. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is