[jira] [Commented] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930244#comment-16930244 ] Hyukjin Kwon commented on SPARK-29058: -- {code} >>> schema = "Fruit string,color string,price

[jira] [Commented] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930243#comment-16930243 ] Hyukjin Kwon commented on SPARK-29058: -- Oh, right. The count is 3. In that case it's because

[jira] [Resolved] (SPARK-27972) Move SQL migration guide to the top level

[ https://issues.apache.org/jira/browse/SPARK-27972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27972. - Resolution: Duplicate > Move SQL migration guide to the top level >

[jira] [Commented] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

[ https://issues.apache.org/jira/browse/SPARK-29092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930237#comment-16930237 ] Dilip Biswal commented on SPARK-29092: -- I am looking into this. > EXPLAIN FORMATTED does not work

[jira] [Commented] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930232#comment-16930232 ] Suchintak Patnaik commented on SPARK-29058: --- [~hyukjin.kwon] If I take quantity is of type

[jira] [Commented] (SPARK-29031) Materialized column to accelerate queries

[ https://issues.apache.org/jira/browse/SPARK-29031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930230#comment-16930230 ] Jason Guo commented on SPARK-29031: --- [~lishuming] `Materialized column` is supported in Clickhouse 

[jira] [Updated] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

[ https://issues.apache.org/jira/browse/SPARK-29092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29092: Description:   {code:java} withSQLConf(SQLConf.DYNAMIC_PARTITION_PRUNING_ENABLED.key -> "true",

[jira] [Updated] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

[ https://issues.apache.org/jira/browse/SPARK-29092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29092: Target Version/s: 3.0.0 > EXPLAIN FORMATTED does not work well with DPP >

[jira] [Created] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

Xiao Li created SPARK-29092: --- Summary: EXPLAIN FORMATTED does not work well with DPP Key: SPARK-29092 URL: https://issues.apache.org/jira/browse/SPARK-29092 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930221#comment-16930221 ] feiwang edited comment on SPARK-28945 at 9/16/19 4:22 AM: -- [~advancedxy]

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930221#comment-16930221 ] feiwang commented on SPARK-28945: - [~advancedxy] Thanks. Hope SPARK-28945 can be merged soon. It is

[jira] [Reopened] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment

[ https://issues.apache.org/jira/browse/SPARK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA reopened SPARK-28884: -- I think solution has to be re look. Issue still holds good. > [Spark]Spark

[jira] [Commented] (SPARK-29091) spark-shell don't support added jar's class as Serde class

[ https://issues.apache.org/jira/browse/SPARK-29091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930212#comment-16930212 ] angerszhu commented on SPARK-29091: --- [~hyukjin.kwon] emmm, this bug also happen in jdk8,

[jira] [Commented] (SPARK-29031) Materialized column to accelerate queries

[ https://issues.apache.org/jira/browse/SPARK-29031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930211#comment-16930211 ] ShuMing Li commented on SPARK-29031: This can be useful in cases when user's queries are regular and

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930201#comment-16930201 ] Xianjin YE commented on SPARK-28945: >  Hi, I think the exception shown in the

[jira] [Updated] (SPARK-29035) unpersist() ignoring cache/persist()

[ https://issues.apache.org/jira/browse/SPARK-29035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29035: - Description: Calling {{unpersist()}}, even though the {{DataFrame}} is not used anymore

[jira] [Commented] (SPARK-29035) unpersist() ignoring cache/persist()

[ https://issues.apache.org/jira/browse/SPARK-29035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930189#comment-16930189 ] Hyukjin Kwon commented on SPARK-29035: -- [~jose.lima.silva], do you mind if I ask the full

[jira] [Updated] (SPARK-29035) unpersist() ignoring cache/persist()

[ https://issues.apache.org/jira/browse/SPARK-29035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29035: - Component/s: (was: Input/Output) SQL > unpersist() ignoring

[jira] [Updated] (SPARK-29046) Possible NPE on SQLConf.get when SparkContext is stopping in another thread

[ https://issues.apache.org/jira/browse/SPARK-29046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29046: - Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Commented] (SPARK-29044) Resolved attribute(s) R#661751,residue#661752 missing from ipi#660814,residue#660731,exper_set#660827,R#660730,description#660815,sequence#660817,exper#660828,symbol#6

[ https://issues.apache.org/jira/browse/SPARK-29044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930188#comment-16930188 ] Hyukjin Kwon commented on SPARK-29044: -- Are you able to narrow down the reproducer and describe the

[jira] [Resolved] (SPARK-29047) use spark-submit Not a file: hdfs://

[ https://issues.apache.org/jira/browse/SPARK-29047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29047. -- Resolution: Not A Problem The error is from HDFS {{FileInputFormat}}. Please check the

[jira] [Resolved] (SPARK-29050) Fix typo in some docs

[ https://issues.apache.org/jira/browse/SPARK-29050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29050. -- Resolution: Invalid > Fix typo in some docs > - > > Key:

[jira] [Commented] (SPARK-29049) Rename DataSourceStrategy#normalizeFilters to DataSourceStrategy#normalizeAttrNames

[ https://issues.apache.org/jira/browse/SPARK-29049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930182#comment-16930182 ] Hyukjin Kwon commented on SPARK-29049: -- [~xinxianyin] can you fill the JIRA description? why should

[jira] [Resolved] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29058. -- Resolution: Invalid > Reading csv file with DROPMALFORMED showing incorrect record count >

[jira] [Commented] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930181#comment-16930181 ] Hyukjin Kwon commented on SPARK-29058: -- that's because `quantity` is a float, not int: {code} >>>

[jira] [Resolved] (SPARK-29068) CSV read reports incorrect row count

[ https://issues.apache.org/jira/browse/SPARK-29068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29068. -- Resolution: Invalid You should set {{comment}} to {{#}} and {{header}} to {{true}} > CSV

[jira] [Updated] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29058: - Description: The spark sql csv reader is dropping malformed records as expected, but the

[jira] [Commented] (SPARK-29078) Spark shell fails if read permission is not granted to hive warehouse directory

[ https://issues.apache.org/jira/browse/SPARK-29078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930179#comment-16930179 ] Hyukjin Kwon commented on SPARK-29078: -- What error is thrown or what happens in this case in that

[jira] [Updated] (SPARK-29078) Spark shell fails if read permission is not granted to hive warehouse directory

[ https://issues.apache.org/jira/browse/SPARK-29078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29078: - Target Version/s: (was: 3.0.0) > Spark shell fails if read permission is not granted to hive

[jira] [Resolved] (SPARK-29085) spark jdbc query to oracle "__SPARK_GEN_JDBC_SUBQUERY_NAME_" "__" not suport by ORACLE

[ https://issues.apache.org/jira/browse/SPARK-29085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29085. -- Resolution: Duplicate Please search existing issues before filing a new one. > spark jdbc

[jira] [Updated] (SPARK-29086) Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29086: - Parent: (was: SPARK-28684) Issue Type: Bug (was: Sub-task) > Use added jar's class

[jira] [Updated] (SPARK-29086) Use added jar's class as Serde class, SparkGetColumnsOperation return empty columns

[ https://issues.apache.org/jira/browse/SPARK-29086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29086: - Parent: SPARK-28684 Issue Type: Sub-task (was: Bug) > Use added jar's class as Serde

[jira] [Resolved] (SPARK-29069) ResolveInsertInto should not do table look up

[ https://issues.apache.org/jira/browse/SPARK-29069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29069. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25774

[jira] [Updated] (SPARK-29091) spark-shell don't support added jar's class as Serde class

[ https://issues.apache.org/jira/browse/SPARK-29091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-29091: -- Description: {code:java} Welcome to __ / __/__ ___ _/ /__ _\ \/

[jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore

[ https://issues.apache.org/jira/browse/SPARK-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930078#comment-16930078 ] JP Bordenave commented on SPARK-13446: -- i have issue HIVE_STATS_JDBC_TIMEOUT with hive 2.3.6,   

[jira] [Assigned] (SPARK-29052) Create a Migration Guide tap in Spark documentation

[ https://issues.apache.org/jira/browse/SPARK-29052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29052: - Assignee: Hyukjin Kwon > Create a Migration Guide tap in Spark documentation >

[jira] [Resolved] (SPARK-29052) Create a Migration Guide tap in Spark documentation

[ https://issues.apache.org/jira/browse/SPARK-29052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29052. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25757

[jira] [Resolved] (SPARK-29046) Possible NPE on SQLConf.get when SparkContext is stopping in another thread

[ https://issues.apache.org/jira/browse/SPARK-29046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29046. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25790

[jira] [Updated] (SPARK-27122) YARN test failures in Java 9+

[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27122: -- Parent: (was: SPARK-24417) Issue Type: Improvement (was: Sub-task) > YARN test

[jira] [Commented] (SPARK-27122) YARN test failures in Java 9+

[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930019#comment-16930019 ] Dongjoon Hyun commented on SPARK-27122: --- This is backported to `branch-2.4` via

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930014#comment-16930014 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 5:24 PM: --- in

[jira] [Commented] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930014#comment-16930014 ] JP Bordenave commented on SPARK-29088: -- in spark-defaults.conf i was added this line with last two

[jira] [Comment Edited] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930010#comment-16930010 ] feiwang edited comment on SPARK-28945 at 9/15/19 5:17 PM: -- [~cloud_fan]

[jira] [Assigned] (SPARK-29087) Use DelegatingServletContextHandler to avoid CCE

[ https://issues.apache.org/jira/browse/SPARK-29087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29087: - Assignee: Dongjoon Hyun > Use DelegatingServletContextHandler to avoid CCE >

[jira] [Resolved] (SPARK-29087) Use DelegatingServletContextHandler to avoid CCE

[ https://issues.apache.org/jira/browse/SPARK-29087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29087. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-27122) YARN test failures in Java 9+

[ https://issues.apache.org/jira/browse/SPARK-27122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27122: -- Fix Version/s: 2.4.5 > YARN test failures in Java 9+ > - > >

[jira] [Comment Edited] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930010#comment-16930010 ] feiwang edited comment on SPARK-28945 at 9/15/19 5:12 PM: -- [~cloud_fan]

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930010#comment-16930010 ] feiwang commented on SPARK-28945: - [~cloud_fan] [~advancedxy] Hi, I think the exception shown in the

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930005#comment-16930005 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 4:39 PM: --- may be for

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930005#comment-16930005 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 4:39 PM: --- may be for

[jira] [Commented] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930005#comment-16930005 ] JP Bordenave commented on SPARK-29088: -- may be for close, it can be a question of order jar loading

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930002#comment-16930002 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 4:33 PM: --- after lot

[jira] [Resolved] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave resolved SPARK-29088. -- Resolution: Fixed > Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930002#comment-16930002 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 4:31 PM: --- after lot

[jira] [Comment Edited] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930002#comment-16930002 ] JP Bordenave edited comment on SPARK-29088 at 9/15/19 4:30 PM: --- after lot

[jira] [Commented] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930002#comment-16930002 ] JP Bordenave commented on SPARK-29088: -- after lot of trying and lot of fail, i remove all lz4* from

[jira] [Commented] (SPARK-28864) Add spark connector for Alibaba Log Service

[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929983#comment-16929983 ] Ke Li commented on SPARK-28864: --- Hi [~kabhwan] [~gsomogyi] Thank you for your comments. That's would be

[jira] [Updated] (SPARK-28864) Add spark connector for Alibaba Log Service

[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Li updated SPARK-28864: -- Description: Alibaba Log Service is a big data service which has been widely used in Alibaba Group and 

[jira] [Updated] (SPARK-29091) spark-shell don't support added jar's class as Serde class

[ https://issues.apache.org/jira/browse/SPARK-29091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29091: Parent: SPARK-28684 Issue Type: Sub-task (was: Bug) > spark-shell don't support added

[jira] [Created] (SPARK-29091) spark-shell don't support added jar's class as Serde class

angerszhu created SPARK-29091: - Summary: spark-shell don't support added jar's class as Serde class Key: SPARK-29091 URL: https://issues.apache.org/jira/browse/SPARK-29091 Project: Spark Issue

[jira] [Resolved] (SPARK-29090) Invalid patterns of seconds fractions in functions comments

[ https://issues.apache.org/jira/browse/SPARK-29090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29090. Resolution: Won't Fix > Invalid patterns of seconds fractions in functions comments >

[jira] [Created] (SPARK-29090) Invalid patterns of seconds fractions in functions comments

Maxim Gekk created SPARK-29090: -- Summary: Invalid patterns of seconds fractions in functions comments Key: SPARK-29090 URL: https://issues.apache.org/jira/browse/SPARK-29090 Project: Spark

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Target Version/s: (was: 2.4.5, 3.0.0) > DataFrameReader bottleneck in

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Created] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

Arwin S Tio created SPARK-29089: --- Summary: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files Key: SPARK-29089 URL:

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Environment: linux ubuntu 18.04 standalone hive 2.3.6 mysql 5.7.27 hadoop 2.7.7 spark 2.4.4 

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Summary: Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine

[jira] [Updated] (SPARK-29088) Hive 2.3.6 / HDP 2.7.7 / spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail with MR spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Summary: Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail with MR spark

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Environment: linux ubuntu 18.04 standalone hive 2.3.6 hadoop 2.7.7 spark 2.4.4 

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

[jira] [Updated] (SPARK-29088) Hive 2.3.6 lz-1.3.0.jar and spark 2.4.4 lz4-java.jar, insert fail wait spark engine mode , work fine with hadoop mode

[ https://issues.apache.org/jira/browse/SPARK-29088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JP Bordenave updated SPARK-29088: - Description: hello,   i install  hadoop 2.7.7 work fine  i install hive 2.3.6, work fine with

  1   2   >