[
https://issues.apache.org/jira/browse/SPARK-25391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25391:
Assignee: Apache Spark
> Make behaviors consistent when converting parquet hive table to
[
https://issues.apache.org/jira/browse/SPARK-25391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25391:
Assignee: (was: Apache Spark)
> Make behaviors consistent when converting parquet
[
https://issues.apache.org/jira/browse/SPARK-25391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608750#comment-16608750
]
Apache Spark commented on SPARK-25391:
--
User 'seancxmao' has created a pull request for this issue:
Chenxiao Mao created SPARK-25391:
Summary: Make behaviors consistent when converting parquet hive
table to parquet data source
Key: SPARK-25391
URL: https://issues.apache.org/jira/browse/SPARK-25391
Wenchen Fan created SPARK-25390:
---
Summary: finalize the abstraction of data source V2 API
Key: SPARK-25390
URL: https://issues.apache.org/jira/browse/SPARK-25390
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25389:
--
Description:
Like `INSERT OVERWRITE DIRECTORY USING` syntax, `INSERT OVERWRITE DIRECTORY
[
https://issues.apache.org/jira/browse/SPARK-25389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25389:
Assignee: (was: Apache Spark)
> INSERT OVERWRITE DIRECTORY STORED AS should prevent
[
https://issues.apache.org/jira/browse/SPARK-25389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608741#comment-16608741
]
Apache Spark commented on SPARK-25389:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25389:
Assignee: Apache Spark
> INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate
[
https://issues.apache.org/jira/browse/SPARK-25389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25389:
--
Summary: INSERT OVERWRITE DIRECTORY STORED AS should prevent duplicate
fields (was: INSERT
Dongjoon Hyun created SPARK-25389:
-
Summary: INSERT OVERWRITE DIRECTORY STORED AS should not generate
files with duplicate fields
Key: SPARK-25389
URL: https://issues.apache.org/jira/browse/SPARK-25389
[
https://issues.apache.org/jira/browse/SPARK-24911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608701#comment-16608701
]
Apache Spark commented on SPARK-24911:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608697#comment-16608697
]
Apache Spark commented on SPARK-24911:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608698#comment-16608698
]
Apache Spark commented on SPARK-24911:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608699#comment-16608699
]
Apache Spark commented on SPARK-24911:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608696#comment-16608696
]
Apache Spark commented on SPARK-24849:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-24849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608695#comment-16608695
]
Apache Spark commented on SPARK-24849:
--
User 'gatorsmile' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-20918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-20918:
Description:
Currently, the unquoted string of a function identifier is being used as the
[
https://issues.apache.org/jira/browse/SPARK-20918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-20918:
Issue Type: Bug (was: Improvement)
> Use FunctionIdentifier as function identifiers in
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Description:
We save the dataframe object as a hive table in orc/parquet format in the spark
shell.
After we
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Priority: Critical (was: Major)
> The column attributes obtained by Spark sql are inconsistent with hive
>
[
https://issues.apache.org/jira/browse/SPARK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608676#comment-16608676
]
Apache Spark commented on SPARK-25021:
--
User 'ifilonenko' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608675#comment-16608675
]
Wenchen Fan commented on SPARK-25378:
-
ArrayData is not a public interface, so I won't treat it as a
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Summary: The column attributes obtained by Spark sql are inconsistent with
hive (was: Spark sql get incompatiable
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Summary: Spark sql get incompatiable column schema as in hiveThe column
attributes obtained by Spark sql are
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Summary: Spark sql get incompatiable column schema as in hive (was: Spark
sql get incompatiable schema as in hive)
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Summary: Spark sql get incompatiable schema as in hive (was: Spark sql got
incompatiable schema as in hive)
>
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Summary: Spark sql got incompatiable schema as in hive (was: Hive table
created by Spark dataFrame has
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Fix Version/s: (was: 2.3.2)
> Hive table created by Spark dataFrame has incompatiable schema in spark and
>
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Description:
We save the dataframe object as a hive table in orc/parquet format in the spark
shell.
After we
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Description:
We save the dataframe object as a hive table in orc/parquet format in the spark
shell.
After we
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Description:
We save the dataframe object as a hive table in orc/parquet format in the spark
shell.
After we
[
https://issues.apache.org/jira/browse/SPARK-25367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yy updated SPARK-25367:
---
Affects Version/s: 2.2.0
2.2.2
2.3.0
2.3.1
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25175:
--
Fix Version/s: (was: 3.0.0)
> Field resolution should fail if there's ambiguity for ORC
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-25175:
-
Assignee: Chenxiao Mao
> Field resolution should fail if there's ambiguity for ORC
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-25175.
---
Resolution: Fixed
Fix Version/s: 2.4.0
3.0.0
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-25388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25388:
Assignee: (was: Apache Spark)
> checkEvaluation may miss incorrect nullable of
[
https://issues.apache.org/jira/browse/SPARK-25388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25388:
Assignee: Apache Spark
> checkEvaluation may miss incorrect nullable of DataType in the
[
https://issues.apache.org/jira/browse/SPARK-25388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608624#comment-16608624
]
Apache Spark commented on SPARK-25388:
--
User 'kiszk' has created a pull request for this issue:
Kazuaki Ishizaki created SPARK-25388:
Summary: checkEvaluation may miss incorrect nullable of DataType
in the result
Key: SPARK-25388
URL: https://issues.apache.org/jira/browse/SPARK-25388
[
https://issues.apache.org/jira/browse/SPARK-25366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liuxian updated SPARK-25366:
Summary: Zstd and brotli CompressionCodec are not supported for parquet
files (was: Zstd and brotil
[
https://issues.apache.org/jira/browse/SPARK-25364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608612#comment-16608612
]
Vincent commented on SPARK-25364:
-
duplication. close this Jira.
> a better way to handle vector index
[
https://issues.apache.org/jira/browse/SPARK-25364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vincent resolved SPARK-25364.
-
Resolution: Duplicate
> a better way to handle vector index and sparsity in FeatureHasher
>
[
https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25368:
--
Affects Version/s: (was: 2.3.2)
2.3.0
> Incorrect constraint
[
https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-25368:
Summary: Incorrect constraint inference returns wrong result (was:
Incorrect predicate pushdown returns
[
https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-25368:
---
Assignee: Yuming Wang
> Incorrect predicate pushdown returns wrong result
>
[
https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-25368:
Labels: correctness (was: )
> Incorrect predicate pushdown returns wrong result
>
[
https://issues.apache.org/jira/browse/SPARK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-25368.
-
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.2
> Incorrect predicate pushdown
[
https://issues.apache.org/jira/browse/SPARK-25387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25387:
Assignee: Apache Spark
> Malformed CSV causes NPE
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-25387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608476#comment-16608476
]
Apache Spark commented on SPARK-25387:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608477#comment-16608477
]
Apache Spark commented on SPARK-25387:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25387:
Assignee: (was: Apache Spark)
> Malformed CSV causes NPE
>
Maxim Gekk created SPARK-25387:
--
Summary: Malformed CSV causes NPE
Key: SPARK-25387
URL: https://issues.apache.org/jira/browse/SPARK-25387
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608444#comment-16608444
]
Apache Spark commented on SPARK-25371:
--
User 'mgaido91' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25371:
Assignee: Apache Spark
> Vector Assembler with no input columns leads to opaque error
>
[
https://issues.apache.org/jira/browse/SPARK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25371:
Assignee: (was: Apache Spark)
> Vector Assembler with no input columns leads to
[
https://issues.apache.org/jira/browse/SPARK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608443#comment-16608443
]
Apache Spark commented on SPARK-25371:
--
User 'mgaido91' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608430#comment-16608430
]
Apache Spark commented on SPARK-25385:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608429#comment-16608429
]
Apache Spark commented on SPARK-25385:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25385:
Assignee: Apache Spark
> Upgrade jackson version to 2.7.8
>
[
https://issues.apache.org/jira/browse/SPARK-25385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25385:
Assignee: (was: Apache Spark)
> Upgrade jackson version to 2.7.8
>
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-25386:
-
Summary: Don't need to synchronize the IndexShuffleBlockResolver for each
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-25386:
-
Description: Now, we need synchronize the instance of
IndexShuffleBlockResolver in order to
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608427#comment-16608427
]
Apache Spark commented on SPARK-25386:
--
User 'ConeyLiu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25386:
Assignee: (was: Apache Spark)
> Don't need to synchronize the
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25386:
Assignee: Apache Spark
> Don't need to synchronize the IndexShuffleBlockResolver for
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608426#comment-16608426
]
Apache Spark commented on SPARK-25386:
--
User 'ConeyLiu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25385:
Summary: Upgrade jackson version to 2.7.8 (was: Upgrade
fasterxml.jackson.databind.version to
Xianyang Liu created SPARK-25386:
Summary: Don't need to synchronize the IndexShuffleBlockResolver
for each writeIndexFileAndCommit
Key: SPARK-25386
URL: https://issues.apache.org/jira/browse/SPARK-25386
Yuming Wang created SPARK-25385:
---
Summary: Upgrade fasterxml.jackson.databind.version to 2.7.8
Key: SPARK-25385
URL: https://issues.apache.org/jira/browse/SPARK-25385
Project: Spark
Issue
70 matches
Mail list logo
