Hu Fuwang created SPARK-29531:
-
Summary: Refine ThriftServerQueryTestSuite.blackList to reuse code
of SQLQueryTestSuite.blackList
Key: SPARK-29531
URL: https://issues.apache.org/jira/browse/SPARK-29531
Pr
Hu Fuwang created SPARK-29541:
-
Summary: Add missing modules in spark-parent pom file
Key: SPARK-29541
URL: https://issues.apache.org/jira/browse/SPARK-29541
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Attachment: individual-module-build-failure.png
> Add missing modules in spark-parent pom file
> -
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [build guide|#building-submodules-individually]] , individual module
can be bu
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [build guide|#building-submodules-individually]] , individual module
can be bu
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [build guide|#building-submodules-individually] , individual module
can be bui
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [build
guide|[https://spark.apache.org/docs/latest/building-spark.html#buildin
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [link title|http://example.com], individual module can be built
separately wit
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [build guide|http://www.google.com], individual module can be built
separately
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark [link
title|[https://spark.apache.org/docs/latest/building-spark.html#building
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29541:
--
Description:
Per Spark build guide
[https://spark.apache.org/docs/latest/building-spark.html#building
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956748#comment-16956748
]
Hu Fuwang commented on SPARK-29541:
---
[~Qin Yao] yes, thank you kent. will close this j
[
https://issues.apache.org/jira/browse/SPARK-29541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang resolved SPARK-29541.
---
Resolution: Not A Problem
> Add missing modules in spark-parent pom file
> -
[
https://issues.apache.org/jira/browse/SPARK-21287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957939#comment-16957939
]
Hu Fuwang commented on SPARK-21287:
---
[~smilegator] [~srowen] Just submitted a PR for
[
https://issues.apache.org/jira/browse/SPARK-29586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958610#comment-16958610
]
Hu Fuwang commented on SPARK-29586:
---
I am working on this.
> spark jdbc method param
[
https://issues.apache.org/jira/browse/SPARK-29586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29586:
--
Comment: was deleted
(was: I am working on this.)
> spark jdbc method param lowerBound and upperBound
[
https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960370#comment-16960370
]
Hu Fuwang commented on SPARK-28512:
---
[~Gengliang.Wang] Is this already solved by
[htt
Hu Fuwang created SPARK-29615:
-
Summary: Add insertInto method with byName parameter in
DataFrameWriter
Key: SPARK-29615
URL: https://issues.apache.org/jira/browse/SPARK-29615
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang resolved SPARK-29615.
---
Resolution: Not A Problem
> Add insertInto method with byName parameter in DataFrameWriter
> ---
[
https://issues.apache.org/jira/browse/SPARK-29707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964655#comment-16964655
]
Hu Fuwang commented on SPARK-29707:
---
I am working on this.
> Make PartitionFilters an
Hu Fuwang created SPARK-29834:
-
Summary: DESC DATABASE should look up catalog like v2 commands
Key: SPARK-29834
URL: https://issues.apache.org/jira/browse/SPARK-29834
Project: Spark
Issue Type: S
[
https://issues.apache.org/jira/browse/SPARK-29834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971345#comment-16971345
]
Hu Fuwang commented on SPARK-29834:
---
Working on this.
> DESC DATABASE should look up
Hu Fuwang created SPARK-29858:
-
Summary: ALTER DATABASE (SET DBPROPERTIES) should look up catalog
like v2 commands
Key: SPARK-29858
URL: https://issues.apache.org/jira/browse/SPARK-29858
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972530#comment-16972530
]
Hu Fuwang commented on SPARK-29858:
---
Working on this.
> ALTER DATABASE (SET DBPROPERT
Hu Fuwang created SPARK-29859:
-
Summary: ALTER DATABASE (SET LOCATION) should look up catalog like
v2 commands
Key: SPARK-29859
URL: https://issues.apache.org/jira/browse/SPARK-29859
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972532#comment-16972532
]
Hu Fuwang commented on SPARK-29859:
---
Working on this.
> ALTER DATABASE (SET LOCATION)
[
https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29979:
--
Summary: Add property key constants in Table and SupportsNamespaces (was:
Add property constants in T
[
https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29979:
--
Description: Currently, for
> Add property constants in Table and SupportsNamespaces
> --
Hu Fuwang created SPARK-29979:
-
Summary: Add property constants in Table and SupportsNamespaces
Key: SPARK-29979
URL: https://issues.apache.org/jira/browse/SPARK-29979
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29979:
--
Description: Currently, some basic/reserved keys (eg. "location",
"comment") of table and namespace pr
[
https://issues.apache.org/jira/browse/SPARK-29979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29979:
--
Summary: Add basic/reserved property key constants in Table and
SupportsNamespaces (was: Add property
[
https://issues.apache.org/jira/browse/SPARK-29707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-29707:
--
Comment: was deleted
(was: I am working on this.)
> Make PartitionFilters and PushedFilters abbreviat
Hu Fuwang created SPARK-30138:
-
Summary: Separate configuration key of max iterations for analyzer
and optimizer
Key: SPARK-30138
URL: https://issues.apache.org/jira/browse/SPARK-30138
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30138:
--
Description:
Currently, both Analyzer and Optimizer use conf
"spark.sql.optimizer.excludedRules" to s
Hu Fuwang created SPARK-30215:
-
Summary: Remove PrunedInMemoryFileIndex and merge its
functionality into InMemoryFileIndex
Key: SPARK-30215
URL: https://issues.apache.org/jira/browse/SPARK-30215
Project:
Hu Fuwang created SPARK-30259:
-
Summary: CREATE TABLE AS SELECT throw error when session catalog
specified
Key: SPARK-30259
URL: https://issues.apache.org/jira/browse/SPARK-30259
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30259:
--
Description:
Spark throw error when the session catalog is specified explicitly in the
CREATE TABLE A
[
https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30259:
--
Description:
Spark throw error when the session catalog is specified explicitly in "CREATE
TABLE" and
[
https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30259:
--
Summary: CREATE TABLE throw error when session catalog specified (was:
CREATE TABLE AS SELECT throw e
[
https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30259:
--
Description:
Spark throw error when the session catalog is specified explicitly in "CREATE
TABLE" and
[
https://issues.apache.org/jira/browse/SPARK-30215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang resolved SPARK-30215.
---
Resolution: Not A Problem
> Remove PrunedInMemoryFileIndex and merge its functionality into
> InMem
Hu Fuwang created SPARK-30427:
-
Summary: Add config item for limiting partition number when
calculating statistics through HDFS
Key: SPARK-30427
URL: https://issues.apache.org/jira/browse/SPARK-30427
Proj
[
https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30427:
--
Summary: Add config item for limiting partition number when calculating
statistics through File System
[
https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30427:
--
Description:
Currently, when spark need to calculate the statistics (eg. sizeInBytes) of
table partit
Hu Fuwang created SPARK-30469:
-
Summary: Hive Partition columns should not be involved when
calculating sizeInBytes of Project logical plan
Key: SPARK-30469
URL: https://issues.apache.org/jira/browse/SPARK-30469
[
https://issues.apache.org/jira/browse/SPARK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30469:
--
Description:
When getting the statistics of a Project logical plan, if CBO not enabled,
Spark will ca
[
https://issues.apache.org/jira/browse/SPARK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30469:
--
Summary: Partition columns should not be involved when calculating
sizeInBytes of Project logical plan
[
https://issues.apache.org/jira/browse/SPARK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30469:
--
Description:
When getting the statistics of a Project logical plan, if CBO not enabled,
Spark will ca
Hu Fuwang created SPARK-30516:
-
Summary: FileScan.estimateStatistics does not take
partitionFilters and partition number into account
Key: SPARK-30516
URL: https://issues.apache.org/jira/browse/SPARK-30516
[
https://issues.apache.org/jira/browse/SPARK-30516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30516:
--
Description: Currently, FileScan.estimateStatistics will not take
partitionFilters into account, which
[
https://issues.apache.org/jira/browse/SPARK-30516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30516:
--
Description: Currently, FileScan.estimateStatistics does not take
partitionFilters and partition numbe
[
https://issues.apache.org/jira/browse/SPARK-30516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30516:
--
Summary: statistic estimation of FileScan should take partitionFilters and
partition number into accou
Hu Fuwang created SPARK-30525:
-
Summary: HiveTableScanExec do not need to prune partitions again
after pushing down to hive metastore
Key: SPARK-30525
URL: https://issues.apache.org/jira/browse/SPARK-30525
[
https://issues.apache.org/jira/browse/SPARK-30525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30525:
--
Description: In HiveTableScanExec, it will push down to hive metastore for
partition pruning if _spark
[
https://issues.apache.org/jira/browse/SPARK-30525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30525:
--
Description: In HiveTableScanExec, it will push down to hive metastore for
partition pruning if spark.
55 matches
Mail list logo
