Rui Wang created SPARK-41103:
Summary: Document how to add a new proto field of messages
Key: SPARK-41103
URL: https://issues.apache.org/jira/browse/SPARK-41103
Project: Spark
Issue Type:
Rui Wang created SPARK-41102:
Summary: Merge SparkConnectPlanner and SparkConnectCommandPlanner
Key: SPARK-41102
URL: https://issues.apache.org/jira/browse/SPARK-41102
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-41090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-41090:
-
Description:
Add the following test case to `DatasetSuite`:
dataset.createTempView("test_db.tempView")
Rui Wang created SPARK-41090:
Summary: Enhance Dataset.createTempView testing coverage for
db_name.view_name
Key: SPARK-41090
URL: https://issues.apache.org/jira/browse/SPARK-41090
Project: Spark
Rui Wang created SPARK-41086:
Summary: Consolidate SecondArgumentXXX error to
INVALID_PARAMETER_VALUE
Key: SPARK-41086
URL: https://issues.apache.org/jira/browse/SPARK-41086
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-41086:
-
Description:
SECOND_FUNCTION_ARGUMENT_NOT_INTEGER
_LEGACY_ERROR_TEMP_1104
> Consolidate
Rui Wang created SPARK-41078:
Summary: DataFrame `withColumnsRenamed` can be implemented through
`RenameColumns` proto
Key: SPARK-41078
URL: https://issues.apache.org/jira/browse/SPARK-41078
Project:
Rui Wang created SPARK-41077:
Summary: Rename `ColumnRef` to `Column` in Python client
implementation
Key: SPARK-41077
URL: https://issues.apache.org/jira/browse/SPARK-41077
Project: Spark
Rui Wang created SPARK-41061:
Summary: Support SelectExpr which apply Projection by expressions
in Strings in Connect DSL
Key: SPARK-41061
URL: https://issues.apache.org/jira/browse/SPARK-41061
Project:
[
https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630706#comment-17630706
]
Rui Wang edited comment on SPARK-41057 at 11/9/22 2:55 AM:
---
[~dengziming]
[
https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630706#comment-17630706
]
Rui Wang commented on SPARK-41057:
--
@dengziming
Are you interested in this JIRA?
> Support other data
[
https://issues.apache.org/jira/browse/SPARK-41057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-41057:
-
Description:
In
Rui Wang created SPARK-41057:
Summary: Support other data type conversion in the
DataTypeProtoConverter
Key: SPARK-41057
URL: https://issues.apache.org/jira/browse/SPARK-41057
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630630#comment-17630630
]
Rui Wang commented on SPARK-41046:
--
[~dengziming]
Ah I have a working version locally already. Sorry
Rui Wang created SPARK-41046:
Summary: Support CreateView in Connect DSL
Key: SPARK-41046
URL: https://issues.apache.org/jira/browse/SPARK-41046
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-41036:
Summary: `columns` API should use `schema` API to avoid data
fetching
Key: SPARK-41036
URL: https://issues.apache.org/jira/browse/SPARK-41036
Project: Spark
Issue
Rui Wang created SPARK-41034:
Summary: Connect DataFrame should require RemoteSparkSession
Key: SPARK-41034
URL: https://issues.apache.org/jira/browse/SPARK-41034
Project: Spark
Issue Type:
Rui Wang created SPARK-41033:
Summary: RemoteSparkSession should only accept one `user_id`
Key: SPARK-41033
URL: https://issues.apache.org/jira/browse/SPARK-41033
Project: Spark
Issue Type:
Rui Wang created SPARK-41026:
Summary: Support Repartition in Connect DSL
Key: SPARK-41026
URL: https://issues.apache.org/jira/browse/SPARK-41026
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-41010:
Summary: Complete Support for Except and Intersect in Python client
Key: SPARK-41010
URL: https://issues.apache.org/jira/browse/SPARK-41010
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-41002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-41002:
-
Summary: Compatible `take`, `head` and `first` API in Python client (was:
Compatible `take` and
Rui Wang created SPARK-41002:
Summary: Compatible `take` and `head` API in Python client
Key: SPARK-41002
URL: https://issues.apache.org/jira/browse/SPARK-41002
Project: Spark
Issue Type:
Rui Wang created SPARK-40993:
Summary: Migrate markdown style README to
python/docs/development/testing.rst
Key: SPARK-40993
URL: https://issues.apache.org/jira/browse/SPARK-40993
Project: Spark
Rui Wang created SPARK-40992:
Summary: Support toDF(columnNames) in Connect DSL
Key: SPARK-40992
URL: https://issues.apache.org/jira/browse/SPARK-40992
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40989:
Summary: Improve `session.sql` testing coverage in Python client
Key: SPARK-40989
URL: https://issues.apache.org/jira/browse/SPARK-40989
Project: Spark
Issue Type:
Rui Wang created SPARK-40981:
Summary: Support session.range in Python client
Key: SPARK-40981
URL: https://issues.apache.org/jira/browse/SPARK-40981
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40980:
-
Summary: Support session.sql in Connect DSL (was: Improve test coverage
for session.sql)
> Support
Rui Wang created SPARK-40980:
Summary: Improve test coverage for session.sql
Key: SPARK-40980
URL: https://issues.apache.org/jira/browse/SPARK-40980
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626878#comment-17626878
]
Rui Wang commented on SPARK-40951:
--
[~dongjoon] Is this JIRA fully resolved already? Can we close this
Rui Wang created SPARK-40977:
Summary: Complete Support for Union in Python client
Key: SPARK-40977
URL: https://issues.apache.org/jira/browse/SPARK-40977
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40971:
Summary: Imports more from connect proto package to avoid calling
`proto.` for Connect DSL
Key: SPARK-40971
URL: https://issues.apache.org/jira/browse/SPARK-40971
Project:
[
https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40970:
-
Description: Right now Join's on does not support a list of ColumnRef:
[df.age == df2.age, df.name ==
Rui Wang created SPARK-40970:
Summary: Support List[ColumnRef] for Join's on argument.
Key: SPARK-40970
URL: https://issues.apache.org/jira/browse/SPARK-40970
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40938:
Summary: Support Alias for every Relation
Key: SPARK-40938
URL: https://issues.apache.org/jira/browse/SPARK-40938
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40930:
Summary: Support Collect() in Python client
Key: SPARK-40930
URL: https://issues.apache.org/jira/browse/SPARK-40930
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40926:
Summary: Refactor server side tests to only use DataFrame API
Key: SPARK-40926
URL: https://issues.apache.org/jira/browse/SPARK-40926
Project: Spark
Issue Type:
Rui Wang created SPARK-40915:
Summary: Improve `on` in Join in Python client
Key: SPARK-40915
URL: https://issues.apache.org/jira/browse/SPARK-40915
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40914:
-
Summary: Mark internal API to be private[connect] (was: Mark private API
to be private[connect])
>
Rui Wang created SPARK-40914:
Summary: Mark private API to be private[connect]
Key: SPARK-40914
URL: https://issues.apache.org/jira/browse/SPARK-40914
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40883:
Summary: Support Range in Connect proto
Key: SPARK-40883
URL: https://issues.apache.org/jira/browse/SPARK-40883
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40879:
Summary: Support Join UsingColumns in proto
Key: SPARK-40879
URL: https://issues.apache.org/jira/browse/SPARK-40879
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40875:
Summary: Add .agg() to Connect DSL
Key: SPARK-40875
URL: https://issues.apache.org/jira/browse/SPARK-40875
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-40875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622510#comment-17622510
]
Rui Wang commented on SPARK-40875:
--
I am working on this.
> Add .agg() to Connect DSL
>
[
https://issues.apache.org/jira/browse/SPARK-40839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40839:
-
Summary: [Python] Implement `DataFrame.sample` (was: Implement
`DataFrame.sample`)
> [Python]
Rui Wang created SPARK-40836:
Summary: AnalyzeResult should use struct for schema
Key: SPARK-40836
URL: https://issues.apache.org/jira/browse/SPARK-40836
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40828:
Summary: Drop Python test tables before and after unit tests
Key: SPARK-40828
URL: https://issues.apache.org/jira/browse/SPARK-40828
Project: Spark
Issue Type:
Rui Wang created SPARK-40823:
Summary: Connect Proto should carry unparsed identifiers
Key: SPARK-40823
URL: https://issues.apache.org/jira/browse/SPARK-40823
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40816:
Summary: Python: rename LogicalPlan.collect to LogicalPlan.to_proto
Key: SPARK-40816
URL: https://issues.apache.org/jira/browse/SPARK-40816
Project: Spark
Issue
Rui Wang created SPARK-40813:
Summary: Add limit and offset to Connect DSL
Key: SPARK-40813
URL: https://issues.apache.org/jira/browse/SPARK-40813
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40812:
Summary: Add Deduplicate to Connect proto
Key: SPARK-40812
URL: https://issues.apache.org/jira/browse/SPARK-40812
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40809:
-
Summary: Add as(alias: String) to connect DSL (was: Add as(alias) to
connect DSL)
> Add as(alias:
Rui Wang created SPARK-40809:
Summary: Add as(alias) to connect DSL
Key: SPARK-40809
URL: https://issues.apache.org/jira/browse/SPARK-40809
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40780:
Summary: Add WHERE to Connect proto and DSL
Key: SPARK-40780
URL: https://issues.apache.org/jira/browse/SPARK-40780
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40774:
Summary: Add Sample to proto and DSL
Key: SPARK-40774
URL: https://issues.apache.org/jira/browse/SPARK-40774
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40743:
Summary: StructType should contain a list of StructField and each
field should have a name
Key: SPARK-40743
URL: https://issues.apache.org/jira/browse/SPARK-40743
Project:
Rui Wang created SPARK-40717:
Summary: Support Column Alias in connect DSL
Key: SPARK-40717
URL: https://issues.apache.org/jira/browse/SPARK-40717
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-40713:
Summary: Improve SET operation support in the proto and the server
Key: SPARK-40713
URL: https://issues.apache.org/jira/browse/SPARK-40713
Project: Spark
Issue
Rui Wang created SPARK-40707:
Summary: Add groupby to connect DSL and test more than one
grouping expressions
Key: SPARK-40707
URL: https://issues.apache.org/jira/browse/SPARK-40707
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40693:
-
Description:
This is one example:
for SparkConnectTestsPlanOnly, those unit tests access the mock
[
https://issues.apache.org/jira/browse/SPARK-40693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40693:
-
Description:
This is one example:
for SparkConnectTestsPlanOnly, those unit tests access the mock
[
https://issues.apache.org/jira/browse/SPARK-40693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-40693:
-
Description:
This is one example:
for SparkConnectTestsPlanOnly, those unit tests access the remote
Rui Wang created SPARK-40693:
Summary: mypy complains accessing the variable defined in the
class method
Key: SPARK-40693
URL: https://issues.apache.org/jira/browse/SPARK-40693
Project: Spark
Rui Wang created SPARK-40645:
Summary: Throw exception for Collect() and recommend to use
toPandas()
Key: SPARK-40645
URL: https://issues.apache.org/jira/browse/SPARK-40645
Project: Spark
Issue
Rui Wang created SPARK-40587:
Summary: SELECT * shouldn't be empty project list in proto.
Key: SPARK-40587
URL: https://issues.apache.org/jira/browse/SPARK-40587
Project: Spark
Issue Type:
Rui Wang created SPARK-40586:
Summary: Decouple plan transformation and validation on server
side
Key: SPARK-40586
URL: https://issues.apache.org/jira/browse/SPARK-40586
Project: Spark
Issue
Rui Wang created SPARK-40296:
Summary: Error Class for DISTINCT function not found
Key: SPARK-40296
URL: https://issues.apache.org/jira/browse/SPARK-40296
Project: Spark
Issue Type: Task
Rui Wang created SPARK-40055:
Summary: listCatalogs should also return spark_catalog even
spark_catalog implementation is defaultSessionCatalog
Key: SPARK-40055
URL: https://issues.apache.org/jira/browse/SPARK-40055
[
https://issues.apache.org/jira/browse/SPARK-39810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39810:
-
Summary: Catalog.tableExists should handle nested namespace (was:
tableExists can reuse getTable code)
[
https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569140#comment-17569140
]
Rui Wang commented on SPARK-39828:
--
however it seems that temp table will not be checked.
>
Rui Wang created SPARK-39828:
Summary: Catalog.listTables() should respect currentCatalog
Key: SPARK-39828
URL: https://issues.apache.org/jira/browse/SPARK-39828
Project: Spark
Issue Type:
Rui Wang created SPARK-39810:
Summary: tableExists can reuse getTable code
Key: SPARK-39810
URL: https://issues.apache.org/jira/browse/SPARK-39810
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-39700:
Summary: Deprecate API that has parameters (DBName,
tableName/FunctionName)
Key: SPARK-39700
URL: https://issues.apache.org/jira/browse/SPARK-39700
Project: Spark
Rui Wang created SPARK-39583:
Summary: Make RefreshTable be compatible with 3 layer namespace
Key: SPARK-39583
URL: https://issues.apache.org/jira/browse/SPARK-39583
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39548:
-
Summary: CreateView Command with a window clause query hit a wrong window
definition not found issue
Rui Wang created SPARK-39548:
Summary: CreateView Command with a window clause query hit a wrong
window definition not found issue.
Key: SPARK-39548
URL: https://issues.apache.org/jira/browse/SPARK-39548
Rui Wang created SPARK-39506:
Summary: CacheTable, isCached, UncacheTable, setCurrentCatalog,
currentCatalog, listCatalogs
Key: SPARK-39506
URL: https://issues.apache.org/jira/browse/SPARK-39506
Project:
Rui Wang created SPARK-39263:
Summary: GetTable, TableExists and DatabaseExists
Key: SPARK-39263
URL: https://issues.apache.org/jira/browse/SPARK-39263
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539762#comment-17539762
]
Rui Wang commented on SPARK-39236:
--
https://github.com/apache/spark/pull/36586
> Make CreateTable API
Rui Wang created SPARK-39236:
Summary: Make CreateTable API and ListTables API compatible
Key: SPARK-39236
URL: https://issues.apache.org/jira/browse/SPARK-39236
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39235:
-
Component/s: SQL
(was: Spark Core)
> Make Catalog API be compatible with
Rui Wang created SPARK-39235:
Summary: Make Catalog API be compatible with 3-layer-namespace
Key: SPARK-39235
URL: https://issues.apache.org/jira/browse/SPARK-39235
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39144:
-
Description: When we have nested subquery expressions, there is a chance
that deduplicate relations
[
https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39144:
-
Summary: Nested subquery expressions deduplicate relations should be done
bottom up (was: Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534580#comment-17534580
]
Rui Wang commented on SPARK-39144:
--
Testing in https://github.com/apache/spark/pull/36503. Will come up
Rui Wang created SPARK-39144:
Summary: Spark SQL replace wrong attributes for nested subquery
expression in which all tables are the same relation
Key: SPARK-39144
URL:
[
https://issues.apache.org/jira/browse/SPARK-39012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39012:
-
Summary: SparkSQL parse partition value does not support all data types
(was: SparkSQL infer schema
[
https://issues.apache.org/jira/browse/SPARK-39012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39012:
-
Description:
When Spark needs to infer schema, it needs to parse string to a type. Not all
data types
[
https://issues.apache.org/jira/browse/SPARK-39012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39012:
-
Description:
When Spark needs to infer schema, it needs to parse string to a type. Not all
data types
[
https://issues.apache.org/jira/browse/SPARK-39012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527767#comment-17527767
]
Rui Wang commented on SPARK-39012:
--
PR is ready to support binary type
Rui Wang created SPARK-39012:
Summary: SparkSQL Infer schema path does not support all data types
Key: SPARK-39012
URL: https://issues.apache.org/jira/browse/SPARK-39012
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-39012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-39012:
-
Summary: SparkSQL infer schema does not support all data types (was:
SparkSQL Infer schema path does
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
[
https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-38063:
-
Description:
`split_part()` is a commonly supported function by other systems such as
Postgres and
201 - 300 of 309 matches
Mail list logo
