[jira] [Updated] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-22 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Summary: Add PushProjectionThroughLimit for Optimizer  (was: Add 
pushProjectionThroughLimit for optimizer)

> Add PushProjectionThroughLimit for Optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out, still running after 20 minutes...
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-40501) Add pushProjectionThroughLimit for optimizer

2022-09-22 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Summary: Add pushProjectionThroughLimit for optimizer  (was: Add 
PushProjectionThroughLimit for Optimizer)

> Add pushProjectionThroughLimit for optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out, still running after 20 minutes...
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-22 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Summary: Add PushProjectionThroughLimit for Optimizer  (was: Enhance 
'SpecialLimits' to support project(..., limit(...)))

> Add PushProjectionThroughLimit for Optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out, still running after 20 minutes...
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-20 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Description: 
h4. It took a long time to fetch out, still running after 20 minutes...

when run as follow code in spark-shell:

spark.sql("select * from xxx where event_day = '20220919' limit 1").show()

[!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
[!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]

  was:
h4. It took a long time to fetch out

when run as follow code in spark-shell:

spark.sql("select * from xxx where event_day = '20220919' limit 1").show()


[!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
[!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]


> Add PushProjectionThroughLimit for Optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out, still running after 20 minutes...
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-20 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Summary: Add PushProjectionThroughLimit for Optimizer  (was: add 
PushProjectionThroughLimit for Optimizer)

> Add PushProjectionThroughLimit for Optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-40501) add PushProjectionThroughLimit for Optimizer

2022-09-20 Thread BingKun Pan (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

BingKun Pan updated SPARK-40501:

Description: 
h4. It took a long time to fetch out

when run as follow code in spark-shell:

spark.sql("select * from xxx where event_day = '20220919' limit 1").show()


[!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
[!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]

> add PushProjectionThroughLimit for Optimizer
> 
>
> Key: SPARK-40501
> URL: https://issues.apache.org/jira/browse/SPARK-40501
> Project: Spark
>  Issue Type: Improvement
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: BingKun Pan
>Priority: Minor
>
> h4. It took a long time to fetch out
> when run as follow code in spark-shell:
> spark.sql("select * from xxx where event_day = '20220919' limit 1").show()
> [!https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png|width=557!|https://user-images.githubusercontent.com/15246973/191211875-c29c3bae-1339-414b-84bc-2195545b8c35.png]
> [!https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png|width=1419!|https://user-images.githubusercontent.com/15246973/191212244-22108810-dd66-46bd-bea7-a7dab70a1a06.png]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org