Unsubscribe

[bruce COTTMAN]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[Dusty Williams]

Unsubscribe

unsubscribe

[madhan kumar]

unsubscribe

[Sssxxx]

unsubscribe


Sssxxx
sixliu_s...@foxmail.com

unsubscribe

[Ameet Kini]

unsubscribe

unsubscribe

[Gang Feng]

回复：unsubscribe

[yxj1141]

unsubscribe

[Chenyang Tang]

unsubscribe

Unsubscribe

[yxj1141]

Unsubscribe

unsubscribe

[bruce COTTMAN]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

unsubscribe

[Stevens, Clay]

Clay

unsubscribe

[Rajanikant V]

unsubscribe

[Ravi Chinoy]

-- 
Regards
Ravi Chinoy
Phone: (415) 230 9971

unsubscribe

[Kalpana Jalawadi]

unsubscribe

[Duy Pham]

unsubscribe

[Kalpana Jalawadi]

Unsubscribe

[Kalpana Jalawadi]

Unsubscribe

[Devarshi Vyas]

unsubscribe

[Sandeep Vinayak]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

unsubscribe

[Stefan Hagedorn]

Unsubscribe

[杨军]

Unsubscribe 

Unsubscribe

[Kiran Kumar Dusi]

Unsubscribe

unsubscribe

[ankur]

unsubscribe

[Duy Pham]

unsubscribe

unsubscribe

[chu Dragon]

unsubscribe

unsubscribe

[Duy Pham]

unsubscribe

[praveen rao joginapally]

unsubscribe

[Wei Hong]

unsubscribe

unsubscribe

[ankur]

unsubscribe

[杨军]

unsubscribe

unsubscribe

[Sairam Natarajan]

unsubscribe

unsubscribe

[Cenk Ariöz]

unsubscribe

unsubscribe

[Nizam Shaik]

unsubscribe

Unsubscribe

[Dennis Suhari]

Unsubscribe

Von meinem iPhone gesendet

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[赵军]

赵军

Unsubscribe

[Raffael Bottoli Schemmer]

Unsubscribe

Unsubscribe

[xu han]

Unsubscribe

[Denys Cherepanin]

Unsubscribe

Unsubscribe

[Dumas Hwang]

unsubscribe

[Raffael Bottoli Schemmer]

unsubscribe

Unsubscribe

[Bode, Meikel]

Unsubscribe

Unsubscribe

[Amogh Desai]

Unsubscribe

Unsubscribe

[Gary Liu]

Unsubscribe

unsubscribe

[Bhargava Sukkala]

-- 
Thanks,
Bhargava Sukkala.
Cell no:216-278-1066
MS in Business Analytics,
Arizona State University.

unsubscribe

[Bharat Kul Ratan]

unsubscribe

[Bharat Kul Ratan]

unsubscribe

[Atheer Abdullatif]

unsubscribe

unsubscribe

[Chanchal Singh]

unsubscribe

[陈功]

best wishes

unsubscribe

[Kang]

-- 


Best Regards!

Kang 

unsubscribe

[yxj1141]

unsubscribe

unsubscribe

[张洋刚]

unsubscribe

unsubscribe

[朱静]

unsubscribe

unsubscribe

[Atheer Abdullatif]

unsubscribe

Unsubscribe

[ankur]

unsubscribe

unsubscribe

[Raffael Bottoli Schemmer]

unsubscribe

unsubscribe

[报时]

unsubscribe

Unsubscribe

[Frank Luo]

Unsubscribe

Unsubscribe

[Gary Liu]

Unsubscribe

-- 
Gary Liu

unsubscribe

[Atheer Abdullatif]

unsubscribe

Unsubscribe

[Raffael Bottoli Schemmer]

unsubscribe

Unsubscribe

[Devendra Desale]

unsubscribe

Devendra Desale

Unsubscribe

[Gary Liu]

unsubscribe

-- 
Gary Liu

unsubscribe

[Shiv Prashant Sood]

On Sun, 5 Mar 2023 at 18:27, zhangliyun  wrote:

> Hi all
>
>
>   i have a spark sql  , before in  spark 2.4.2 it runs correctly, when i
> upgrade to spark 3.1.3, it has some problem.
>
>  the sql
>
>  ```
>
> select * from eds_rds.cdh_prpc63cgudba_pp_index_disputecasedetails_hourly
> where dt >= date_sub('${today}',30);
>
>
> ```
>
> it will load the data of past 30 days of table
> eds_rds.cdh_prpc63cgudba_pp_index_disputecasedetails_hourly, here
> today='2023-03-01'
>
>
> in spark2  i saw the physical plan  the partition Filter is PartitionFilters:
> [isnotnull(dt#1461), (dt#1461 >= 2023-01-31)]
>
>  +- *(4) FileScan parquet 
> eds_rds.cdh_prpc63cgudba_pp_index_disputecasedetails_hourly[disputeid#1327,statuswork#1330,opTs#1457,trailSeqno#1459,trailRba#1460,dt#1461,hr#1462]
>  Batched: true, Format: Parquet, Location: 
> PrunedInMemoryFileIndex[gs://pypl-bkt-prd-row-std-gds-non-edw-tables/apps/risk/eds/eds_risk/eds_r...,
>  PartitionCount: 805, PartitionFilters: [isnotnull(dt#1461), (dt#1461 >= 
> 2023-01-31)], PushedFilters: [IsNotNull(disputeid)], ReadSchema: 
> struct
>
>
>
> in spark3 , i saw the physical plan ,  the partitionFilter is 
> [isnotnull(dt#1602),
> (cast(dt#1602 as date) >= 19387)]
> ```
>
> (8) Scan parquet eds_rds.cdh_prpc63cgudba_pp_index_disputecasedetails_hourly
> Output [7]: [disputeid#1468, statuswork#1471, opTs#1598, trailSeqno#1600, 
> trailRba#1601, dt#1602, hr#1603]
> Batched: true
> Location: InMemoryFileIndex 
> [gs://pypl-bkt-prd-row-std-gds-non-edw-tables/apps/risk/eds/eds_risk/eds_rds/cdh/prpc63cgudba_pp_index_disputecasedetails/dt=2023-01-30/hr=00,
>  ... 784 entries]
> PartitionFilters: [isnotnull(dt#1602), (cast(dt#1602 as date) >= 19387)]
> PushedFilters: [IsNotNull(disputeid)]
> ReadSchema: 
> struct
>
>
> ```
>
> here i want to ask why there is big difference in partitionFitler in
> spark2 and spark3,  i guess most my spark configure is similar in spark2
> and spark3 to run the same sql
>

Unsubscribe

[Amogh Desai]

unsubscribe me from this mailing list

unsubscribe

[Tang Jinxin]

unsubscribe

unsubscribe

[Atheer Abdullatif]

unsubscribe

unsubscribe

[Evy M]

unsubscribe

Unsubscribe

[Dennis Jung]

Unsubscribe

Unsubscribe

[Tang Jinxin]

Unsubscribe

unsubscribe

[김병찬]

제목unsubscribe

unsubscribe

[Huajian Mao]

unsubscribe

-- 
Best Regards,
- Huajian

unsubscribe

[Devendra Desale]

unsubscribe

[Hiral Mehta]

>

unsubscribe

[Alexey Milogradov]

unsubscribe

[Ray Qiu]

unsubscribe

[马殿军]

unsubscribe


Ma Dianjun

Unsubscribe

[Dhruv Kumar]

Unsubscribe

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[Anton Solod]

Unsubscribe

Unsubscribe

[Bhavya Jain]

Unsubscribe

(send this email to unsubscribe)

[Harley Cody]

unsubscribe

[Michal Sankot]

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Unsubscribe

[Abhishek sm]

Unsubscribe

On Thu, Dec 24, 2020, 6:59 AM Shril Kumar  wrote:

> Unsubscribe
>

Unsubscribe

[Shril Kumar]

Unsubscribe

Re: Unsubscribe

[purnendu SAHA]

Unsubscribe

On Wed, Dec 23, 2020 at 10:50 PM Ruchir Gupta  wrote:

> Unsubscribe
>

Unsubscribe

[Ruchir Gupta]

Unsubscribe

Unsubscribe

[Srichand Avala]

Unsubscribe

Unsubscribe

[Eric Richardson]

Unsubscribe

Re: Unsubscribe

[dayne sorvisto]

unsubscribe


On Wed, Dec 9, 2020 at 9:31 AM Rishi Raj Tandon 
wrote:

>   Unsubscribe
>
>>

Unsubscribe

[Rishi Raj Tandon]

  Unsubscribe

>

unsubscribe

[surendra reddy]

Unsubscribe

Unsubscribe

[Bhavya Jain]

Unsubscriber

Unsubscribe

[David Zhou]

Unsubscribe

unsubscribe

[????????]

unsubscribe

unsubscribe

[Mark Daniels]

>

Unsubscribe

[Ankit Sinha]

Unsubscribe
-- 
Ankit

Re: Unsubscribe

[Rohit Mishra]

I think you have sent this request to wrong email address. I don’t want to
unsubscribe from Dev mail list. I don’t remember I have send any such
request.

Regards,
Rohit Mishra

On Tue, 23 Jun 2020 at 7:39 PM, Jeff Evans 
wrote:

> That is not how you unsubscribe.  See here:
> https://gist.github.com/jeff303/ba1906bb7bcb2f2501528a8bb1521b8e
>
> On Tue, Jun 23, 2020 at 5:02 AM Kiran Kumar Dusi 
> wrote:
>
>> Unsubscribe
>>
>> On Tue, 23 Jun 2020 at 15:18 Akhil Anil  wrote:
>>
>
>> --
>>> Sent from Gmail Mobile
>>>
>>

Re: Unsubscribe

[Jeff Evans]

That is not how you unsubscribe.  See here:
https://gist.github.com/jeff303/ba1906bb7bcb2f2501528a8bb1521b8e

On Tue, Jun 23, 2020 at 5:02 AM Kiran Kumar Dusi 
wrote:

> Unsubscribe
>
> On Tue, 23 Jun 2020 at 15:18 Akhil Anil  wrote:
>
>> --
>> Sent from Gmail Mobile
>>
>

Re: Unsubscribe

[Kiran Kumar Dusi]

Unsubscribe

On Tue, 23 Jun 2020 at 15:18 Akhil Anil  wrote:

> --
> Sent from Gmail Mobile
>

Unsubscribe

[Akhil Anil]

-- 
Sent from Gmail Mobile