unsubscribe

-- *M Akram Azarm* *B Eng. in Software Engineering (Reading)* *UOW,UK / IIT,LK* Contact | 077-502-0402

Re: Error while reading hive tables with tmp/hidden files inside partitions

This looks like a bug that path filter doesn't work for hive table reading. Can you open a JIRA ticket? On Thu, Apr 23, 2020 at 3:15 AM Dhrubajyoti Hati wrote: > Just wondering if any one could help me out on this. > > Thank you! > > > > > *Regards,Dhrubajyoti Hati.* > > > On Wed, Apr 22, 2020

Re: Getting the ball started on a 2.4.6 release

We have a conclusion now and we decide to include SPARK-31509 in the PR of SPARK-31485. So there actually should be only one candidate(But to be honest, it still depends on committers). Best, Yi Wu -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

Re: Error while reading hive tables with tmp/hidden files inside partitions

Just wondering if any one could help me out on this. Thank you! *Regards,Dhrubajyoti Hati.* On Wed, Apr 22, 2020 at 7:15 PM Dhrubajyoti Hati wrote: > Hi, > > Is there any way to discard files starting with dot(.) or ending with .tmp > in the hive partition while reading from Hive table

Re: Getting the ball started on a 2.4.6 release

Thanks, I agree improving that error message instead of hanging could be a good candidate for backporting to 2.4 On Tue, Apr 21, 2020 at 6:43 PM wuyi wrote: > I have one: https://issues.apache.org/jira/browse/SPARK-31485, which could > cause application hang. > > > And, probably, also

unsubscribe

SPIP: Catalog API for view metadata

Hi everyone, In order to disassociate view metadata from Hive Metastore and support different storage backends, I am proposing a new view catalog API to load, create, alter, and drop views. Document: https://docs.google.com/document/d/1XOxFtloiMuW24iqJ-zJnDzHl2KMxipTjJoxleJFz66A/edit?usp=sharing