you sort by the partition key to
> ensure the partitions match up? Thinking of olden times :)
>
> On Fri, Dec 23, 2022 at 4:42 AM Shivam Verma
> wrote:
>
>> Hi Gurunandan,
>>
>> Thanks for the reply!
>>
>> I do see the exchange operator in the SQL tab, bu
the executed plan and validate for Exchange
> Operator in the Physical Plan.
>
> On Wed, Dec 14, 2022 at 10:56 AM Shivam Verma
> wrote:
> >
> > Hello folks,
> >
> > I have a use case where I save two pyspark dataframes as parquet files
> and then use them lat
Hello folks,
I have a use case where I save two pyspark dataframes as parquet files and
then use them later to join with each other or with other tables and
perform multiple aggregations.
Since I know the column being used in the downstream joins and groupby, I
was hoping I could use
