Re: Spark: Support CREATE TABLE LIKE

2026-03-17 Thread Anton Okolnychyi 
Help review the Spark change and let's get it in for 4.2, please.

пн, 16 бер. 2026 р. о 21:28 Anurag Mantripragada <
[email protected]> пише:

> Hi Szehon,
>
> Great timing. This is indeed the same feature Max intended to add via
> Iceberg extensions. Supporting this directly in Spark is the correct
> approach. I will update the Iceberg PR. We can likely close it and wait for
> the Spark support to be implemented.
>
> ~ Anurag
>
> On Mon, Mar 16, 2026 at 1:17 PM Szehon Ho  wrote:
>
>> Hi all
>>
>> FYI, looks like Liangchi has a PR on the Spark side, is it related?
>> https://github.com/apache/spark/pull/54809
>> .
>>
>> Thanks
>> Szehon
>>
>> On Mon, Mar 16, 2026 at 11:03 AM Anurag Mantripragada <
>> [email protected]> wrote:
>>
>>> Hi Max,
>>>
>>> We discussed this PR during the Iceberg-Spark Community Sync
>>> ,
>>> but I missed updating the PR with the details. The general conclusion from
>>> the meeting was that the community is moving away from extensions because
>>> they are fragile and difficult to maintain within Iceberg. However, I
>>> personally believe that CTAS is useful, and we should consider adding it to
>>> Spark if it is currently unsupported.
>>>
>>> I would like to hear from other Spark experts on this thread before we
>>> decide whether to proceed.
>>>
>>> ~ Anurag
>>>
>>> On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov <
>>> [email protected]> wrote:
>>>
 Hello,

 Can anybody spend the time reviewing my PR for adding that feature?
 Not sure why it was ignored by original reviewers but let me know if
 it's obsolete, no longer needed, or so low priority that no one cares.

 https://github.com/apache/iceberg/pull/14269


 Max.

>>>

Re: Spark: Support CREATE TABLE LIKE

2026-03-16 Thread Anurag Mantripragada 
Hi Szehon,

Great timing. This is indeed the same feature Max intended to add via
Iceberg extensions. Supporting this directly in Spark is the correct
approach. I will update the Iceberg PR. We can likely close it and wait for
the Spark support to be implemented.

~ Anurag

On Mon, Mar 16, 2026 at 1:17 PM Szehon Ho  wrote:

> Hi all
>
> FYI, looks like Liangchi has a PR on the Spark side, is it related?
> https://github.com/apache/spark/pull/54809
> .
>
> Thanks
> Szehon
>
> On Mon, Mar 16, 2026 at 11:03 AM Anurag Mantripragada <
> [email protected]> wrote:
>
>> Hi Max,
>>
>> We discussed this PR during the Iceberg-Spark Community Sync
>> ,
>> but I missed updating the PR with the details. The general conclusion from
>> the meeting was that the community is moving away from extensions because
>> they are fragile and difficult to maintain within Iceberg. However, I
>> personally believe that CTAS is useful, and we should consider adding it to
>> Spark if it is currently unsupported.
>>
>> I would like to hear from other Spark experts on this thread before we
>> decide whether to proceed.
>>
>> ~ Anurag
>>
>> On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov <
>> [email protected]> wrote:
>>
>>> Hello,
>>>
>>> Can anybody spend the time reviewing my PR for adding that feature?
>>> Not sure why it was ignored by original reviewers but let me know if
>>> it's obsolete, no longer needed, or so low priority that no one cares.
>>>
>>> https://github.com/apache/iceberg/pull/14269
>>>
>>>
>>> Max.
>>>
>>

Re: Spark: Support CREATE TABLE LIKE

2026-03-16 Thread Szehon Ho 
Hi all

FYI, looks like Liangchi has a PR on the Spark side, is it related?
https://github.com/apache/spark/pull/54809
.

Thanks
Szehon

On Mon, Mar 16, 2026 at 11:03 AM Anurag Mantripragada <
[email protected]> wrote:

> Hi Max,
>
> We discussed this PR during the Iceberg-Spark Community Sync
> ,
> but I missed updating the PR with the details. The general conclusion from
> the meeting was that the community is moving away from extensions because
> they are fragile and difficult to maintain within Iceberg. However, I
> personally believe that CTAS is useful, and we should consider adding it to
> Spark if it is currently unsupported.
>
> I would like to hear from other Spark experts on this thread before we
> decide whether to proceed.
>
> ~ Anurag
>
> On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov <
> [email protected]> wrote:
>
>> Hello,
>>
>> Can anybody spend the time reviewing my PR for adding that feature?
>> Not sure why it was ignored by original reviewers but let me know if it's
>> obsolete, no longer needed, or so low priority that no one cares.
>>
>> https://github.com/apache/iceberg/pull/14269
>>
>>
>> Max.
>>
>

Re: Spark: Support CREATE TABLE LIKE

2026-03-16 Thread Anurag Mantripragada 
Hi Max,

We discussed this PR during the Iceberg-Spark Community Sync
,
but I missed updating the PR with the details. The general conclusion from
the meeting was that the community is moving away from extensions because
they are fragile and difficult to maintain within Iceberg. However, I
personally believe that CTAS is useful, and we should consider adding it to
Spark if it is currently unsupported.

I would like to hear from other Spark experts on this thread before we
decide whether to proceed.

~ Anurag

On Sun, Mar 15, 2026 at 8:58 PM Max Konstantinov <
[email protected]> wrote:

> Hello,
>
> Can anybody spend the time reviewing my PR for adding that feature?
> Not sure why it was ignored by original reviewers but let me know if it's
> obsolete, no longer needed, or so low priority that no one cares.
>
> https://github.com/apache/iceberg/pull/14269
>
>
> Max.
>