Re: Plans for Schema Evolution in Table API

2023-08-17 Thread Jing Ge
Hi Ashish, Table API has many restrictions. Even if the source schema has been changed in a compatible manner from the database's perspective, the added column should not be used in the downstream operators, e.g. join. In case schema evolution is required in your business, you might want to

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread liu ron
Hi, Ashish As Timo said, the community currently doesn't have plan to support schema evolution in Table API, Best, Ron Timo Walther 于2023年8月15日周二 23:29写道: > Hi Ashish, > > sorry for the late reply. There are currently no concrete plans to > support schema evolution in Table API. Until

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread Timo Walther
Hi Ashish, sorry for the late reply. There are currently no concrete plans to support schema evolution in Table API. Until recently, Flink version evolution was the biggest topic. In the near future we can rediscuss query and state evolution in more detail. Personally, I think we will need

Re: Plans for Schema Evolution in Table API

2023-08-14 Thread Ashish Khatkar
Bumping the thread. On Fri, Aug 4, 2023 at 12:51 PM Ashish Khatkar wrote: > Hi all, > > We are using flink-1.17.0 table API and RocksDB as backend to provide a > service to our users to run sql queries. The tables are created using the > avro schema and when the schema is changed in a

Plans for Schema Evolution in Table API

2023-08-04 Thread Ashish Khatkar
Hi all, We are using flink-1.17.0 table API and RocksDB as backend to provide a service to our users to run sql queries. The tables are created using the avro schema and when the schema is changed in a compatible manner i.e adding a field with default, we are unable to recover the job from the