The first linked reference is the PR for spec update. [3] https://github.com/apache/iceberg/pull/9728
On Wed, Feb 14, 2024 at 3:36 PM Steven Wu <stevenz...@gmail.com> wrote: > We just ran out of time and didn't get a chance to discuss this in the > community sync meeting today. Hence, I am raising the discussion here. > > We added JSON parsers for content file and file scan task a year ago [1]. > Recently, I just realized the implementation only handles BaseFileScanTask. > It would fail if the FileScanTask is some other implementation (like > StaticDataTask). > > Eduard, Anton, and I have been discussing a solution in issue-9597 [2]. We > reached a consensus that we need to define a new `task-type` enum field to > indicate the implementation class/type [3]. For backward compatibility, the > lack of this new `task-type` field should be interpreted as > `base-file-task`. > > Since this is a spec change, Anton suggested more visibility. Hence I am > starting this discussion thread. > > [1] https://github.com/apache/iceberg/pull/6934 > [2] https://github.com/apache/iceberg/issues/9597 > [3] https://github.com/apache/iceberg/pull/9728 >
