+1 On Wed, Oct 21, 2026 at 10:00 AM Kousuke Saruta <[email protected]> wrote:
> +1 > > > 2026年10月21日(水) 15:09 Yang Jie <[email protected]>: > >> +1 >> >> On 2026/10/20 17:08:44 Anish Shrigondekar via dev wrote: >> > +1 (non-binding) >> > >> > Thanks Jungtaek for driving this ! >> > >> > Thanks, >> > Anish >> > >> > On Tue, Oct 20, 2026 at 10:01 AM Dongjoon Hyun <[email protected]> >> wrote: >> > >> > > +1 (binding) >> > > >> > > Thank you for driving this, Jungtaek. On-demand lookups fill a real >> gap >> > > for Real-Time Mode, and the DSv2 sketch and the stream-static scope >> address >> > > my main concerns from the DISCUSS thread. >> > > >> > > I'd appreciate it if the doc could be updated to match what we agreed >> in >> > > the thread, so that it stays the reference for the implementation: >> > > >> > > - For sources supporting both `BATCH_READ` and `EXTERNAL_LOOKUP`, the >> > > default stays the existing join strategies (Oct 15). Q4, Q6, and Q8 >> still >> > > say that Spark chooses the lookup join automatically, and the sentence >> > > about the default behavior in Appendix A is cut off. >> > > - Stream-static joins fall back to `BATCH_READ` instead of failing >> (Oct 8). >> > > - The cache is tied to the task lifecycle, and the hint options >> override >> > > the SQL configs (Oct 8 and Oct 16). >> > > >> > > Dongjoon. >> > > >> > > >> > > On 2026/10/20 12:51:57 Jungtaek Lim wrote: >> > > > Starting from my +1 (non-binding) >> > > > >> > > > On Tue, Oct 20, 2026 at 12:04 PM Jungtaek Lim < >> > > [email protected]> >> > > > wrote: >> > > > >> > > > > Hi devs, >> > > > > >> > > > > I would live to start a vote on introducing external lookup join, >> as >> > > > > proposed. >> > > > > >> > > > > JIRA ticket: https://issues.apache.org/jira/browse/SPARK-60031 >> > > > > SPIP doc: >> > > > > >> > > >> https://docs.google.com/document/d/1fBPM5cku8UJXacG2fw9df1zqALJ-WFm8E9-b9oiFP5M/edit?tab=t.0 >> > > > > Discussion thread: >> > > > > >> https://lists.apache.org/thread.html/7s6tgy9cm18jnzykr8htrtrw4nxyrhp1 >> > > > > >> > > > > The vote will be open for at least 72 hours, and passes if a >> majority >> > > +1 >> > > > > PMC >> > > > > votes are cast, with a minimum of 3 +1 votes. >> > > > > >> > > > > Please vote: >> > > > > [ ] +1: Accept the proposal as an official SPIP >> > > > > [ ] +0 >> > > > > [ ] -1: I don't think this is a good idea because ... >> > > > > >> > > > > Thanks, >> > > > > Jungtaek Lim (HeartSaVioR) >> > > > > >> > > > >> > > >> > > --------------------------------------------------------------------- >> > > To unsubscribe e-mail: [email protected] >> > > >> > > >> > >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: [email protected] >> >>
