Sounds a good idea. Thanks Radar for taking care of that!
Best regards, Ruilong Huo At 2018-07-09 16:02:54, "Radar Lei" <[email protected]> wrote: >Hi Ruilong, > >As there are no further comments on this topic, I will remove the >feature 'Support >accessing Hive table data by Pluggable Storage Framework' from current >Apache HAWQ 2.4.0.0-incubating release. > >The updated features including in current release are listed as: > > - New Feature: Pluggable Vectorized Execution Engine on HAWQ. > - New Feature: Support Runtime Filter for HAWQ local hash join. > > >Since the two list features are all completed, I will start the release >process soon. > >Thanks. > > >Regards, >Radar > >On Tue, Jul 3, 2018 at 9:18 AM, HuoRuilong <[email protected]> wrote: > >> Exactly, Ed. The plan is to split the work and make them available in >> subsequent releases. For now, there are five sub tasks tracking them >> (HAWQ-1628 ~ HAWQ-1632). Though we might separate them even more as we go >> deeper with it. >> >> In fact, the work for the initial task has been started. We might discuss >> which releases these features will fit into as we drafting the plan for >> future releases. >> >> >> Best regards, >> Ruilong >> >> >> At 2018-07-02 22:27:52, "Ed Espino" <[email protected]> wrote: >> >Thanks for bring this up Ruilong. Given your input, It is reasonable to >> >remove the pluggable storage framework features from 2.4.0.0. To keep the >> >momentum going, going forward, can we separate the work and incrementally >> >commit prerequisite work over several releases? >> > >> >-=e >> > >> >On Mon, Jul 2, 2018 at 2:34 AM Radar Lei <[email protected]> wrote: >> > >> >> Hi Ruilong, >> >> >> >> Thanks for the update, for me, I'm fine with removing this feature from >> >> 2.4.0.0 release since the scope is bigger than expected. >> >> >> >> And we still have Vectorized Execution and Runtime Filter features in >> this >> >> release, they are good enough to make a new release. >> >> >> >> Regards, >> >> Radar >> >> >> >> On Mon, Jul 2, 2018 at 4:03 PM, Ruilong Huo <[email protected]> wrote: >> >> >> >> > Hi Radar and All, >> >> > >> >> > >> >> > Had a closer look at the plan for Apache HAWQ 2.4.0.0 release, it >> turns >> >> > out that the support of Hive data access in pluggable storage >> framework >> >> has >> >> > larger content than expected. In fact, to make Hive protocol >> available, >> >> the >> >> > prerequisite need to be done at first, which including HDFS protocol, >> >> ORC, >> >> > TEXT/CSV format, etc. The corresponding task have been added in >> umbrella >> >> > feature HAWQ-786 as below: >> >> > >> >> > >> >> > HAWQ-1628: Support HDFS protocol using pluggable storage framework >> >> > HAWQ-1629: Support ORC format using pluggable storage framework >> >> > HAWQ-1630: Support TEXT/CSV format using pluggable storage framework >> >> > HAWQ-1631: Support Hive protocol using pluggable storage framework >> >> > HAWQ-1632: Wrap up pluggable storage framework and HDFS/Hive >> >> ORC/TEXT/CSV >> >> > support >> >> > >> >> > >> >> > Given that, I think it will be better if we can release 2.4.0.0 >> without >> >> > this feature for now and accommodate it to subsequent releases. Any >> >> comment? >> >> > >> >> > >> >> > Best regards, >> >> > Ruilong Huo >> >> > >> >> > >> >> > >> >> > >> >> > >> >> > >> >> >>
