Hi, Current implementation of HiveOperator <https://github.com/apache/incubator-apex-malhar/blob/master/contrib/src/main/java/com/datatorrent/contrib/hive/HiveOperator.java> is extended from AbstractStoreOutputOperator <https://github.com/apache/incubator-apex-malhar/blob/master/library/src/main/java/com/datatorrent/lib/db/AbstractStoreOutputOperator.java>. We have instance of store in AbstractStoreOutputOperator <https://github.com/apache/incubator-apex-malhar/blob/master/library/src/main/java/com/datatorrent/lib/db/AbstractStoreOutputOperator.java#L44>. Additionally, HiveOperator <https://github.com/apache/incubator-apex-malhar/blob/master/contrib/src/main/java/com/datatorrent/contrib/hive/HiveOperator.java> declares another field for store.
I am thinking of removing this redundant field from HiveOperator. But, this field is protected; thus, removing it would result in backward compatibility issue. Any recommendations/suggestions on how should I go about this? ~ Yogi On 12 May 2016 at 11:01, Yogi Devendra <[email protected]> wrote: > Created https://issues.apache.org/jira/browse/APEXMALHAR-2087 for > tracking this. > > ~ Yogi > > On 11 May 2016 at 22:23, Priyanka Gugale <[email protected]> wrote: > >> +1, it would be easy to use hive operator if we combine the required >> operator together. >> >> -Priyanka >> >> On Wed, May 11, 2016 at 3:27 AM, Mohit Jotwani <[email protected]> >> wrote: >> >> > +1 >> > >> > Regards, >> > Mohit >> > >> > >> > >> > On Wed, May 11, 2016 at 3:55 PM, Yogi Devendra <[email protected] >> > >> > wrote: >> > >> > > Hi, >> > > >> > > Currently, applications which needs to write to Hive have to include 2 >> > > operators FSPojoToHiveOperator, HiveOperator from malhar-contrib in >> the >> > > application DAG. [First operator writes to HDFS; second operator loads >> > > files from HDFS to hive]. >> > > >> > > I am proposing to wrap these two operators into a >> > Module/CompositeOperator. >> > > So that, end user can directly include this module into application. >> > > >> > > Any feedback? >> > > >> > > ~ Yogi >> > > >> > >> > >
