?????? Flink??????????Hive??????????????????

Mon, 09 Dec 2019 19:15:13 -0800 

https://github.com/hiliuxg/flink-orc-sink ????????????hdfs orc????????exectly 
once




------------------ ???????? ------------------
??????: "jingwen jingwen"<[email protected]&gt;; 
????????: 2019??12??10??(??????) ????11:12
??????: "user-zh"<[email protected]&gt;; 
????: Re: Flink??????????Hive??????????????????



hbase????????????????????????????/??????????????????????????????????????????????????
????????????hdfs????????????????????

???? <[email protected]&gt; ??2019??12??10?????? ????8:21??????

&gt; 1. ????Parquet??????StreamingFileSink????ORC????????????????
&gt; 2. BulkWriter??????????????????????
&gt;
&gt; JingsongLee <[email protected]&gt; ??2019??12??9?????? 
????3:24??????
&gt;
&gt; &gt; Hi ????
&gt; &gt; - ????????????????StreamingFileSink????????????Parquet??
&gt; &gt; (????????StreamingFileSink????ORC??????)
&gt; &gt; - BulkWriter????????????????????????StreamingFileSink????????????
&gt; &gt; - ????sync hive??????????????????????????StreamingFileSink????????????
&gt; &gt;
&gt; &gt; 
??1.11????Table????????????????????????????????????hive??????????????????????????????????????????????[1]
&gt; &gt;
&gt; &gt; [1] https://issues.apache.org/jira/browse/FLINK-14249
&gt; &gt;
&gt; &gt; Best,
&gt; &gt; Jingsong Lee
&gt; &gt;
&gt; &gt;
&gt; &gt; ------------------------------------------------------------------
&gt; &gt; From:???? <[email protected]&gt;
&gt; &gt; Send Time:2019??12??8??(??????) 10:04
&gt; &gt; To:[email protected] <[email protected]&gt;
&gt; &gt; Subject:Flink??????????Hive??????????????????
&gt; &gt;
&gt; &gt; ??????????????HBase??????Hive????Hbase??
&gt; &gt; ????????????????????HDFS????????Hive????????????????????????????????
&gt; &gt;
&gt; &gt; 1. 
??????????????????????????????StreamingFileSink??????????????????????????????????Parquet??ORC)
&gt; &gt; ??????????????????????????Streaming
&gt; &gt; Writer????????????????
&gt; &gt; 
BulkWriter????????????????????????????????????????????????????????????????????????????StreamingWriter????????
&gt; &gt; ????????Update??Delete???? ??????????????sync??Hive????
&gt; &gt;
&gt; &gt; 2. ????HDFS????????????????Hive????????????????????????Flink 
ETL??????????????????
&gt; &gt;
&gt;

回复