Why don’t you write them directly on local storage and then write them all to 
HDFS?

Then you can create an external table in Hive on them and do analyses

> Am 20.03.2020 um 08:30 schrieb "wangl...@geekplus.com.cn" 
> <wangl...@geekplus.com.cn>:
> 
> 
> https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest+V2
> 
> I want to stream my app log to Hive using flume on the edge app server.
> Since HDFS is not friendly to frequently write, I am afraid this way can not 
> bear  high throuthput.
> 
> Any suggesions on this?
> 
> Thanks,
> Lei
> 
> wangl...@geekplus.com.cn 
> 

Reply via email to