SbloodyS opened a new issue #5466:
URL: https://github.com/apache/dolphinscheduler/issues/5466


   /usr/local/service/flume/bin/flume-ng agent -c 
/usr/local/service/flume/conf/ -f 
/data/dolphinscheduler/data/hadoop/resources/appsflyer/appsflyer_flume.properties
 -n agent -Dflume.root.logger=INFO,console
   
   
   
![image](https://user-images.githubusercontent.com/17822915/118210194-b46ef300-b49c-11eb-9355-80c3242a370a.png)
   
   
   Start the Flume agent with above shell command. After it has written a few 
files to HDFS, kill it using webui kill command. Check the hdfs dir. There will 
be a .tmp file. If we restart the Flume agent, it will resume writing data to 
HDFS, but it will not close/cleanup the .tmp file.
   
   I think the correct scenario is that use kill -15 instead of of kill -9, so 
that flume agent can exit gracefully and it can perform these tasks before 
stopping the agent.
   
   **Which version of DolphinScheduler:**
    -[1.3.6]
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to