Lobo2008 commented on PR #29350:
URL: https://github.com/apache/spark/pull/29350#issuecomment-1230313321

   > application
   
   
   
   > Hi, @Lobo2008 . Could you file a new JIRA issue with the stack trace or 
logs?
   
   Hi @dongjoon-hyun , Sorry that I misunderstood this PR.  What I came across 
is that there are always some  event logs cannot be seen from SHS.  
   * in HDFS:  `hadoop fs -ls hdfs://xxxx/eventLog/* |grep -v 'inprogress'|wc 
-l`  gets `57307`
   * in SHS:  `Showing 1 to 20 of 57,258 entries `,49 apps missed
   
   These 49 event logs maybe ok because  when I 
   * `hadoop cp app_123`  to `app_123_2.inprogess ` 
   * then `hadoop mv app_123_2.inprogess` to `app_123_2`
   * `app_123`  appears  in SHS   
   
   This PR is skipping  these 49 apps not resolving them.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to