sandugood commented on PR #1547: URL: https://github.com/apache/datafusion-ballista/pull/1547#issuecomment-4224699537
> <img alt="image" width="1408" height="848" src="https://private-user-images.githubusercontent.com/956287/576642888-07c26052-65aa-49fe-bf98-f0eb3ef3b84f.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzU4MzM0MzUsIm5iZiI6MTc3NTgzMzEzNSwicGF0aCI6Ii85NTYyODcvNTc2NjQyODg4LTA3YzI2MDUyLTY1YWEtNDlmZS1iZjk4LWYwZWIzZWYzYjg0Zi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNDEwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDQxMFQxNDU4NTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hOThmMjEzYmFhODcyZTg1NTlhNDg2NjQ1ZTM4NDhlMDA3NTY1ZWYzZTg0ZmM1N2NhMjdhZjkwZWM3MmNiZjg3JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.3iYwJOyiHY7BidCaxfFG63mrvt7jSFkCyPDtzm9Jd7k";> > just for reference, what spark exposes on executor page Thank you for the response I think it seems somewhat close to that of Spark, because we got: 1. Executor Cores - we get it when we are registering the executor in the scheduler 2. Active/Failed/Complete - through the TaskStatus specification, as well as ShuffleWrite stats 3. Memory (RAM) stats (from this PR) Is adding disk info to that a good idea? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
![https://private-user-images.githubusercontent.com/956287/576642888-07c26052-65aa-49fe-bf98-f0eb3ef3b84f.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzU4MzM0MzUsIm5iZiI6MTc3NTgzMzEzNSwicGF0aCI6Ii85NTYyODcvNTc2NjQyODg4LTA3YzI2MDUyLTY1YWEtNDlmZS1iZjk4LWYwZWIzZWYzYjg0Zi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNDEwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDQxMFQxNDU4NTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hOThmMjEzYmFhODcyZTg1NTlhNDg2NjQ1ZTM4NDhlMDA3NTY1ZWYzZTg0ZmM1N2NhMjdhZjkwZWM3MmNiZjg3JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.3iYwJOyiHY7BidCaxfFG63mrvt7jSFkCyPDtzm9Jd7k"](https://private-user-images.githubusercontent.com/956287/576642888-07c26052-65aa-49fe-bf98-f0eb3ef3b84f.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzU4MzM0MzUsIm5iZiI6MTc3NTgzMzEzNSwicGF0aCI6Ii85NTYyODcvNTc2NjQyODg4LTA3YzI2MDUyLTY1YWEtNDlmZS1iZjk4LWYwZWIzZWYzYjg0Zi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjYwNDEwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI2MDQxMFQxNDU4NTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hOThmMjEzYmFhODcyZTg1NTlhNDg2NjQ1ZTM4NDhlMDA3NTY1ZWYzZTg0ZmM1N2NhMjdhZjkwZWM3MmNiZjg3JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.3iYwJOyiHY7BidCaxfFG63mrvt7jSFkCyPDtzm9Jd7k"){kind=link}