GitHub user paragpc opened a pull request:
https://github.com/apache/spark/pull/11867
[SPARK-14049] [CORE] Add functionality in spark history sever API to query
applications by end time
## What changes were proposed in this pull request?
Currently, spark history server provides functionality to query
applications by application start time range based on minDate and maxDate query
parameters, but it lacks support to query applications by their end time. In
this pull request we are proposing optional minEndDate and maxEndDate query
parameters and filtering capability based on these parameters to spark history
server. This functionality can be used for following queries,
1. Applications finished in last 'x' minutes
2. Applications finished before 'y' time
3. Applications finished between 'x' time to 'y' time
4. Applications started from 'x' time and finished before 'y' time.
For backward compatibility, we can keep existing minDate and maxDate query
parameters as they are and they can continue support filtering based on start
time range.
## How was this patch tested?
Existing unit tests and 4 new unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/paragpc/spark master-SHS-query-by-endtime_2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11867.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11867
----
commit ec9999fcb4aabefd9b26462cb0b3c0914d6a9ea9
Author: Parag Chaudhari <[email protected]>
Date: 2016-03-15T17:25:46Z
Merge pull request #1 from apache/master
Update from original repository
commit 4b617b257c4285e32af5bd8300e78932e4761fce
Author: Parag Chaudhari <[email protected]>
Date: 2016-03-16T01:51:07Z
Added functionality in spark history server to query applications by endTime
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
