[
https://issues.apache.org/jira/browse/KNOX-2310?focusedWorklogId=410738&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-410738
]
ASF GitHub Bot logged work on KNOX-2310:
----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Mar/20 00:21
Start Date: 27/Mar/20 00:21
Worklog Time Spent: 10m
Work Description: lmccay commented on pull request #302: KNOX-2310
URL: https://github.com/apache/knox/pull/302
(It is very **important** that you created an Apache Knox JIRA for this
change and that the PR title/commit message includes the Apache Knox JIRA ID!)
## What changes were proposed in this pull request?
A simple method for producing a meaningful mathematical report of a dataset
would allow the user to quickly determine some basic metrics of a dataset.
For instance, given a dataset with time series data across columns, an
aggregation of:
min
max
mean
median
mode
sum
for specific columns would provide a way to visualize the changes across
time.
knox:000> test.aggregate() columns "A,B,C" functions "min, max, mean,
median, mode,sum"
===> +----------+----------------------+----------+----------+
| | A | B | C |
+----------+----------------------+----------+----------+
| min | 100.0 | 200.0 | 300.0 |
| max | 200.0 | 400.0 | 500.0 |
| mean | 166.66666666666666 | 300.0 | 400.0 |
| median | 200.0 | 300.0 | 400.0 |
| mode | 200.0 | 200.0 | 300.0 |
| sum | 500.0 | 900.0 | 1200.0 |
+----------+----------------------+----------+----------+
## How was this patch tested?
Added new unit test and ran existing unit tests.
Tested manually in KnoxShell.
(Please explain how this patch was tested. For instance: running automated
unit/integration tests, manual tests. Please write down your test steps as
detailed as possible)
(If this patch involves UI changes, please attach a screen-shot; otherwise,
remove this)
Please review [Knox Contributing
Process](https://cwiki.apache.org/confluence/display/KNOX/Contribution+Process#ContributionProcess-GithubWorkflow)
before opening a pull request.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 410738)
Remaining Estimate: 0h
Time Spent: 10m
> Add aggregate method to KnoxShellTable
> --------------------------------------
>
> Key: KNOX-2310
> URL: https://issues.apache.org/jira/browse/KNOX-2310
> Project: Apache Knox
> Issue Type: Improvement
> Components: KnoxShell
> Reporter: Larry McCay
> Assignee: Larry McCay
> Priority: Major
> Fix For: 1.4.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> A simple method for producing a meaningful mathematical report of a dataset
> would allow the user to quickly determine some basic metrics of a dataset.
> For instance, given a dataset with time series data across columns, an
> aggregation of:
> * min
> * max
> * mean
> * median
> * mode
> * sum
> for specific columns would provide a way to visualize the changes across time.
> {code}
> knox:000> hopkinsC19.filter() name "Country/Region" equalTo "US" aggregate()
> columns "3/15/20, 3/16/20, 3/17/20, 3/18/20, 3/19/20, 3/20/20, 3/21/20"
> functions "min, max, mean, median, mode, sum" title "Confirmed COVID-19 US
> Cases over the last Week"
> ===> Confirmed COVID-19 US Cases over the last Week
> +----------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+
> | | 3/15/20 | 3/16/20 | 3/17/20
> | 3/18/20 | 3/19/20 | 3/20/20 |
> 3/21/20 |
> +----------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+
> | min | 0.0 | 0.0 | 1.0
> | 1.0 | 2.0 | 3.0 |
> 3.0 |
> | max | 732.0 | 967.0 | 1706.0
> | 2495.0 | 5365.0 | 8310.0 |
> 11710.0 |
> | mean | 62.482142857142826 | 82.71428571428568 |
> 114.66071428571433 | 138.98214285714295 | 244.23214285714275 |
> 341.0714285714283 | 455.1607142857145 |
> | median | 20.0 | 24.0 | 31.0
> | 40.5 | 56.0 | 79.0 |
> 120.0 |
> | mode | 1.0 | 1.0 | 3.0
> | 18.0 | 44.0 | 14.0 |
> 15.0 |
> | sum | 3499.0 | 4632.0 | 6421.0
> | 7783.0 | 13677.0 | 19100.0 |
> 25489.0 |
> +----------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+----------------------+
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
