[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220131#comment-16220131 ] ASF GitHub Bot commented on METRON-1224: Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/796 > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220130#comment-16220130 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 +1 > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220129#comment-16220129 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 + 1. Gret job. all pass login to application ✓ should display error message for invalid credentials ✓ should login for valid credentials ✓ should logout metron-alerts App ✓ should have all the UI elements ✓ should have all pagination controls and they should be working ✓ should have all settings controls and they should be working ✓ play pause should start polling and stop polling ✓ should select columns from table configuration ✓ should have all time-range controls ✓ should have all time range values populated - 1 ✓ should have all time range values populated - 2 ✓ should have all time range values populated - 3 ✓ should have all time range values populated - 4 ✓ should disable date picker when timestamp is present in search ✓ should have now included when to date is empty ✓ should have all time-range included while searching metron-alerts configure table ✓ should select columns from table configuration ✓ should rename columns from table configuration metron-alerts Search ✓ should display all the default values for saved searches ✓ should have all save search controls and they save search should be working ✓ should populate search items when selected on table ✓ should delete search items from search box ✓ should delete first search items from search box having multiple search fields ✓ manually entering search queries to search box and pressing enter key should search metron-alerts tree view ✓ should have all group by elements ✓ drag and drop should change group order ✓ should have group details for single group by ✓ should have group details for multiple group by ✓ should have sort working for group details for multiple sub groups ✓ should have search working for group details for multiple sub groups metron-alerts facets ✓ should display facets data ✓ should expand all facets ✓ should have all facet values ✓ should collapse all facets metron-alerts alert status ✓ should change alert status for multiple alerts to OPEN ✓ should change alert status for multiple alerts to DISMISS ✓ should change alert status for multiple alerts to ESCALATE ✓ should change alert status for multiple alerts to RESOLVE ✓ should change alert status for multiple alerts to OPEN in tree view metron-alerts alert status ✓ should change alert statuses ✓ should add comments for table view ✓ should add comments for tree view Executed 42 of 42 specs SUCCESS in 5 mins 2 secs. [01:01:00] I/launcher - 0 instance(s) of WebDriver still running [01:01:00] I/launcher - chrome #01 passed > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220113#comment-16220113 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 login to application ✓ should display error message for invalid credentials ✓ should login for valid credentials ✓ should logout metron-alerts App ✓ should have all the UI elements ✓ should have all pagination controls and they should be working ✓ should have all settings controls and they should be working ✓ play pause should start polling and stop polling ✓ should select columns from table configuration ✓ sould have all time-range controls ✗ sould have all time-range included while searching - Expected 'Alerts (0)' to equal 'Alerts (5)'. metron-alerts configure table ✓ should select columns from table configuration metron-alerts Search ✓ should display all the default values for saved searches ✓ should have all save search controls and they save search should be working ✓ should populate search items when selected on table ✓ should delete search items from search box ✓ should delete first search items from search box having multiple search fields ✓ manually entering search queries to search box and pressing enter key should search metron-alerts tree view ✓ should have all group by elements ✓ drag and drop should change group order ✓ should have group details for single group by ✓ should have group details for multiple group by ✓ should have sort working for group details for multiple sub groups ✓ should have search working for group details for multiple sub groups metron-alerts facets ✓ should display facets data ✓ should expand all facets ✓ should have all facet values ✓ should collapse all facets metron-alerts alert status ✓ should change alert status for multiple alerts to OPEN ✓ should change alert status for multiple alerts to DISMISS ✓ should change alert status for multiple alerts to ESCALATE ✓ should change alert status for multiple alerts to RESOLVE ✗ should change alert status for multiple alerts to OPEN in tree view - Failed: element not visible (Session info: chrome=61.0.3163.100) (Driver info: chromedriver=2.33.506106 (8a06c39c4582fbfbab6966dbb1c38a9173bfb1a2),platform=Mac OS X 10.12.6 x86_64) metron-alerts alert status ✓ should change alert statuses ✓ should add comments for table view ✓ should add comments for tree view ** *Failures* ** 1) metron-alerts App sould have all time-range included while searching - Expected 'Alerts (0)' to equal 'Alerts (5)'. 2) metron-alerts alert status should change alert status for multiple alerts to OPEN in tree view - Failed: element not visible (Session info: chrome=61.0.3163.100) (Driver info: chromedriver=2.33.506106 (8a06c39c4582fbfbab6966dbb1c38a9173bfb1a2),platform=Mac OS X 10.12.6 x86_64) > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219772#comment-16219772 ] ASF GitHub Bot commented on METRON-1224: Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/796 I think the test coverage looks pretty good. I'm +1 conditional on the e2e tests passing. > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219544#comment-16219544 ] ASF GitHub Bot commented on METRON-1224: Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/796 @merrimanr I have added e2e tests as suggested and merged your PR too. Plz, let me know if I missed anything. I had to omit assertions for a couple of quick ranges as they can cause trouble when we have leap years and 29 day months. I hope it's not an issue. > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217639#comment-16217639 ] ASF GitHub Bot commented on METRON-1224: Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/796 This issue is still not fixed: - The first is related to time-range selections that include 'Now' as part of the range (Last 7 days, Last 5 minutes, Today so far, etc). This should be a sliding window so I would expect the search query to be different every time the results are refreshed. - Fixed I submitted a PR against this PR that should address it (also has the latest version of master merged in). Let me know if you think this is the right way to fix it. Seems kind of strange to import a class (QueryBuilder) in alerts-list into a service but I'll let you decide if that is ideal. Saved search is working now and everything else seems to function correctly. I did notice a regression where if I rename a column, type a query with the friendly name in the query box (ie. sourceType:snort) results are no longer returned. Not sure if that was introduced in this PR or not because I don't think we are testing for it. I am still not a fan of how the Time Range selection works. The "now" designation is essentially meaningless because you can't save a range with "now" in either FROM or TO. I still agree with all my previous complaints about this too. If the community feels it is working correctly then I would not hold up this PR over it. The e2e tests are still insufficient and failing. I gave some recommendations [here](https://github.com/apache/metron/pull/796#issuecomment-337965321) for your reference. > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217153#comment-16217153 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 @iraghumitra looks like everything has been addressed. I am +1 on my side, but lets have @merrimanr chime in > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216909#comment-16216909 ] ASF GitHub Bot commented on METRON-1224: Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/796 @merrimanr @james-sirota There was a bug in handling the recent searches that were in old format can you check it now. Sorry for the trouble > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216344#comment-16216344 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 A few things didn't work for me. First, when I select a time range of (t-x minutes) the start and end time does not fill in per screen shot below. https://user-images.githubusercontent.com/4854764/31926145-b2ac5c52-b841-11e7-9fde-aa9d6ba3267d.png;> The time box was initially populated with the word "now", which did not allow me to save. I had to manually enter valid timestamps in order for this to work: https://user-images.githubusercontent.com/4854764/31926214-0d02a616-b842-11e7-8811-b5dae19f63d4.png;> When I click to save a search I get the following exception: TypeError: path must be absolute or specify root to res.sendFile at ServerResponse.sendFile (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/response.js:410:11) at /usr/metron/0.4.1/web/expressjs/alerts-server.js:71:7 at Layer.handle [as handle_request] (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/layer.js:95:5) at next (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/route.js:137:13) at Route.dispatch (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/route.js:112:3) at Layer.handle [as handle_request] (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/layer.js:95:5) at /usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/index.js:281:22 at param (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/index.js:354:14) at param (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/index.js:365:14) at Function.process_params (/usr/metron/0.4.1/web/expressjs/node_modules/express/lib/router/index.js:410:3) > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216278#comment-16216278 ] ASF GitHub Bot commented on METRON-1224: Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/796 @merrimanr can you clear browser cache and try? There is a change in save query model my bad I missed mentioning it. > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[
https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215973#comment-16215973
]
ASF GitHub Bot commented on METRON-1224:
Github user merrimanr commented on the issue:
https://github.com/apache/metron/pull/796
Just tried this again and I could not get it to work. I noticed master has
not been merged in recently so that could be the cause. Here are the issues I
see:
- anytime I select a Time Range or Quick Range, this query is sent and no
results are returned:
```
{
"query": ""
}
```
- when I select a Time Range or Quick Range, a query is sent during the
next refresh cycle when I would expect it to be sent immediately
- when I change the "FROM" field the "TO" field is automatically set to the
end of the day but I don't see a way to change it back to "now"
I suspect something is off so I will pause on reviewing until a search with
a time range is working again.
> Add time range selection to search control
> --
>
> Key: METRON-1224
> URL: https://issues.apache.org/jira/browse/METRON-1224
> Project: Metron
> Issue Type: New Feature
>Reporter: RaghuMitra
>Assignee: RaghuMitra
>
> Add ability to select a time range for a query. This is a good add-on for the
> existing search that will enable users to select a time range quickly.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215440#comment-16215440 ] ASF GitHub Bot commented on METRON-1224: Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/796 @merrimanr plz find my replies - when I open the date/time range picker why does it say "now/d"? I would expect just "now" or "Now" - Changed to now - when I first navigate to the Alerts UI or select "All time" why do I see a timestamp clause in the query? Why not just leave it out? - Fixed - The first is related to time-range selections that include 'Now' as part of the range (Last 7 days, Last 5 minutes, Today so far, etc). This should be a sliding window so I would expect the search query to be different every time the results are refreshed. - Fixed - I also found the time range selector value isn't populated correctly when loading a saved or recent search. -Fixed - if I select a cell in the table to apply a filter, then remove the filter by hovering over it in the search bar and clicking 'x', the time range dropdown is disabled. -Fixed - when I select a Quick Range filter or open the drop-down after a, the Time Range inputs are not updated and still say "now/d" - I felt 'Quick Range' and 'Time Range' should be mutually exclusive. If it is confusing I can fix it. - when I click the 'X' or clear button in the search bar, I would expect the time range selector to be reset to "All time" - Fixed - when I open the drop down and change the "FROM" time range, I would expect the "TO" input to still say "now" (it's automatically set to end of the day picked in "FROM") - This is intentional just to ensure that To date is not before From date - when I open the drop down and change either "FROM", "TO" or both, I would expect those inputs to reset if I closed the dropdown without hitting "Apply" (they are still populated when I open the dropdown again) - If it is not really annoying I would leave this to default behaviour. There are both advantages/disadvantages of clearing the fields and retaining the value > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207675#comment-16207675 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 On my objection about not being able to paste a timestamp, I filed a follow-on Jira so that this PR can go in https://issues.apache.org/jira/browse/METRON-1253 > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202156#comment-16202156 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 I tested the PR. The only issue I see is that when I paste the timestamp or manually type it into the boxes it overwrites it with the calendar entries. So essentially the only way to get the timestamp in is to enter it through the calendar selection. Other than that it works great. I tested the positive case and the negative case. The search functionality works. I am a conditional +1 on this, because I do want to be able to enter the timestamps manually (not through the calendar picker). If you can fix that I think this PR is good to go > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202130#comment-16202130 ] ASF GitHub Bot commented on METRON-1224: Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/796 @ottobackwards that's a good suggestion can you create a ticket with some more details about new quick filters and any design that you have in mind. I would be happy to pick it up as a follow-on > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (METRON-1224) Add time range selection to search control
[ https://issues.apache.org/jira/browse/METRON-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202131#comment-16202131 ] ASF GitHub Bot commented on METRON-1224: Github user james-sirota commented on the issue: https://github.com/apache/metron/pull/796 @ottobackwards @iraghumitra i already filed a feature request on that: https://issues.apache.org/jira/browse/METRON-1248 > Add time range selection to search control > -- > > Key: METRON-1224 > URL: https://issues.apache.org/jira/browse/METRON-1224 > Project: Metron > Issue Type: New Feature >Reporter: RaghuMitra >Assignee: RaghuMitra > > Add ability to select a time range for a query. This is a good add-on for the > existing search that will enable users to select a time range quickly. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
