[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[Arina Ielchiieva (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377047#comment-15377047
 ] 

Arina Ielchiieva commented on DRILL-2593:
-

[~knguyen]
>From developers prospective, I don't check whether profile is corrupted or not 
>(ex: if it's missing info such as user:). I just try to deserialize 
>profile to QueryProfile object and if   exception occurred (json was 
>malformed) I mark it as corrupted and generate warning. 

> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341764#comment-15341764
 ] 

ASF GitHub Bot commented on DRILL-2593:
---

Github user arina-ielchiieva commented on the issue:

https://github.com/apache/drill/pull/523
  
Merged into master with commit 2862beaf5c72ccaafc6c52b9956f2d0414948b67


> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341765#comment-15341765
 ] 

ASF GitHub Bot commented on DRILL-2593:
---

Github user arina-ielchiieva closed the pull request at:

https://github.com/apache/drill/pull/523


> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[Arina Ielchiieva (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341763#comment-15341763
 ] 

Arina Ielchiieva commented on DRILL-2593:
-

Merged into master with commit 2862beaf5c72ccaafc6c52b9956f2d0414948b67

> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334143#comment-15334143
 ] 

ASF GitHub Bot commented on DRILL-2593:
---

Github user parthchandra commented on the issue:

https://github.com/apache/drill/pull/523
  
+1. LGTM


> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330265#comment-15330265
 ] 

ASF GitHub Bot commented on DRILL-2593:
---

GitHub user arina-ielchiieva opened a pull request:

https://github.com/apache/drill/pull/523

DRILL-2593: 500 error when crc for a query profile is out of sync

In case we have corrupted profile, it will be skipped but dismissable 
warning will be generated.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/arina-ielchiieva/drill DRILL-2593

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/drill/pull/523.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #523


commit afc758003cfdde9ddaf50e66f23a5ad91de0280b
Author: Arina Ielchiieva 
Date:   2016-06-12T13:48:54Z

DRILL-2593: 500 error when crc for a query profile is out of sync




> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: 1.7.0
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[Arina Ielchiieva (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326489#comment-15326489
 ] 

Arina Ielchiieva commented on DRILL-2593:
-

In case we have corrupted profile, it will be skipped but dismissable warning 
will be generated.
Screenshots - warning1.JPG, warning2.JPG.

> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
>Assignee: Arina Ielchiieva
> Fix For: Future
>
> Attachments: warning1.JPG, warning2.JPG
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[John Omernik (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310569#comment-15310569
 ] 

John Omernik commented on DRILL-2593:
-

Big +1 one from me, here is my user list post on the subject. This should be 
easily reproducible, and for end users/admins it could be quite the issue 
trying the track down the troublesome profile.  We should really address this 
for user exp reasons. 

John


Post from User list:


It is absolutely a bad profile, however,  it was not a empty file profile, 
instead, it was a profile where the write didn't complete (likely due to my bad 
cluster state post). 

I was able to reproduce it synthetically like this, say you had a profile that 
ended similar to this:

..."endpoint":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"lastUpdate":1464730828126,"lastProgress":1464730828126}]}],"user":"adm"}

(The ... represents the part I removed for brevity in this email, the rest of 
the profile is below)

We can reproduce the UI profiles issue by removing ,"user":"adm"}

so it ends like this:

..."endpoint":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"lastUpdate":1464730828126,"lastProgress":1464730828126}]}]


Let me know if you know of a JIRA, otherwise I'll open one, this is a pain for 
users, because you have to go through an validate the json on every profile to 
find the one that is breaking your UI.  

John





Full "Working" Profile:

{"id":{"part1":2932401029014293687,"part2":6412631480783062510},"type":1,"start":1464730828036,"end":1464730828131,"query":"alter
 session set `store.parquet.enable_dictionary_encoding` = 
true","foreman":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"state":2,"totalFragments":1,"finishedFragments":0,"fragmentProfile":[{"majorFragmentId":0,"minorFragmentProfile":[{"state":3,"minorFragmentId":0,"operatorProfile":[{"inputProfile":[{"records":1,"batches":1,"schemas":1}],"operatorId":0,"operatorType":26,"setupNanos":0,"processNanos":1020862,"peakLocalMemoryAllocated":4530432,"waitNanos":0},{"inputProfile":[{"records":1,"batches":1,"schemas":1}],"operatorId":0,"operatorType":13,"setupNanos":0,"processNanos":154675,"peakLocalMemoryAllocated":4530176,"metric":[{"metricId":0,"longValue":59}],"waitNanos":1936593}],"startTime":1464730828114,"endTime":1464730828123,"memoryUsed":0,"maxMemoryUsed":9060608,"endpoint":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"lastUpdate":1464730828126,"lastProgress":1464730828126}]}],"user":"adm"}


Full "Broken" Profile:

{"id":{"part1":2932401029014293687,"part2":6412631480783062510},"type":1,"start":1464730828036,"end":1464730828131,"query":"alter
 session set `store.parquet.enable_dictionary_encoding` = 
true","foreman":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"state":2,"totalFragments":1,"finishedFragments":0,"fragmentProfile":[{"majorFragmentId":0,"minorFragmentProfile":[{"state":3,"minorFragmentId":0,"operatorProfile":[{"inputProfile":[{"records":1,"batches":1,"schemas":1}],"operatorId":0,"operatorType":26,"setupNanos":0,"processNanos":1020862,"peakLocalMemoryAllocated":4530432,"waitNanos":0},{"inputProfile":[{"records":1,"batches":1,"schemas":1}],"operatorId":0,"operatorType":13,"setupNanos":0,"processNanos":154675,"peakLocalMemoryAllocated":4530176,"metric":[{"metricId":0,"longValue":59}],"waitNanos":1936593}],"startTime":1464730828114,"endTime":1464730828123,"memoryUsed":0,"maxMemoryUsed":9060608,"endpoint":{"address":"zeta01.mydomain.net","userPort":20001,"controlPort":20002,"dataPort":20003},"lastUpdate":1464730828126,"lastProgress":1464730828126}]}]


> 500 error when crc for a query profile is out of sync
> -
>
> Key: DRILL-2593
> URL: https://issues.apache.org/jira/browse/DRILL-2593
> Project: Apache Drill
>  Issue Type: Bug
>  Components: Client - HTTP
>Affects Versions: 0.7.0
>Reporter: Jason Altekruse
> Fix For: Future
>
>
> To reproduce, on a machine where an embedded drillbit has been run, edit one 
> of the profiles stored in /tmp/drill/profiles and try to navigate to the 
> profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[Sudheesh Katkam (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592767#comment-14592767
 ] 

Sudheesh Katkam commented on DRILL-2593:


What is the expected behavior?

 500 error when crc for a query profile is out of sync
 -

 Key: DRILL-2593
 URL: https://issues.apache.org/jira/browse/DRILL-2593
 Project: Apache Drill
  Issue Type: Bug
  Components: Client - HTTP
Affects Versions: 0.7.0
Reporter: Jason Altekruse
Assignee: Sudheesh Katkam
 Fix For: 1.2.0


 To reproduce, on a machine where an embedded drillbit has been run, edit one 
 of the profiles stored in /tmp/drill/profiles and try to navigate to the 
 profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (DRILL-2593) 500 error when crc for a query profile is out of sync

[Jason Altekruse (JIRA)]

[ 
https://issues.apache.org/jira/browse/DRILL-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592772#comment-14592772
 ] 

Jason Altekruse commented on DRILL-2593:


Couple of options, we can show it in the list with a profile corrupted 
message, or just leave it out entirely. The big problem is that the whole page 
gives a 500 error so you cannot see any of the profiles.

 500 error when crc for a query profile is out of sync
 -

 Key: DRILL-2593
 URL: https://issues.apache.org/jira/browse/DRILL-2593
 Project: Apache Drill
  Issue Type: Bug
  Components: Client - HTTP
Affects Versions: 0.7.0
Reporter: Jason Altekruse
Assignee: Sudheesh Katkam
 Fix For: 1.2.0


 To reproduce, on a machine where an embedded drillbit has been run, edit one 
 of the profiles stored in /tmp/drill/profiles and try to navigate to the 
 profiles page on the Web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)