[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219-branch-2.001.patch

Add version for branch-2

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch, HADOOP-14219-branch-2.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219-branch-2.6.0.001.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219-branch-2.6.0.001.patch

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch, 
> HADOOP-14219-branch-2.6.0.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.001.patch

git.apache.org and github were not in sync

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.001.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

Add missing license header (and allow comments in json parser)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

New patch (test added)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Open  (was: Patch Available)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-24 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: (was: HADOOP-14219.patch)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-23 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Status: Patch Available  (was: Open)

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

[jira] [Updated] (HADOOP-14219) RumenToSLS: parsing problem with crashed attempts

2017-03-23 Thread Julien Vaudour (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Vaudour updated HADOOP-14219:

Attachment: HADOOP-14219.patch

The proposed patched consider all as the more generic class java.lang.Number
It also ignores task attempts having null hostName

> RumenToSLS: parsing problem with crashed attempts
> -
>
> Key: HADOOP-14219
> URL: https://issues.apache.org/jira/browse/HADOOP-14219
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 2.6.0
>Reporter: Julien Vaudour
>Priority: Minor
> Attachments: HADOOP-14219.patch
>
>
> In case of crashed task attempts, we may have in rumen logs task attempts 
> with null hostName and finishTime defined to -1
> for example
> {code}
>{
>   "resourceUsageMetrics": {
> "heapUsage": 0,
> "physicalMemoryUsage": 0,
> "virtualMemoryUsage": 0,
> "cumulativeCpuUsage": 0
>   },
>   "vmemKbytes": [],
>   "physMemKbytes": [],
>   "cpuUsages": [],
>   "clockSplits": [],
>   "location": null,
>   "sortFinished": -1,
>   "shuffleFinished": -1,
>   "spilledRecords": -1,
>   "reduceOutputRecords": -1,
>   "reduceShuffleBytes": -1,
>   "fileBytesRead": -1,
>   "hdfsBytesWritten": -1,
>   "hdfsBytesRead": -1,
>   "hostName": null,
>   "finishTime": -1,
>   "startTime": 1489619193378,
>   "result": null,
>   "attemptID": "attempt_1488896259152_410442_r_15_1",
>   "fileBytesWritten": -1,
>   "mapInputRecords": -1,
>   "mapInputBytes": -1,
>   "mapOutputBytes": -1,
>   "mapOutputRecords": -1,
>   "combineInputRecords": -1,
>   "reduceInputGroups": -1,
>   "reduceInputRecords": -1
> }
> {code}
> Jackson parser will automatically consider -1 as a java.lang.Integer. However 
> RumenToSLSConverter make the assumption than jackson has deserialize all 
> timstamp as instance of java.lang.Long, resulting in a ClassCastException.
> RumenToSLSConverter also make the assumption that hostName is not null, so we 
> can also have a NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org