[jira] [Commented] (MAPREDUCE-6712) Support grouping values for reducer on java-side
[
https://issues.apache.org/jira/browse/MAPREDUCE-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15336923#comment-15336923
]
Daniel Templeton commented on MAPREDUCE-6712:
-
Pyspark actually does some cleverness under covers to replace as much of your
python code with Scala as possible. Regardless, the advantages of Spark over
MR in performance are huge. Not being forced to serialize to HDFS between
chained jobs and being able to cache data in memory are a big deal.
> Support grouping values for reducer on java-side
>
>
> Key: MAPREDUCE-6712
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6712
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/streaming
>Reporter: He Tianyi
>Priority: Minor
>
> In hadoop streaming, with TextInputWriter, reducer program will receive each
> line representing a (k, v) tuple from {{stdin}}, in which values with
> identical key is not grouped.
> This brings some inefficiency, especially for runtimes based on interpreter
> (e.g. cpython), coming from:
> A. user program has to compare key with previous one (but on java side,
> records already come to reducer in groups),
> B. user program has to perform {{read}}, then {{find}} or {{split}} on each
> record. even if there are multiple values with identical key,
> C. if length of key is large, apparently this introduces inefficiency for
> caching,
> Suppose we need another InputWriter. But this is not enough, since the
> interface of {{InputWriter}} defined {{writeKey}} and {{writeValue}}, not
> {{writeValues}}. Though we can compare key in custom InputWriter and group
> them, but this is also inefficient. Some other changes are also needed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6542) HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe
[
https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335954#comment-15335954
]
zhangyubiao commented on MAPREDUCE-6542:
Thanks [~templedf] and [~ajisakaa] review. [~ajisakaa] Should I summit a
patch for rebase branch-2.8?
> HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe
> ---
>
> Key: MAPREDUCE-6542
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6542
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver
>Affects Versions: 2.2.0, 2.7.1
> Environment: CentOS6.5 Hadoop
>Reporter: zhangyubiao
>Assignee: zhangyubiao
> Fix For: 2.9.0
>
> Attachments: MAPREDUCE-6542-v10.patch, MAPREDUCE-6542-v11.patch,
> MAPREDUCE-6542-v12.patch, MAPREDUCE-6542-v13.patch, MAPREDUCE-6542-v14.patch,
> MAPREDUCE-6542-v15.patch, MAPREDUCE-6542-v16.patch, MAPREDUCE-6542-v2.patch,
> MAPREDUCE-6542-v3.patch, MAPREDUCE-6542-v4.patch, MAPREDUCE-6542-v5.patch,
> MAPREDUCE-6542-v6.patch, MAPREDUCE-6542-v7.patch, MAPREDUCE-6542-v8.patch,
> MAPREDUCE-6542-v9.patch, MAPREDUCE-6542.patch
>
>
> I use SimpleDateFormat to Parse the JobHistory File before
> {code}
> private static final SimpleDateFormat dateFormat =
> new SimpleDateFormat("-MM-dd HH:mm:ss");
> public static String getJobDetail(JobInfo job) {
> StringBuffer jobDetails = new StringBuffer("");
> SummarizedJob ts = new SummarizedJob(job);
> jobDetails.append(job.getJobId().toString().trim()).append("\t");
> jobDetails.append(job.getUsername()).append("\t");
> jobDetails.append(job.getJobname().replaceAll("\\n",
> "")).append("\t");
> jobDetails.append(job.getJobQueueName()).append("\t");
> jobDetails.append(job.getPriority()).append("\t");
> jobDetails.append(job.getJobConfPath()).append("\t");
> jobDetails.append(job.getUberized()).append("\t");
>
> jobDetails.append(dateFormat.format(job.getSubmitTime())).append("\t");
>
> jobDetails.append(dateFormat.format(job.getLaunchTime())).append("\t");
>
> jobDetails.append(dateFormat.format(job.getFinishTime())).append("\t");
>return jobDetails.toString();
> }
> {code}
> But I find I query the SubmitTime and LaunchTime in hive and compare
> JobHistory File time , I find that the submitTime and launchTime was wrong.
> Finally,I change to use the FastDateFormat to parse the time format and the
> time become right
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335733#comment-15335733 ] shenyinjie commented on MAPREDUCE-6716: --- The fix is quite straightforward, so no need to add unit test. And, the problem in checkstyle is also not introduced by my patch . > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0, 2.8.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch, MAPREDUCE-6716_trunk.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type: > Total jobs:1 > JobId StateStartTime > UserName Queue Priority UsedContainers > RsvdContainers UsedMem RsvdMem NeededMem AM info > job_1466130676071_0003 PREP 1466133828870 hdfs > default VERY_HIGH1 01536M > 0M 1536M > http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ > refer to source code, found that "job.getStartTime()" is long type, and > should be converted to date format。 >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[
https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335675#comment-15335675
]
Hadoop QA commented on MAPREDUCE-6716:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 16s
{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m 0s
{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
21s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 29s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 38s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
14s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 7s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 21s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
22s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 21s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 21s
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 13s
{color} | {color:red}
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core:
The patch generated 2 new + 36 unchanged - 2 fixed = 38 total (was 38) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 26s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
9s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s {color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
56s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 19s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 1s
{color} | {color:green} hadoop-mapreduce-client-core in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
18s {color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 17m 33s {color}
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:e2f6409 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12811311/MAPREDUCE-6716_trunk.patch
|
| JIRA Issue | MAPREDUCE-6716 |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux edcbb5f08ca3 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 09e82ac |
| Default Java | 1.8.0_91 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6563/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6563/testReport/ |
| modules | C:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core
U:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6563/console |
| Powered by | Apache Yetus 0.3.0 http://yetus.apache.org |
This message was automatically generated.
> Shell command "mapred job -list" show wr
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Affects Version/s: 2.8.0 > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0, 2.8.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch, MAPREDUCE-6716_trunk.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type: > Total jobs:1 > JobId StateStartTime > UserName Queue Priority UsedContainers > RsvdContainers UsedMem RsvdMem NeededMem AM info > job_1466130676071_0003 PREP 1466133828870 hdfs > default VERY_HIGH1 01536M > 0M 1536M > http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ > refer to source code, found that "job.getStartTime()" is long type, and > should be converted to date format。 >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6542) HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe
[
https://issues.apache.org/jira/browse/MAPREDUCE-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335637#comment-15335637
]
Akira AJISAKA commented on MAPREDUCE-6542:
--
Filed MAPREDUCE-6717 for follow-up.
> HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe
> ---
>
> Key: MAPREDUCE-6542
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6542
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver
>Affects Versions: 2.2.0, 2.7.1
> Environment: CentOS6.5 Hadoop
>Reporter: zhangyubiao
>Assignee: zhangyubiao
> Fix For: 2.9.0
>
> Attachments: MAPREDUCE-6542-v10.patch, MAPREDUCE-6542-v11.patch,
> MAPREDUCE-6542-v12.patch, MAPREDUCE-6542-v13.patch, MAPREDUCE-6542-v14.patch,
> MAPREDUCE-6542-v15.patch, MAPREDUCE-6542-v16.patch, MAPREDUCE-6542-v2.patch,
> MAPREDUCE-6542-v3.patch, MAPREDUCE-6542-v4.patch, MAPREDUCE-6542-v5.patch,
> MAPREDUCE-6542-v6.patch, MAPREDUCE-6542-v7.patch, MAPREDUCE-6542-v8.patch,
> MAPREDUCE-6542-v9.patch, MAPREDUCE-6542.patch
>
>
> I use SimpleDateFormat to Parse the JobHistory File before
> {code}
> private static final SimpleDateFormat dateFormat =
> new SimpleDateFormat("-MM-dd HH:mm:ss");
> public static String getJobDetail(JobInfo job) {
> StringBuffer jobDetails = new StringBuffer("");
> SummarizedJob ts = new SummarizedJob(job);
> jobDetails.append(job.getJobId().toString().trim()).append("\t");
> jobDetails.append(job.getUsername()).append("\t");
> jobDetails.append(job.getJobname().replaceAll("\\n",
> "")).append("\t");
> jobDetails.append(job.getJobQueueName()).append("\t");
> jobDetails.append(job.getPriority()).append("\t");
> jobDetails.append(job.getJobConfPath()).append("\t");
> jobDetails.append(job.getUberized()).append("\t");
>
> jobDetails.append(dateFormat.format(job.getSubmitTime())).append("\t");
>
> jobDetails.append(dateFormat.format(job.getLaunchTime())).append("\t");
>
> jobDetails.append(dateFormat.format(job.getFinishTime())).append("\t");
>return jobDetails.toString();
> }
> {code}
> But I find I query the SubmitTime and LaunchTime in hive and compare
> JobHistory File time , I find that the submitTime and launchTime was wrong.
> Finally,I change to use the FastDateFormat to parse the time format and the
> time become right
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6717) Remove deprecated StringUtils.getFormattedTimeWithDiff
Akira AJISAKA created MAPREDUCE-6717:
Summary: Remove deprecated StringUtils.getFormattedTimeWithDiff
Key: MAPREDUCE-6717
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6717
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Akira AJISAKA
Priority: Minor
MAPREDUCE-6542 deprecated {{StringUtils.getFormattedTimeWithDiff(DateFormat,
long, long)}}, so it should be removed later.
This method can be removed in branch-2 because {{StringUtils}} is not
{{@Public}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Attachment: MAPREDUCE-6716_trunk.patch patch for trunk > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch, MAPREDUCE-6716_trunk.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type: > Total jobs:1 > JobId StateStartTime > UserName Queue Priority UsedContainers > RsvdContainers UsedMem RsvdMem NeededMem AM info > job_1466130676071_0003 PREP 1466133828870 hdfs > default VERY_HIGH1 01536M > 0M 1536M > http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ > refer to source code, found that "job.getStartTime()" is long type, and > should be converted to date format。 >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Target Version/s: 2.8.0 > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type: > Total jobs:1 > JobId StateStartTime > UserName Queue Priority UsedContainers > RsvdContainers UsedMem RsvdMem NeededMem AM info > job_1466130676071_0003 PREP 1466133828870 hdfs > default VERY_HIGH1 01536M > 0M 1536M > http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ > refer to source code, found that "job.getStartTime()" is long type, and > should be converted to date format。 >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Description: when client excute shell "mapred job -list", the result shows " job's startTime" ,but it is a long type: Total jobs:1 JobId StateStartTime UserName Queue Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info job_1466130676071_0003 PREP 1466133828870 hdfs default VERY_HIGH1 01536M 0M 1536M http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ refer to source code, found that "job.getStartTime()" is long type, and should be converted to date format。 ...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), job.getStartTime(),... was: when client excute shell "mapred job -list", the result shows " job's startTime" ,but it is a long type; ...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), job.getStartTime(),... found that "job.getStartTime()" is long type, and should be converted to date format。 > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type: > Total jobs:1 > JobId StateStartTime > UserName Queue Priority UsedContainers > RsvdContainers UsedMem RsvdMem NeededMem AM info > job_1466130676071_0003 PREP 1466133828870 hdfs > default VERY_HIGH1 01536M > 0M 1536M > http://shenyj.bchadoop.novalocal:8088/proxy/application_1466130676071_0003/ > refer to source code, found that "job.getStartTime()" is long type, and > should be converted to date format。 >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[
https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335577#comment-15335577
]
Hadoop QA commented on MAPREDUCE-6716:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 0s
{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 4s {color}
| {color:red} MAPREDUCE-6716 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12811306/MAPREDUCE-6716.patch |
| JIRA Issue | MAPREDUCE-6716 |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6562/console |
| Powered by | Apache Yetus 0.3.0 http://yetus.apache.org |
This message was automatically generated.
> Shell command "mapred job -list" show wrong time format
>
>
> Key: MAPREDUCE-6716
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 2.6.0
> Environment: centos6.5 x64
> hadoop 2.6.0 /hadoop2.8.0
>Reporter: shenyinjie
>Priority: Minor
> Fix For: 2.8.0
>
> Attachments: MAPREDUCE-6716.patch
>
>
> when client excute shell "mapred job -list",
> the result shows " job's startTime" ,but it is a long type;
>...writer.printf(dataPattern, job.getJobID().toString(), job.getState(),
> job.getStartTime(),...
> found that "job.getStartTime()" is long type, and should be converted to
> date format。
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Attachment: MAPREDUCE-6716.patch > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > Attachments: MAPREDUCE-6716.patch > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type; >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... > found that "job.getStartTime()" is long type, and should be converted to > date format。 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
[ https://issues.apache.org/jira/browse/MAPREDUCE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenyinjie updated MAPREDUCE-6716: -- Status: Patch Available (was: Open) > Shell command "mapred job -list" show wrong time format > > > Key: MAPREDUCE-6716 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client >Affects Versions: 2.6.0 > Environment: centos6.5 x64 > hadoop 2.6.0 /hadoop2.8.0 >Reporter: shenyinjie >Priority: Minor > Fix For: 2.8.0 > > > when client excute shell "mapred job -list", > the result shows " job's startTime" ,but it is a long type; >...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), > job.getStartTime(),... > found that "job.getStartTime()" is long type, and should be converted to > date format。 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6716) Shell command "mapred job -list" show wrong time format
shenyinjie created MAPREDUCE-6716: - Summary: Shell command "mapred job -list" show wrong time format Key: MAPREDUCE-6716 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6716 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Affects Versions: 2.6.0 Environment: centos6.5 x64 hadoop 2.6.0 /hadoop2.8.0 Reporter: shenyinjie Priority: Minor Fix For: 2.8.0 when client excute shell "mapred job -list", the result shows " job's startTime" ,but it is a long type; ...writer.printf(dataPattern, job.getJobID().toString(), job.getState(), job.getStartTime(),... found that "job.getStartTime()" is long type, and should be converted to date format。 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
