[
https://issues.apache.org/jira/browse/HADOOP-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111174#comment-15111174
]
Allen Wittenauer edited comment on HADOOP-12563 at 1/21/16 7:44 PM:
--------------------------------------------------------------------
I'm still playing around a bit, but some feedback:
* Non-existent file handling should throw a message as well as give a failure
exit code:
{code}
$ rm foo
$ hadoop dtutil get foo
$ echo $?
0
{code}
* fetchdt needs to default to use the java-based serialization for backward
compatibility. Simple script that shows it:
{code}
#!/bin/bash
URL=hdfs://$(hostname):9000
hdfs fetchdt dt-fetchdt
hadoop dtutil get ${URL} dt-util-default
hadoop dtutil get ${URL} -format java dt-util-java
hadoop dtutil get ${URL} -format protobuf dt-util-proto
ls -l dt-*
{code}
was (Author: aw):
I'm still playing around a bit, but some feedback:
* Non-existent file handling should throw a message as well as give a failure
exit code:
{code}
$ rm foo
$ hadoop dtutil get foo
$ echo $?
0
{code}
* fetchdt needs to default to use the java-based serialization for backward
compatibility.
{code}
#!/bin/bash
URL=hdfs://$(hostname):9000
hdfs fetchdt dt-fetchdt
hadoop dtutil get ${URL} dt-util-default
hadoop dtutil get ${URL} -format java dt-util-java
hadoop dtutil get ${URL} -format protobuf dt-util-proto
ls -l dt-*
{code}
> Updated utility to create/modify token files
> --------------------------------------------
>
> Key: HADOOP-12563
> URL: https://issues.apache.org/jira/browse/HADOOP-12563
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 3.0.0
> Reporter: Allen Wittenauer
> Assignee: Matthew Paduano
> Attachments: HADOOP-12563.01.patch, HADOOP-12563.02.patch,
> HADOOP-12563.03.patch, HADOOP-12563.04.patch, HADOOP-12563.05.patch,
> HADOOP-12563.06.patch, example_dtutil_commands_and_output.txt,
> generalized_token_case.pdf
>
>
> hdfs fetchdt is missing some critical features and is geared almost
> exclusively towards HDFS operations. Additionally, the token files that are
> created use Java serializations which are hard/impossible to deal with in
> other languages. It should be replaced with a better utility in common that
> can read/write protobuf-based token files, has enough flexibility to be used
> with other services, and offers key functionality such as append and rename.
> The old version file format should still be supported for backward
> compatibility, but will be effectively deprecated.
> A follow-on JIRA will deprecrate fetchdt.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
