[
https://issues.apache.org/jira/browse/HBASE-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822674#comment-13822674
]
Nick Dimiduk commented on HBASE-8438:
-------------------------------------
I noticed the DEBUG output as well. It goes to stderr so I planned to pipe that
to /dev/null from consuming shell scripts. I can look at changing the log level
programmatically if you'd prefer.
hadoop-mapreduce-client-core.jar comes from the default Job values
(mapOutputKeyClass, mapOutputValueClass, etc). I introduce a new method in
HBASE-9165 that excludes these classes. We can switch this patch over to use
that method if you prefer. Mind giving that one a review as well?
> Extend bin/hbase to print a "mapreduce classpath"
> -------------------------------------------------
>
> Key: HBASE-8438
> URL: https://issues.apache.org/jira/browse/HBASE-8438
> Project: HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.94.6.1, 0.95.0
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Fix For: 0.98.0, 0.96.1
>
> Attachments:
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
> 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch
>
>
> For tools like pig and hive, blindly appending the full output of `bin/hbase
> classpath` to their own CLASSPATH is excessive. They already build CLASSPATH
> entries for hadoop. All they need from us is the delta entries, the
> dependencies we require w/o hadoop and all of it's transitive deps. This is
> also a kindness for Windows, where there's a shorter limit on the length of
> commandline arguments.
> See also HIVE-2055 for additional discussion.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
