[
https://issues.apache.org/jira/browse/HIVE-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399067#comment-13399067
]
Kanna Karanam commented on HIVE-3172:
-------------------------------------
@Carl - All MiniMR cluster related test cases are failing when hadoop is
attempting to run the MR jobs.
I am debating on following two approaches-.
1) Create a custom ANT task that takes the list of folders/filesets as an input
and enumerates files from each folder and adds to list/classpath if doesn’t
exist already. (Based on unique names). I have very limited knowledge on ANT so
please let me know if you see any error.
2) Hacky solution is replace the fileset with path element in the test class
path.
Please let me know if you see any other possible solutions.
Thanks
> Remove the duplicate JAR entries from the (“test.classpath”) to avoid command
> line exceeding char limit on windows
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-3172
> URL: https://issues.apache.org/jira/browse/HIVE-3172
> Project: Hive
> Issue Type: Sub-task
> Components: Tests, Windows
> Affects Versions: 0.10.0
> Environment: Windows
> Reporter: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
>
> The maximum length of the DOS command string is 8191 characters (in Windows
> latest versions http://support.microsoft.com/kb/830473). Following entries in
> the “build-common.xml” are adding lot of duplicate JAR entries to the
> “test.classpath” and it exceeds the max character limit on windows very
> easily.
> <!-- Include build/dist/lib on the classpath before Ivy and exclude hive jars
> from Ivy to make sure we get the local changes when we test Hive -->
> <fileset dir="${build.dir.hive}/dist/lib" includes="*.jar"
> erroronmissingdir="false"
> excludes="**/hive_contrib*.jar,**/hive-contrib*.jar,**/lib*.jar"/>
> <fileset dir="${hive.root}/build/ivy/lib/test" includes="*.jar"
> erroronmissingdir="false" excludes="**/hive_*.jar,**/hive-*.jar"/>
> <fileset dir="${hive.root}/build/ivy/lib/default" includes="*.jar"
> erroronmissingdir="false" excludes="**/hive_*.jar,**/hive-*.jar" />
> <fileset dir="${hive.root}/testlibs" includes="*.jar"/>
> Proposed solution (workaround)–
> 1)Include all JARs from dist\lib excluding
> "**/hive_contrib*.jar,**/hive-contrib*.jar,**/lib*.jar"
> 2)Select the specific jars (missing jars) from test/other folders, (that
> includes Hadoop-*.jar files)
> Thanks
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
