[
https://issues.apache.org/jira/browse/HAMA-949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495557#comment-14495557
]
Hudson commented on HAMA-949:
-----------------------------
FAILURE: Integrated in Hama-trunk #378 (See
[https://builds.apache.org/job/Hama-trunk/378/])
HAMA-949: File splits based on number of input files (edwardyoon: rev 1673611)
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJobClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/FileInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/LocalBSPRunner.java
> File splits based on number of input files
> ------------------------------------------
>
> Key: HAMA-949
> URL: https://issues.apache.org/jira/browse/HAMA-949
> Project: Hama
> Issue Type: Improvement
> Affects Versions: 0.6.4
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.7.0
>
> Attachments: patch.txt
>
>
> I've create multiple input files considering max task capacity of cluster,
> but it wasn't able to run. Because, currently file splits are determined
> based on number of blocks.
> I don't know why below code has been removed. What if add this again?
> {code}
> // take the short circuit path if we have already partitioned
> if (numSplits == files.length) {
> for (FileStatus file : files) {
> if (file != null) {
> splits.add(new FileSplit(file.getPath(), 0, file.getLen(),
> new String[0]));
> }
> }
> return splits.toArray(new FileSplit[splits.size()]);
> }
> {code}
> https://www.mail-archive.com/[email protected]/msg00319.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
