[
http://opencast.jira.com/browse/MH-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=26924#comment-26924
]
Rubén Pérez Vázquez commented on MH-7698:
-----------------------------------------
One of our gurus here in Vigo, Pablo, has discovered what the problem is, and
the errors are completely misguiding, so ignore my last comment because the
memory size seems NOT to be the problem in this case.
Last Friday he was investigating the issue because we have also being observing
it in some recordings, and it turns out that (please confirm you are
experimenting the same issues):
1 - In 32-bit machines, the exception shown in this issue appears, and the
workflow fails at distribution
2 - In 64-bit machines, no exception is raised, but the file is copied only up
to a size of 2GB, and the rest is ignored.
The bug resides in the file FileSupport.java in the matterhorn-common bundle,
**so it might potentially affect any bundles using this utility class**. It has
been consistently tested both in local and network filesystems (NFS).
Specifically, the conflicting lines are the 151st to 153rd in the
aforementioned file:
source = new FileInputStream(sourceLocation).getChannel();
destination = new FileOutputStream(dest).getChannel();
destination.transferFrom(source, 0, source.size());
Pablo has confirmed that the following workaround fixes the problem (for both
architectures):
source = new FileInputStream(sourceLocation).getChannel();
destination = new FileOutputStream(targetLocation).getChannel();
final long chunk = 1 * 1024 * 1024 *1024; //1GB
for (long pos = 0; pos < source.size(); ) {
pos += destination.transferFrom(source,pos,chunk);
}
However, this is not but a patch because FileChannels are NOT supposed to have
any particular size limit. Nothing in the docs suggests files larger than 2GB
should be problematic, and no bugs seem to have been reported whatsoever. I
would like to know if somebody within the Matterhorn adopters have observed
this problem, because it is hard to believe that it is only affecting Spanish
adopters. I'm inclined to think that either nobody but Spaniards have been
experimenting with large files (which at this point of the project is frankly
hard to believe) or that people has found this bug but has ignored it for some
reason (which is equivalently hard to believe). Comments on this issue from
some other adopters are welcome.
I suggest this is reprioritized as Release Blocker for 1.3, but I would be glad
if it is considered a blocker for 1.2 too. We could consider this as a bug
found in 1.2 QA and incorporate it to the process, but as important as I
believe fixing this to be, since nobody else has reported it, I understand
people not seeing this issue, or managing only small files (?!) will prefer to
move this to 1.3. Input sbout this is welcome, too.
We will keep investigating this issue in the interim.
> Error distributing: One of the distribution jobs did not complete successfully
> ------------------------------------------------------------------------------
>
> Key: MH-7698
> URL: http://opencast.jira.com/browse/MH-7698
> Project: Matterhorn Project
> Issue Type: Bug
> Components: Distribution, Engage Tools
> Affects Versions: 1.1.x (branch)
> Reporter: Miguel
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
_______________________________________________
Matterhorn mailing list
[email protected]
http://lists.opencastproject.org/mailman/listinfo/matterhorn
To unsubscribe please email
[email protected]
_______________________________________________
