[
https://issues.apache.org/jira/browse/NIFI-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15006881#comment-15006881
]
Joseph Percivall commented on NIFI-1165:
----------------------------------------
For the HDFS issue, I like that idea Sean, assuming we give instructions in
comments in the PutHDFSTest class that explains how to properly run it. That
way we can run it when it finds it, ignore it when it doesn't and allow the
user to properly set it up (assuming they want to).
Working to get it working properly with the exe: we have it successfully
running in the ide but running it from the terminal using maven fails.
The original issue is that we didn't have the winutils.exe assigned to the
"hadoop.home.dir" system property. We added the exe to the test resources
folder so that it would be able to be used from the target/test-classes folder.
We correctly see the system property pointing to the right location except when
running from the terminal it fails as if it wasn't able to use the exe.
For RouteText, I have a fix. The fix relies on the assumption that people
should check things out of git "as-is" and commit them "unix style". This is
because it counts the number of lines using the line separator. When checking
them out as is and committing unix style there will be "\n" for all machines. I
believe we have established that as the standard git configuration to use when
programming in windows.
If we don't want to rely on the user's git properties I can do a bit more work
to make it line ending agnostic.
[~markap14] is working on the TailFile issue since he recently created that
processor. He should have a fix in the next couple days.
> Master Build Fails on Windows
> -----------------------------
>
> Key: NIFI-1165
> URL: https://issues.apache.org/jira/browse/NIFI-1165
> Project: Apache NiFi
> Issue Type: Bug
> Reporter: Joseph Percivall
> Assignee: Joseph Percivall
> Priority: Blocker
> Fix For: 0.4.0
>
>
> I tested with two separate Windows 8 machines and get the same errors when
> building master. There are errors in PutHDFSTest, TestRouteText and
> TestTailFile
> PutHDFSTest fails on lines 186 and 198.
> The output for the TestRouteText and TestTailFile:
> TestRouteText.testJson:655 expected:<7> but was:<0>
> TestRouteText.testXml:691 expected:<1> but was:<0>
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.testRolloverAfterHavingReadAllData:277 expected:<2> but was:<0>
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestTailFile.setup:61 null
> TestHDFS is failing due to: "java.io.IOException: Could not locate executable
> null\bin\winutils.exe in the Hadoop binaries."
> TestRouteText is actually failing due to attempting to take into account
> Windows by using "System.lineSeparator()" when traversing a file that is
> checked into git using "\n" line separators.
> TestTailFile I believe is failing due to the processor holding a lock on the
> file while the file is trying to be rolled over. In order to manually test
> it, I ran NiFi and started tailing a file. When I tried to rename it (like a
> server rolling over a file would) it told me it was in use by Java.
> I already have a fix for TestRouteText, Oleg and I are working on HDFS, and
> Mark is working on TailFile
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
