Joseph Percivall created NIFI-3842:
--------------------------------------
Summary: Parquet unit test failures on Win 8.1
Key: NIFI-3842
URL: https://issues.apache.org/jira/browse/NIFI-3842
Project: Apache NiFi
Issue Type: Sub-task
Reporter: Joseph Percivall
Priority: Minor
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.nifi.processors.parquet.FetchParquetTest
Tests run: 6, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 1.167 sec <<<
FAILURE! - in org.apache.nifi.processors.parquet.FetchParquetTest
testFetchParquetToCSV(org.apache.nifi.processors.parquet.FetchParquetTest)
Time elapsed: 0.818 sec <<< ERROR!
java.io.IOException: (null) entry in command string: null chmod 0644
C:\nifi\nifi-nar-bundles\nifi-parquet-bundle\nifi-parquet-processors\target\testFetchParq
uetToCSV.parquet
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at
org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:789)
at
org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:241)
at
org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:273)
at
org.apache.parquet.hadoop.ParquetWriter$Builder.build(ParquetWriter.java:495)
at
org.apache.nifi.processors.parquet.FetchParquetTest.writeParquetUsers(FetchParquetTest.java:269)
at
org.apache.nifi.processors.parquet.FetchParquetTest.testFetchParquetToCSV(FetchParquetTest.java:98)
testIOExceptionCreatingReaderShouldRouteToRetry(org.apache.nifi.processors.parquet.FetchParquetTest)
Time elapsed: 0.029 sec <<< ERROR!
java.io.IOException: (null) entry in command string: null chmod 0644
C:\nifi\nifi-nar-bundles\nifi-parquet-bundle\nifi-parquet-processors\target\testFetchParq
uetToCSV.parquet
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at
org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:789)
at
org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:241)
at
org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:273)
at
org.apache.parquet.hadoop.ParquetWriter$Builder.build(ParquetWriter.java:495)
at
org.apache.nifi.processors.parquet.FetchParquetTest.writeParquetUsers(FetchParquetTest.java:269)
at
org.apache.nifi.processors.parquet.FetchParquetTest.testIOExceptionCreatingReaderShouldRouteToRetry(FetchParquetTest.java:164)
testIOExceptionWhileReadingShouldRouteToRetry(org.apache.nifi.processors.parquet.FetchParquetTest)
Time elapsed: 0.022 sec <<< ERROR!
java.io.IOException: (null) entry in command string: null chmod 0644
C:\nifi\nifi-nar-bundles\nifi-parquet-bundle\nifi-parquet-processors\target\testFetchParq
uetToCSV.parquet
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at
org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:789)
at
org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:241)
at
org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:273)
at
org.apache.parquet.hadoop.ParquetWriter$Builder.build(ParquetWriter.java:495)
at
org.apache.nifi.processors.parquet.FetchParquetTest.writeParquetUsers(FetchParquetTest.java:269)
at
org.apache.nifi.processors.parquet.FetchParquetTest.testIOExceptionWhileReadingShouldRouteToRetry(FetchParquetTest.java:201)
testIOExceptionWhileWritingShouldRouteToRetry(org.apache.nifi.processors.parquet.FetchParquetTest)
Time elapsed: 0.124 sec <<< ERROR!
java.io.IOException: (null) entry in command string: null chmod 0644
C:\nifi\nifi-nar-bundles\nifi-parquet-bundle\nifi-parquet-processors\target\testFetchParq
uetToCSV.parquet
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at
org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:789)
at
org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:241)
at
org.apache.parquet.hadoop.ParquetWriter.<init>(ParquetWriter.java:273)
at
org.apache.parquet.hadoop.ParquetWriter$Builder.build(ParquetWriter.java:495)
at
org.apache.nifi.processors.parquet.FetchParquetTest.writeParquetUsers(FetchParquetTest.java:269)
at
org.apache.nifi.processors.parquet.FetchParquetTest.testIOExceptionWhileWritingShouldRouteToRetry(FetchParquetTest.java:233)
Running org.apache.nifi.processors.parquet.PutParquetTest
Tests run: 26, Failures: 13, Errors: 0, Skipped: 0, Time elapsed: 0.578 sec <<<
FAILURE! - in org.apache.nifi.processors.parquet.PutParquetTest
testDestinationExistsWithOverwriteShouldBeSuccessful(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.042 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testDestinationExistsWithOverwriteShouldBeSuccessful(PutParquetTest.java:322)
testWriteAvroAndRemoveCRCFiles(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.021 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testWriteAvroAndRemoveCRCFiles(PutParquetTest.java:169)
testWriteAvroParquetWithDefaults(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.022 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testWriteAvroParquetWithDefaults(PutParquetTest.java:126)
testInvalidAvroShouldRouteToFailure(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.029 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to failure
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testInvalidAvroShouldRouteToFailure(PutParquetTest.java:220)
testValidSchemaWithELShouldBeSuccessful(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.024 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testValidSchemaWithELShouldBeSuccessful(PutParquetTest.java:339)
testRowGroupSize(org.apache.nifi.processors.parquet.PutParquetTest) Time
elapsed: 0.023 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testRowGroupSize(PutParquetTest.java:513)
testReadAsStringAndWriteAsInt(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.022 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testReadAsStringAndWriteAsInt(PutParquetTest.java:639)
testDictionaryPageSize(org.apache.nifi.processors.parquet.PutParquetTest) Time
elapsed: 0.021 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testDictionaryPageSize(PutParquetTest.java:575)
testMaxPaddingPageSize(org.apache.nifi.processors.parquet.PutParquetTest) Time
elapsed: 0.026 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testMaxPaddingPageSize(PutParquetTest.java:606)
testPageSize(org.apache.nifi.processors.parquet.PutParquetTest) Time elapsed:
0.029 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testPageSize(PutParquetTest.java:544)
testMalformedRecordExceptionFromReaderShouldRouteToFailure(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.02 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to failure
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testMalformedRecordExceptionFromReaderShouldRouteToFailure(PutParquetTest.java:397)
testFailureExceptionRenamingShouldRouteToFailure(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.02 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to failure
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testFailureExceptionRenamingShouldRouteToFailure(PutParquetTest.java:494)
testWriteAvroWithGZIPCompression(org.apache.nifi.processors.parquet.PutParquetTest)
Time elapsed: 0.017 sec <<< FAILURE!
java.lang.AssertionError: Expected all Transferred FlowFiles to go to success
but 1 were routed to retry
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.nifi.util.MockProcessSession.assertAllFlowFilesTransferred(MockProcessSession.java:1155)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:275)
at
org.apache.nifi.util.StandardProcessorTestRunner.assertAllFlowFilesTransferred(StandardProcessorTestRunner.java:321)
at
org.apache.nifi.processors.parquet.PutParquetTest.testWriteAvroWithGZIPCompression(PutParquetTest.java:192)
Results :
Failed tests:
PutParquetTest.testDestinationExistsWithOverwriteShouldBeSuccessful:322
Expected all Transferred FlowFiles to go to success but 1 were routed to retry
PutParquetTest.testDictionaryPageSize:575 Expected all Transferred FlowFiles
to go to success but 1 were routed to retry
PutParquetTest.testFailureExceptionRenamingShouldRouteToFailure:494 Expected
all Transferred FlowFiles to go to failure but 1 were routed to retry
PutParquetTest.testInvalidAvroShouldRouteToFailure:220 Expected all
Transferred FlowFiles to go to failure but 1 were routed to retry
PutParquetTest.testMalformedRecordExceptionFromReaderShouldRouteToFailure:397
Expected all Transferred FlowFiles to go to failure but 1 were routed to retry
PutParquetTest.testMaxPaddingPageSize:606 Expected all Transferred FlowFiles
to go to success but 1 were routed to retry
PutParquetTest.testPageSize:544 Expected all Transferred FlowFiles to go to
success but 1 were routed to retry
PutParquetTest.testReadAsStringAndWriteAsInt:639 Expected all Transferred
FlowFiles to go to success but 1 were routed to retry
PutParquetTest.testRowGroupSize:513 Expected all Transferred FlowFiles to go
to success but 1 were routed to retry
PutParquetTest.testValidSchemaWithELShouldBeSuccessful:339 Expected all
Transferred FlowFiles to go to success but 1 were routed to retry
PutParquetTest.testWriteAvroAndRemoveCRCFiles:169 Expected all Transferred
FlowFiles to go to success but 1 were routed to retry
PutParquetTest.testWriteAvroParquetWithDefaults:126 Expected all Transferred
FlowFiles to go to success but 1 were routed to retry
PutParquetTest.testWriteAvroWithGZIPCompression:192 Expected all Transferred
FlowFiles to go to success but 1 were routed to retry
Tests in error:
FetchParquetTest.testFetchParquetToCSV:98->writeParquetUsers:269 ▒ IO (null)
e...
FetchParquetTest.testIOExceptionCreatingReaderShouldRouteToRetry:164->writeParquetUsers:269
▒ IO
FetchParquetTest.testIOExceptionWhileReadingShouldRouteToRetry:201->writeParquetUsers:269
▒ IO
FetchParquetTest.testIOExceptionWhileWritingShouldRouteToRetry:233->writeParquetUsers:269
▒ IO
Tests run: 32, Failures: 13, Errors: 4, Skipped: 0
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
