Tham created ARROW-5410:
---------------------------
Summary: Crash at arrow::internal::FileWrite
Key: ARROW-5410
URL: https://issues.apache.org/jira/browse/ARROW-5410
Project: Apache Arrow
Issue Type: Bug
Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
Reporter: Tham
My applicationĀ is writing a bunch of parquet files and it often crashes. Most
of the time it crashes when writing the first file, sometimes it can write the
first file and crashing at the 2nd file. The file can always be opened. It only
crashes at writeTable.
As I tested, my application crashes when build with release mode, but don't
crash with debug mode. It crashed only on one Windows machine, not others.
Here is stack trace from dump file:
{code:java}
STACK_TEXT:
0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230
00000000`00000033 00007ffc`032dbe21 :
CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d
00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f
0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02
0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9
0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140
00000000`00000005 00000122`bbe61e30 :
ucrtbase!_acrt_uninitialize_command_line+0x6fd4
0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000
0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d
0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153
00000122`bbe890e0 0000001e`10efe634 : CortexSync!arrow::internal::FileWrite+0x5e
0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004
0000733f`5e86f38c 00000122`bbe14c40 : CortexSync!arrow::io::OSFile::Write+0x1d5
0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522
00000122`bbffe6e0 00000000`ffffffff :
CortexSync!arrow::io::FileOutputStream::Write+0x12
0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0
00000000`00000013 0000001e`10efe730 :
CortexSync!parquet::ArrowOutputStream::Write+0x39
0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78
0000001e`10efe9c0 00000000`00000000 :
CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f
0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450
00000000`00000002 00000122`bc0218d0 :
CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250
00000000`00000000 00000122`b1680000 :
CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5>
>::WriteDictionaryPage+0x143
0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000
00000122`bbe3f540 00000122`b2439998 :
CortexSync!parquet::ColumnWriterImpl::Close+0x47
0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0
00000122`bbec4bb0 00000122`b2439998 :
CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting destructor'+0x100
0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0
00000122`bbe89390 00000000`00000000 :
CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430
00000000`0000000f 00000000`00000000 :
CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8
00000000`3f800000 00000000`00000000 :
CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
I tried a lot of ways to find out the root cause, but failed. Can anyone here
give me some information/advice please, so that I can investigate more? Thanks!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)