[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated ARROW-5410: Attachment: io-util-no-printf.asm > [C++] Crash at arrow::internal::FileWrite > - > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) >Reporter: Tham >Priority: Major > Labels: parquet > Attachments: io-util-add-more-log.asm, io-util-no-printf.asm, > io-util.asm > > > My application is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230 > `0033 7ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d > `0033 `0033 : ucrtbase!invalid_parameter+0x13f > 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02 > 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9 > 001e`10efe1f0 7ffc`032d926d : ` `0140 > `0005 0122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 001e`10efe250 7ff7`7f66585e : 0010`0005 ` > 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d > 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153 > 0122`bbe890e0 001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 001e`10efe360 7ff7`7f632442 : `348a `0004 > 733f`5e86f38c 0122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522 > 0122`bbffe6e0 ` : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0 > `0013 001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78 > 001e`10efe9c0 ` : > CortexSync!parquet::ThriftSerializer::Serialize+0x11f > 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450 > `0002 0122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250 > ` 0122`b168 : > CortexSync!parquet::TypedColumnWriterImpl > >::WriteDictionaryPage+0x143 > 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 ` > 0122`bbe3f540 0122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0 > 0122`bbec4bb0 0122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0 > 0122`bbe89390 ` : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430 > `000f ` : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8 > `3f80 ` : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated ARROW-5410: Attachment: io-util.asm > [C++] Crash at arrow::internal::FileWrite > - > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) >Reporter: Tham >Priority: Major > Labels: parquet > Attachments: io-util-add-more-log.asm, io-util.asm > > > My application is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230 > `0033 7ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d > `0033 `0033 : ucrtbase!invalid_parameter+0x13f > 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02 > 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9 > 001e`10efe1f0 7ffc`032d926d : ` `0140 > `0005 0122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 001e`10efe250 7ff7`7f66585e : 0010`0005 ` > 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d > 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153 > 0122`bbe890e0 001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 001e`10efe360 7ff7`7f632442 : `348a `0004 > 733f`5e86f38c 0122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522 > 0122`bbffe6e0 ` : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0 > `0013 001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78 > 001e`10efe9c0 ` : > CortexSync!parquet::ThriftSerializer::Serialize+0x11f > 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450 > `0002 0122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250 > ` 0122`b168 : > CortexSync!parquet::TypedColumnWriterImpl > >::WriteDictionaryPage+0x143 > 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 ` > 0122`bbe3f540 0122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0 > 0122`bbec4bb0 0122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0 > 0122`bbe89390 ` : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430 > `000f ` : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8 > `3f80 ` : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tham updated ARROW-5410: Attachment: io-util-add-more-log.asm > [C++] Crash at arrow::internal::FileWrite > - > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) >Reporter: Tham >Priority: Major > Labels: parquet > Attachments: io-util-add-more-log.asm > > > My application is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230 > `0033 7ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d > `0033 `0033 : ucrtbase!invalid_parameter+0x13f > 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02 > 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9 > 001e`10efe1f0 7ffc`032d926d : ` `0140 > `0005 0122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 001e`10efe250 7ff7`7f66585e : 0010`0005 ` > 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d > 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153 > 0122`bbe890e0 001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 001e`10efe360 7ff7`7f632442 : `348a `0004 > 733f`5e86f38c 0122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522 > 0122`bbffe6e0 ` : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0 > `0013 001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78 > 001e`10efe9c0 ` : > CortexSync!parquet::ThriftSerializer::Serialize+0x11f > 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450 > `0002 0122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250 > ` 0122`b168 : > CortexSync!parquet::TypedColumnWriterImpl > >::WriteDictionaryPage+0x143 > 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 ` > 0122`bbe3f540 0122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0 > 0122`bbec4bb0 0122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0 > 0122`bbe89390 ` : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430 > `000f ` : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8 > `3f80 ` : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-5410: -- Component/s: C++ > [C++] Crash at arrow::internal::FileWrite > - > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Components: C++ > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) >Reporter: Tham >Priority: Major > Labels: parquet > > My application is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230 > `0033 7ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d > `0033 `0033 : ucrtbase!invalid_parameter+0x13f > 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02 > 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9 > 001e`10efe1f0 7ffc`032d926d : ` `0140 > `0005 0122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 001e`10efe250 7ff7`7f66585e : 0010`0005 ` > 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d > 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153 > 0122`bbe890e0 001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 001e`10efe360 7ff7`7f632442 : `348a `0004 > 733f`5e86f38c 0122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522 > 0122`bbffe6e0 ` : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0 > `0013 001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78 > 001e`10efe9c0 ` : > CortexSync!parquet::ThriftSerializer::Serialize+0x11f > 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450 > `0002 0122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250 > ` 0122`b168 : > CortexSync!parquet::TypedColumnWriterImpl > >::WriteDictionaryPage+0x143 > 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 ` > 0122`bbe3f540 0122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0 > 0122`bbec4bb0 0122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0 > 0122`bbe89390 ` : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430 > `000f ` : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8 > `3f80 ` : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite
[ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-5410: Summary: [C++] Crash at arrow::internal::FileWrite (was: Crash at arrow::internal::FileWrite) > [C++] Crash at arrow::internal::FileWrite > - > > Key: ARROW-5410 > URL: https://issues.apache.org/jira/browse/ARROW-5410 > Project: Apache Arrow > Issue Type: Bug > Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616) >Reporter: Tham >Priority: Major > Labels: parquet > > My application is writing a bunch of parquet files and it often crashes. Most > of the time it crashes when writing the first file, sometimes it can write > the first file and crashing at the 2nd file. The file can always be opened. > It only crashes at writeTable. > As I tested, my application crashes when build with release mode, but don't > crash with debug mode. It crashed only on one Windows machine, not others. > Here is stack trace from dump file: > {code:java} > STACK_TEXT: > 001e`10efd840 7ffc`0333d53f : ` 001e`10efe230 > `0033 7ffc`032dbe21 : > CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 > 001e`10efe170 7ffc`0333d559 : `ff02 7ffc`032da63d > `0033 `0033 : ucrtbase!invalid_parameter+0x13f > 001e`10efe1b0 7ffc`03318664 : 7ff7`7f7c8489 `ff02 > 001e`10efe230 `0033 : ucrtbase!invalid_parameter_noinfo+0x9 > 001e`10efe1f0 7ffc`032d926d : ` `0140 > `0005 0122`bbe61e30 : > ucrtbase!_acrt_uninitialize_command_line+0x6fd4 > 001e`10efe250 7ff7`7f66585e : 0010`0005 ` > 001e`10efe560 0122`b2337b88 : ucrtbase!write+0x8d > 001e`10efe2a0 7ff7`7f632785 : 7ff7` 7ff7`7f7bb153 > 0122`bbe890e0 001e`10efe634 : > CortexSync!arrow::internal::FileWrite+0x5e > 001e`10efe360 7ff7`7f632442 : `348a `0004 > 733f`5e86f38c 0122`bbe14c40 : > CortexSync!arrow::io::OSFile::Write+0x1d5 > 001e`10efe510 7ff7`7f71c1b9 : 001e`10efe738 7ff7`7f665522 > 0122`bbffe6e0 ` : > CortexSync!arrow::io::FileOutputStream::Write+0x12 > 001e`10efe540 7ff7`7f79cb2f : 0122`bbe61e30 0122`bbffe6e0 > `0013 001e`10efe730 : > CortexSync!parquet::ArrowOutputStream::Write+0x39 > 001e`10efe6e0 7ff7`7f7abbaf : 7ff7`7fd75b78 7ff7`7fd75b78 > 001e`10efe9c0 ` : > CortexSync!parquet::ThriftSerializer::Serialize+0x11f > 001e`10efe8c0 7ff7`7f7aaf93 : ` 0122`bbe3f450 > `0002 0122`bc0218d0 : > CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f > 001e`10efee20 7ff7`7f7a3707 : 0122`bbe3f450 001e`10eff250 > ` 0122`b168 : > CortexSync!parquet::TypedColumnWriterImpl > >::WriteDictionaryPage+0x143 > 001e`10efeed0 7ff7`7f710480 : 001e`10eff1c0 ` > 0122`bbe3f540 0122`b2439998 : > CortexSync!parquet::ColumnWriterImpl::Close+0x47 > 001e`10efef60 7ff7`7f7154da : 0122`bbec3cd0 001e`10eff1c0 > 0122`bbec4bb0 0122`b2439998 : > CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting > destructor'+0x100 > 001e`10efefa0 7ff7`7f71619c : ` 001e`10eff1c0 > 0122`bbe89390 ` : > CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa > 001e`10eff150 7ff7`7f202de9 : `0001 001e`10eff430 > `000f ` : > CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc > 001e`10eff410 7ff7`7f18baf3 : 0122`bbec39b0 0122`b24c53f8 > `3f80 ` : > CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} > I tried a lot of ways to find out the root cause, but failed. Can anyone here > give me some information/advice please, so that I can investigate more? > Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)