[ 
https://issues.apache.org/jira/browse/IMPALA-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573480#comment-16573480
 ] 

Tim Armstrong commented on IMPALA-7402:
---------------------------------------

Tests running at the time:
{noformat}

03:52:28 [gw5] PASSED 
query_test/test_scratch_limit.py::TestScratchLimit::test_with_zero_scratch_limit_no_memory_limit[exec_option:
 {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000, 
'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 
'exec_single_node_rows_threshold': 0} | table_format: text/none] 
03:53:21 
query_test/test_sort.py::TestQueryFullSort::test_multiple_buffer_pool_limits[exec_option:
 {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 
'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 
'exec_single_node_rows_threshold': 0} | table_format: parquet/none] 
03:53:21 [gw3] FAILED 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling[exec_option:
 {'debug_action': '-1:OPEN:[email protected]', 
'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
03:53:22 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_aggs[exec_option:
 {'debug_action': None, 'default_spillable_buffer_size': '256k'} | 
table_format: parquet/none] 
03:53:22 [gw3] FAILED 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_aggs[exec_option:
 {'debug_action': None, 'default_spillable_buffer_size': '256k'} | 
table_format: parquet/none] 
03:53:23 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_aggs[exec_option:
 {'debug_action': '-1:OPEN:[email protected]', 
'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
03:53:23 [gw3] FAILED 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_aggs[exec_option:
 {'debug_action': '-1:OPEN:[email protected]', 
'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
03:53:24 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_large_rows[exec_option:
 {'debug_action': None, 'default_spillable_buffer_size': '256k'} | 
table_format: parquet/none] 
03:53:24 [gw3] FAILED 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_large_rows[exec_option:
 {'debug_action': None, 'default_spillable_buffer_size': '256k'} | 
table_format: parquet/none] 
03:53:28 
query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_large_rows[exec_option:
 {'debug_action': '-1:OPEN:[email protected]', 
'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
03:53:28 [gw2] PASSED 
query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_decimal_tbl[exec_option:
 {'debug_action': None, 'abort_on_error': False, 'mem_limit': '512m', 
'num_nodes': 0} | table_format: parquet/none] 
03:53:29 
query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_decimal_tbl[exec_option:
 {'debug_action': None, 'abort_on_error': False, 'mem_limit': '512m', 
'num_nodes': 0} | table_format: avro/snap/block] 
03:53:29 [gw1] FAILED 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q53[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:53:33 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q54[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:53:33 [gw7] FAILED 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q4[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:53:35 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q6[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:53:35 [gw0] FAILED 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q75[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:54:08 
query_test/test_tpcds_queries.py::TestTpcdsQuery::test_tpcds_q76[exec_option: 
{'decimal_v2': 0, 'batch_size': 0, 'num_nodes': 0, 
'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 
'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 
0} | table_format: parquet/none] 
03:54:08 [gw2] PASSED 
query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_decimal_tbl[exec_option:
 {'debug_action': None, 'abort_on_error': False, 'mem_limit': '512m', 
'num_nodes': 0} | table_format: avro/snap/block] 
{noformat}

> DCHECK failed min_bytes_to_write <= dirty_unpinned_pages_ in buffer-pool
> ------------------------------------------------------------------------
>
>                 Key: IMPALA-7402
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7402
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 3.1.0
>            Reporter: Vuk Ercegovac
>            Assignee: Tim Armstrong
>            Priority: Blocker
>              Labels: broken-build
>
> One of the impalad's crashed with the following DCHECK failure:
> {noformat}
> F0806 01:26:21.905500  5101 buffer-pool.cc:645] Check failed: 
> min_bytes_to_write <= dirty_unpinned_pages_.bytes() (8192 vs. 0)
> Here is the backtrace:{noformat}
> {noformat}
> #0 0x0000003af1e328e5 in raise () from /lib64/libc.so.6 
> #1 0x0000003af1e340c5 in abort () from /lib64/libc.so.6 
> #2 0x000000000437f454 in google::DumpStackTraceAndExit() () 
> #3 0x0000000004375ead in google::LogMessage::Fail() () 
> #4 0x0000000004377752 in google::LogMessage::SendToLog() () 
> #5 0x0000000004375887 in google::LogMessage::Flush() () 
> #6 0x0000000004378e4e in google::LogMessageFatal::~LogMessageFatal() () 
> #7 0x000000000205ad16 in impala::BufferPool::Client::WriteDirtyPagesAsync 
> (this=0x17d03f0e0, min_bytes_to_write=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/runtime/bufferpool/buffer-pool.cc:645
>  
> #8 0x000000000205a835 in impala::BufferPool::Client::CleanPages 
> (this=0x17d03f0e0, client_lock=0x7f324cb12220, len=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/runtime/bufferpool/buffer-pool.cc:625
>  
> #9 0x000000000205a646 in impala::BufferPool::Client::DecreaseReservationTo 
> (this=0x17d03f0e0, max_decrease=8192, target_bytes=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/runtime/bufferpool/buffer-pool.cc:609
>  
> #10 0x0000000002057583 in 
> impala::BufferPool::ClientHandle::DecreaseReservationTo (this=0x181c0a990, 
> max_decrease=8192, target_bytes=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/runtime/bufferpool/buffer-pool.cc:319
>  
> #11 0x00000000020d9419 in 
> impala::HdfsScanNode::ReturnReservationFromScannerThread (this=0x181c0a800, 
> lock=..., bytes=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/exec/hdfs-scan-node.cc:194
>  
> #12 0x00000000020da485 in impala::HdfsScanNode::ScannerThread 
> (this=0x181c0a800, first_thread=false, scanner_thread_reservation=8192) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/exec/hdfs-scan-node.cc:367
>  
> #13 0x00000000020d96b0 in impala::HdfsScanNode::<lambda()>::operator()(void) 
> const (__closure=0x7f324cb12b88) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/repos/Impala/be/src/exec/hdfs-scan-node.cc:261
>  
> #14 0x00000000020db6d6 in 
> boost::detail::function::void_function_obj_invoker0<impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::<lambda()>,
>  void>::invoke(boost::detail::function::function_buffer &) 
> (function_obj_ptr=...) at 
> /data/jenkins/workspace/impala-cdh6.x-exhaustive-centos6/Impala-Toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:153
> ...
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to