Hello,
Downloaded latest FastBit. Compiled it under Ubuntu 10.04 and Windows 7
using Visual Studio Express 2010 (32bit).
I made test partition with 20M rows. Everything runs fine so far with
adding and querying test partition.
I experience following problem trying to use ibis.exe program or
directly use ibis::part::deactivate() function.
O:\FastBitTest\Run>ibis.exe -d test -y book_id=40
doDeletion -- deactivate(test, book_id=40) returned 284830
O:\FastBitTest\Run>ibis.exe -d test -y book_id=41
Warning ** ibis.exe received a string exception
bitvector::write failed to open file
The fault happens when -part.msk file exists. If I delete it the next
operation is successful.
Same test scenario runs excellent in Ubuntu.
I am attaching verbose 20 log file.
There can be seen a message saying:
"Warning -- bitvector::write failed to open "test\-part.msk" to write
the bit vector ... Permission denied"
Any help will be much appreciated.
Regards,
Chavdar Kopoev
Log file log.txt for FastBit ibis opened on Tue Nov 16 16:12:07 2010
ibis: batch mode, log level 20
resource::read -- can not open any of the following configuration files:
ibis.rc
.ibisrc
fileManager::ctor found the physical memory size to be 4190388224 bytes
fileManager initialization complete -- maxBytes=2095194112, maxOpenFiles=60
util::gatherParts -- examining test
fileManager::storage(00F66BF0, 00000000) initialization completed
array_t<unsigned int> constructed at 00F62CF0 with actual=00F66BF0,
m_begin=00000000 and actual->size()=0
bitvector (00F62CE0) constructed with m_vec at 00F62CF0
part::readMetaData -- opened test\-part.txt for reading
Name = "test"
Description = "ardea.exe -d test -m active:int, book_id:int, match_id:int,
odd_hc:float, odd_price:float -t fastbit.csv"
Number_of_columns = 5
Number_of_rows = 20000000
Timestamp = 1289561377
State = 1
END HEADER
fileManager::storage(00F66C50, 00000000) initialization completed
array_t<unsigned int> constructed at 00BE1E44 with actual=00F66C50,
m_begin=00000000 and actual->size()=0
bitvector (00BE1E34) constructed with m_vec at 00BE1E44
read info about column active for partition test
part::readMetaData -- got column active from test\-part.txt
fileManager::storage(00F66C90, 00000000) initialization completed
array_t<unsigned int> constructed at 00BE1EF4 with actual=00F66C90,
m_begin=00000000 and actual->size()=0
bitvector (00BE1EE4) constructed with m_vec at 00BE1EF4
read info about column book_id for partition test
part::readMetaData -- got column book_id from test\-part.txt
fileManager::storage(00F66CD0, 00000000) initialization completed
array_t<unsigned int> constructed at 00F68E9C with actual=00F66CD0,
m_begin=00000000 and actual->size()=0
bitvector (00F68E8C) constructed with m_vec at 00F68E9C
read info about column match_id for partition test
part::readMetaData -- got column match_id from test\-part.txt
fileManager::storage(00F66D10, 00000000) initialization completed
array_t<unsigned int> constructed at 00F68F4C with actual=00F66D10,
m_begin=00000000 and actual->size()=0
bitvector (00F68F3C) constructed with m_vec at 00F68F4C
read info about column odd_hc for partition test
part::readMetaData -- got column odd_hc from test\-part.txt
fileManager::storage(00F66D50, 00000000) initialization completed
array_t<unsigned int> constructed at 00F68FFC with actual=00F66D50,
m_begin=00000000 and actual->size()=0
bitvector (00F68FEC) constructed with m_vec at 00F68FFC
read info about column odd_price for partition test
part::readMetaData -- got column odd_price from test\-part.txt
part[test]::gainReadAccess -- pthread_rwlock_rdlock(00F62D38) for readRIDs
fileManager::storage(00F66C10, 00000000) initialization completed
array_t<union ibis::rid_t> constructed at 00F62A58 with actual=00F66C10,
m_begin=00000000 and actual->size()=0
fileManager::getFile(test\-rids) -- command stat failed: No such file or
directory
fileManager::getFile -- got 0 ints from test\-rids
part[test]::readRIDs -- the file manager failed to read file "test\-rids".
There is no RIDs.
part[test]::releaseAccess -- pthread_rwlock_unlock(00F62D38) for readRIDs
util::mutexLock -- acquiring lock (00A86340) for
fileManager::getFile(test\-part.msk)
fileManager::getFile(test\-part.msk) -- attempting to read test\-part.msk
(1523980 bytes)
fileManager::storage(00BE1F88, 00000000) initialization completed
fileManager::roFile::clear(00BE1F88, 00000000) ...
roFile::doMap(00BE1F88, 00F70000, test\-part.msk, 0, 1523980, read-only)
initialization completed
roFile::doMap(00BE1F88, 00F70000, test\-part.msk, 0, 1523980, read-only) added
1523980 bytes to increase totalBytes to 1,523,980
fileManager::recordFile(00BE1F88, 00F70000, 1523980, test\-part.msk) -- record
storage object 00BE1F88
fileManager::getFile(test\-part.msk) -- completed mmapping 1523980 bytes from
test\-part.msk
fileManager::getFile(test\-part.msk) took 0.000431962 sec(elapsed) [0.001
sec(CPU)] to mmap 1523980 bytes at a speed of 3528.04 MB/s [1523.98]
file name: test\-part.msk
storage @ 00BE1F88, 00F70000, 1st 32 bits = ffff, 1st 64 bits = c00000040000ffff
file descriptor 000000E0
fmap handle 00000184
base address 00F70000
mapped y opened at Tue Nov 16 16:12:07 2010 last
used at Thu Jan 01 02:00:00 1970
# of bytes 1523980 # of past acc 0 # of active acc 0
util::mutexLock -- releasing lock (00A86340) for
fileManager::getFile(test\-part.msk)
fileManager::gainReadAccess on 00A8633C for test\-part.msk
array_t<unsigned int> constructed at 0018EFBC with actual=00BE1F88
m_begin=00F70000 and actual->size()=1523980
array_t<unsigned int>::freeMemory this=0018EFBC actual=00F66BF0 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66BF0, 00000000) ...
fileManager::getFile -- got 380995 ints from test\-part.msk
part::init -- mask for partition test has 19714419 set bits out of 20000000
util::mutexLock -- acquiring lock (00A86340) for fileManager::addCleaner
util::mutexLock -- releasing lock (00A86340) for fileManager::addCleaner
Completed construction of an part named test
activeDir = "test"
part: test (ardea.exe -d test -m active:int, book_id:int, match_id:int,
odd_hc:float, odd_price:float -t fastbit.csv) with 20000000 rows, 5 columns
Column list:
active: (INT) [0, 1]
book_id: (INT) [0, 69]
match_id: (INT) [0, 10222]
odd_hc: (FLOAT) [0, 4.5]
odd_price: (FLOAT) [1, 5.99]
util::mutexLock -- acquiring lock (00A82FF0) for gatherParts
util::mutexLock -- releasing lock (00A82FF0) for gatherParts
Partition[1]:
test
Warning -- getFileSize(book_id=53) failed ... No such file or directory
doDeletion will invoke deactive on 1 data partition with "book_id=53"
fileManager::storage(00F66D90, 00000000) initialization completed
array_t<unsigned int> constructed at 0018F3D8 with actual=00F66D90,
m_begin=00000000 and actual->size()=0
bitvector (0018F3C8) constructed with m_vec at 0018F3D8
newToken -- constructing token from uid chapa (1093130533), time 1289916727,
sequence number 1
newToken -- generated new token "FHUO8JnXZIR----0" for user chapa
query FHUO8JnXZIR----0 constructed for chapa
whereClause::ctor to parse "book_id=53"
qExpr::simplify -- input expression book_id == 53
qExpr::simplify -- output expression (@00F676C8) book_id == 53
qExpr::simplify -- input expression book_id == 53
qExpr::simplify -- output expression (@00F676C8) book_id == 53
query[FHUO8JnXZIR----0]::setWhereClause -- add a new where clause "book_id=53".
query[FHUO8JnXZIR----0]::gainWriteAccess -- acquiring a write lock for
setWhereClause
query[FHUO8JnXZIR----0]::releaseAccess -- releasing rwlock for setWhereClause
query[FHUO8JnXZIR----0]::setWhereClause -- where "book_id=53"
Translated the WHERE clause into: book_id == 53
query[FHUO8JnXZIR----0]::gainReadAccess -- acquiring a read lock for
getExpandedHits
part[test]::gainReadAccess -- pthread_rwlock_rdlock(00F62D38) for
FHUO8JnXZIR----0
query[FHUO8JnXZIR----0]::doEvaluate -- starting to evaluate book_id == 53
fileManager::storage(00F66E10, 00000000) initialization completed
array_t<unsigned int> constructed at 0018E7CC with actual=00F66E10,
m_begin=00000000 and actual->size()=0
bitvector (0018E7BC) constructed with m_vec at 0018E7CC
bitvector (0018E7BC) clear the content of bitvector with m_vec at 0018E7CC
fileManager::storage::storage(28) ...
fileManager::storage(00F66E30, 00F686C0) initialization completed
fileManager::storage(00F66E30, 00F686C0) added 28 bytes to increase totalBytes
to 1,524,008
array_t<unsigned int> constructed at 0018E5FC with 7 elements, actual=00F66E30,
m_begin=00F686C0 and actual->size()=28
array_t<unsigned int>::freeMemory this=0018E5FC actual=00F66E10 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66E10, 00000000) ...
fileManager::storage(00F66E10, 00000000) initialization completed
array_t<unsigned int> constructed at 0018E544 with actual=00F66E10,
m_begin=00000000 and actual->size()=0
bitvector (0018E534) constructed with m_vec at 0018E544
util::mutexLock -- acquiring lock (00BE1F7C) for column::getNullMask
fileManager::storage(00F66EB0, 00000000) initialization completed
array_t<unsigned int> constructed at 0018E3D0 with actual=00F66EB0,
m_begin=00000000 and actual->size()=0
fileManager::getFile(test\book_id.msk) -- command stat failed: No such file or
directory
fileManager::getFile -- got 0 ints from test\book_id.msk
bitvector (0018E534) clear the content of bitvector with m_vec at 0018E544
fileManager::storage::storage(28) ...
fileManager::storage(00F66E90, 00F686E8) initialization completed
fileManager::storage(00F66E90, 00F686E8) added 28 bytes to increase totalBytes
to 1,524,036
array_t<unsigned int> constructed at 0018E26C with 7 elements, actual=00F66E90,
m_begin=00F686E8 and actual->size()=28
array_t<unsigned int>::freeMemory this=0018E26C actual=00F66E10 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66E10, 00000000) ...
column[test.book_id](INT)::getNullMask -- get null mask (20000000, 20000000)
[st.st_size=80000000, sz=20000000, ierr=-101]
array_t<unsigned int> constructed at 0018E410 with actual=00F66E90,
m_begin=00F686E8 and actual->size()=28, copied from 0018E544
bitvector (0018E400) constructed with m_vec at 0018E410 as a copy of 0018E534
with m_vec at 0018E544
bitvector (0018E400) clear the content of bitvector with m_vec at 0018E410
array_t<unsigned int>::freeMemory this=0018E410 actual=00F66C90 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66C90, 00000000) ...
array_t<unsigned int>::freeMemory this=0018E3D0 actual=00F66EB0 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66EB0, 00000000) ...
column[test.book_id](INT)::getNullMask -- mask size = 20000000, cnt = 20000000
util::mutexLock -- releasing lock (00BE1F7C) for column::getNullMask
fileManager::storage::storage(00F686E8, 00F686EC) ...
fileManager::storage(00F66EB0, 00BE1998) initialization completed
fileManager::storage(00F66EB0, 00BE1998) added 4 bytes to increase totalBytes
to 1,524,040
bitvector (0018F3C8) clear the content of bitvector with m_vec at 0018F3D8
fileManager::storage(00F66C90, 00000000) initialization completed
array_t<unsigned int> constructed at 0018E528 with actual=00F66C90,
m_begin=00000000 and actual->size()=0
bitvector (0018E518) constructed with m_vec at 0018E528
column[test.book_id]::readLock -- pthread_rwlock_rdlock(00BE1F78) for
evaluateRange
column[test.book_id]::readLock -- pthread_rwlock_unlock(00BE1F78) for
evaluateRange
column[test.book_id]::writeLock -- pthread_rwlock_wrlock(00BE1F78) for loadIndex
column[test.book_id](INT)::loadIndex -- loading the index from test
column[test.book_id](INT)::index::create -- invoking the index factory with
spec=`default' and source=test)
fileManager::storage(00F66E10, 00000000) initialization completed
array_t<int> constructed at 00F690B8 with actual=00F66E10, m_begin=00000000 and
actual->size()=0
fileManager::storage(00F66E70, 00000000) initialization completed
array_t<__int64> constructed at 00F690C4 with actual=00F66E70, m_begin=00000000
and actual->size()=0
fileManager::getFileSegment(test\book_id.idx, 4, 16, 300) ...
fileManager::storage::storage(284) ...
fileManager::storage(0018CCF0, 00F67700) initialization completed
fileManager::storage(0018CCF0, 00F67700) added 284 bytes to increase totalBytes
to 1,524,324
fileManager::storage::clear(0018CCF0, 00000000) ...
fileManager::storage::read(fdes=4, begin=16, end=300) -- read 284 bytes in
6.07828e-006 sec(elapsed) [0 sec(CPU)] at a speed of 46.7 MB/s [0]
fileManager::getFileSegment(test\book_id.idx, 4, 16, 300) completed reading 284
bytes
fileManager::getFileSegment(test\book_id.idx, 4, 16, 300) took 0.000114271
sec(elapsed) [0 sec(CPU)] to read 284 bytes at a speed of 2.48531 MB/s [0]
storage @ 00F66ED0, 00F67700, 1st 32 bits = 12c, 1st 64 bits = 1741c80000012c
# of bytes 284 # of past acc 0 # of active acc 0
array_t<int> constructed at 0018D914 with actual=00F66ED0 and m_begin=00F67700,
content from file test\book_id.idx beginning at 16 ending at 300
array_t<int>::freeMemory this=0018D914 actual=00F66E10 and m_begin=00000000
(active references: 1, past references: 0)
fileManager::storage::clear(00F66E10, 00000000) ...
direkte[book_id]::read(test\book_id.idx) finished reading index header with
nrows=20000000 and bits.size()=70
column[test.book_id](INT)::readIndex -- the direct index was read (test) in
0.001 sec(CPU), 0.000584323 sec(elapsed)
The direct bitmap index for book_id contains 70 bit vectors
The direct bitmap index for book_id contains 70 bit vectors
util::mutexLock -- acquiring lock (00BE1F7C) for loadIndex
util::mutexLock -- releasing lock (00BE1F7C) for loadIndex
column[test.book_id]::writeLock -- pthread_rwlock_unlock(00BE1F78) for loadIndex
column[test.book_id]::indexLock -- pthread_rwlock_rdlock(00BE1F78) for
evaluateRange
bitvector (0018E518) clear the content of bitvector with m_vec at 0018E528
index[book_id]::sumBins(53, 54, res(0, 0)) ...
column[test.book_id](INT)::gainExclusiveAccess -- pthread_mutex_lock for
index[test.book_id]::activate
index[test.book_id]::activate(53, 54) using file "test\book_id.idx"
fileManager::storage::storage(1522568) ...
fileManager::storage(0018DC48, 010F0020) initialization completed
fileManager::storage(0018DC48, 010F0020) added 1522568 bytes to increase
totalBytes to 3,046,892
fileManager::storage::clear(0018DC48, 00000000) ...
fileManager::storage::read(fdes=4, begin=80725380, end=82247948) -- read
1522568 bytes in 0.00128778 sec(elapsed) [0.001 sec(CPU)] at a speed of
1.18e+003 MB/s [1.52e+003]
array_t<unsigned int> constructed at 0018E154 with actual=00F66E10,
m_begin=010F0020 and m_end=01263BA8 using section [0, 1522568) from 00F66E10
array_t<unsigned int> constructed at 00F68720 with actual=00F66E10,
m_begin=010F0020 and actual->size()=1522568, copied from 0018E154
bitvector (00F68710) constructed with m_vec at 00F68720 based on an
array_t<word_t> at 0018E154 with m_begin at 010F0020
array_t<unsigned int>::freeMemory this=0018E154 actual=00F66E10 and
m_begin=010F0020 (active references: 2, past references: 0)
column[test.book_id](INT)::releaseExclusiveAccess -- pthread_mutex_unlock for
index[test.book_id]::activate
fileManager::storage::storage(1522560) ...
fileManager::storage(00F66EF0, 01270020) initialization completed
fileManager::storage(00F66EF0, 01270020) added 1522560 bytes to increase
totalBytes to 4,569,452
array_t<unsigned int> constructed at 0018E214 with 380640 elements,
actual=00F66EF0, m_begin=01270020 and actual->size()=1522560
array_t<unsigned int>::freeMemory this=0018E214 actual=00F66D90 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66D90, 00000000) ...
column[test.book_id]::indexLock -- pthread_rwlock_unlock(00BE1F78) for
evaluateRange
column[test.book_id]::evaluateRange(book_id == 53, mask(20000000, 20000000))
completed with low.size() = 20000000, low.cnt() = 285918, and ierr = 285918
bitvector (0018E518) clear the content of bitvector with m_vec at 0018E528
array_t<unsigned int>::freeMemory this=0018E528 actual=00F66C90 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66C90, 00000000) ...
bitvector (0018E534) clear the content of bitvector with m_vec at 0018E544
array_t<unsigned int>::freeMemory this=0018E544 actual=00F66EB0 and
m_begin=00BE1998 (active references: 1, past references: 0)
fileManager::storage::clear(00F66EB0, 00BE1998) ...
fileManager::storage::clear(00F66EB0, 00BE1998) removed 4 bytes to decrease
totalBytes to 4,569,448
part[test]::evaluateRange(book_id == 53), ierr = 285918
bitvector (0018E7BC) clear the content of bitvector with m_vec at 0018E7CC
array_t<unsigned int>::freeMemory this=0018E7CC actual=00F66E30 and
m_begin=00F686C0 (active references: 1, past references: 0)
fileManager::storage::clear(00F66E30, 00F686C0) ...
fileManager::storage::clear(00F66E30, 00F686C0) removed 28 bytes to decrease
totalBytes to 4,569,420
query[FHUO8JnXZIR----0]::doEvaluate(00F676C8: book_id == 53) --> 285918, ierr =
285918
part[test]::releaseAccess -- pthread_rwlock_unlock(00F62D38) for
FHUO8JnXZIR----0
query[FHUO8JnXZIR----0]::releaseAccess -- releasing rwlock for getExpandedHits
query[FHUO8JnXZIR----0]::clear -- clearing stored information
query[FHUO8JnXZIR----0]::gainWriteAccess -- acquiring a write lock for clear
query[FHUO8JnXZIR----0]::releaseAccess -- releasing rwlock for clear
part[test]::deactivate translated "book_id=53" into 285918 rows
part[test]::gainWriteAccess -- pthread_rwlock_wrlock(00F62D38) for deactivate
fileManager::storage::storage(00F70000, 010E4104) ...
fileManager::storage(00F66DF0, 013F0020) initialization completed
fileManager::storage(00F66DF0, 013F0020) added 1523972 bytes to increase
totalBytes to 6,093,392
fileManager::releaseAccess on 00A8633C for test\-part.msk
fileManager::storage(00F66E30, 00000000) initialization completed
array_t<unsigned int> constructed at 0018F1E0 with actual=00F66E30,
m_begin=00000000 and actual->size()=0
bitvector (0018F1D0) constructed with m_vec at 0018F1E0
fileManager::storage::storage(2580644) ...
fileManager::storage(0018EFB8, 01570020) initialization completed
fileManager::storage(0018EFB8, 01570020) added 2580644 bytes to increase
totalBytes to 8,674,036
fileManager::storage::clear(0018EFB8, 00000000) ...
bitvector (0018F1D0) clear the content of bitvector with m_vec at 0018F1E0
array_t<unsigned int>::freeMemory this=0018F1E0 actual=00F66DF0 and
m_begin=013F0020 (active references: 1, past references: 0)
fileManager::storage::clear(00F66DF0, 013F0020) ...
fileManager::storage::clear(00F66DF0, 013F0020) removed 1523972 bytes to
decrease totalBytes to 7,150,064
Warning -- bitvector::write failed to open "test\-part.msk" to write the bit
vector ... Permission denied
part[test]::releaseAccess -- pthread_rwlock_unlock(00F62D38) for deactivate
bitvector (0018F3C8) clear the content of bitvector with m_vec at 0018F3D8
array_t<unsigned int>::freeMemory this=0018F3D8 actual=00F66EF0 and
m_begin=01270020 (active references: 1, past references: 0)
fileManager::storage::clear(00F66EF0, 01270020) ...
fileManager::storage::clear(00F66EF0, 01270020) removed 1522560 bytes to
decrease totalBytes to 5,627,504
Warning ** ibis received a string exception
bitvector::write failed to open file
fileManager::clear -- starting ...
--- Tue Nov 16 16:12:07 2010
The number of memory mapped files is 1. (max = 60)
file name: test\-part.msk
storage @ 00BE1F88, 00F70000, 1st 32 bits = ffff, 1st 64 bits = c00000040000ffff
file descriptor 000000E0
fmap handle 00000184
base address 00F70000
mapped y opened at Tue Nov 16 16:12:07 2010 last
used at Tue Nov 16 16:12:07 2010
# of bytes 1523980 # of past acc 1 # of active acc 0
Size of all mapped files is 1,523,980
The number of files read into memory is 0
The total size of all files read into memory is 0
Size of all named storages is 1,523,980
Size of all unnamed storages is 4,103,524
The total size of all named and unnamed storages is 5,627,504
The prescribed maximum size is 2,095,194,112
Number of pages accessed (recorded so far) is 375 (page size = 4096)
util::mutexLock -- acquiring lock (00A86340) for fileManager::clear
fileManager invoking registered external cleaners ...
column[test.book_id]::softWriteLock -- pthread_rwlock_trywrlock(00BE1F78) for
unloadIndex
bitvector (00F68710) clear the content of bitvector with m_vec at 00F68720
array_t<unsigned int>::freeMemory this=00F68720 actual=00F66E10 and
m_begin=010F0020 (active references: 1, past references: 1)
fileManager::storage::clear(00F66E10, 010F0020) ...
fileManager::storage::clear(00F66E10, 010F0020) removed 1522568 bytes to
decrease totalBytes to 4,104,936
array_t<__int64>::freeMemory this=00F690C4 actual=00F66E70 and m_begin=00000000
(active references: 1, past references: 0)
fileManager::storage::clear(00F66E70, 00000000) ...
array_t<int>::freeMemory this=00F690B8 actual=00F66ED0 and m_begin=00F67700
(active references: 1, past references: 0)
fileManager::storage::clear(00F66ED0, 00F67700) ...
fileManager::storage::clear(00F66ED0, 00F67700) removed 284 bytes to decrease
totalBytes to 4,104,652
column[test.book_id](INT)::unloadIndex -- successfully removed the index
column[test.book_id]::softWriteLock -- pthread_rwlock_unlock(00BE1F78) for
unloadIndex
part[test]::unloadIndexes -- unloaded all indexes of this data partition
fileManager -- external cleaners reduce totalBytes from 5627504 to 4104652
--- Tue Nov 16 16:12:07 2010
The number of memory mapped files is 1. (max = 60)
file name: test\-part.msk
storage @ 00BE1F88, 00F70000, 1st 32 bits = ffff, 1st 64 bits = c00000040000ffff
file descriptor 000000E0
fmap handle 00000184
base address 00F70000
mapped y opened at Tue Nov 16 16:12:07 2010 last
used at Tue Nov 16 16:12:07 2010
# of bytes 1523980 # of past acc 1 # of active acc 0
Size of all mapped files is 1,523,980
The number of files read into memory is 0
The total size of all files read into memory is 0
Size of all named storages is 1,523,980
Size of all unnamed storages is 2,580,672
The total size of all named and unnamed storages is 4,104,652
The prescribed maximum size is 2,095,194,112
Number of pages accessed (recorded so far) is 375 (page size = 4096)
fileManager::unload -- to free up all unused space (totalBytes=4,104,652,
maxBytes=2,095,194,112)
fileManager invoking registered external cleaners ...
part[test]::unloadIndexes -- unloaded all indexes of this data partition
part[test]::gainWriteAccess -- pthread_rwlock_trywrlock(00F62D38) for freeRIDs
array_t<union ibis::rid_t>::freeMemory this=00F62A58 actual=00F66C10 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66C10, 00000000) ...
part[test]::releaseAccess -- pthread_rwlock_unlock(00F62D38) for freeRIDs
fileManager -- external cleaners did not reduce the total bytes (4104652)
--- Tue Nov 16 16:12:07 2010
The number of memory mapped files is 1. (max = 60)
file name: test\-part.msk
storage @ 00BE1F88, 00F70000, 1st 32 bits = ffff, 1st 64 bits = c00000040000ffff
file descriptor 000000E0
fmap handle 00000184
base address 00F70000
mapped y opened at Tue Nov 16 16:12:07 2010 last
used at Tue Nov 16 16:12:07 2010
# of bytes 1523980 # of past acc 1 # of active acc 0
Size of all mapped files is 1,523,980
The number of files read into memory is 0
The total size of all files read into memory is 0
Size of all named storages is 1,523,980
Size of all unnamed storages is 2,580,672
The total size of all named and unnamed storages is 4,104,652
The prescribed maximum size is 2,095,194,112
Number of pages accessed (recorded so far) is 375 (page size = 4096)
fileManager::unload -- unloading all (1) inactive files
fileManager::unload -- unloading file "test\-part.msk"
file name: test\-part.msk
storage @ 00BE1F88, 00F70000, 1st 32 bits = ffff, 1st 64 bits = c00000040000ffff
file descriptor 000000E0
fmap handle 00000184
base address 00F70000
mapped y opened at Tue Nov 16 16:12:07 2010 last
used at Tue Nov 16 16:12:07 2010
# of bytes 1523980 # of past acc 1 # of active acc 0
fileManager::roFile::clear(00BE1F88, 00F70000, test\-part.msk) ...
fileManager::roFile::clear(00BE1F88, 00F70000, test\-part.msk) removed 1523980
bytes to decrease totalBytes to 2,580,672
fileManager::storage::clear(00BE1F88, 00000000) ...
fileManager::clear -- completed with 2,580,672 bytes of storage remain in
memory after removing all managed objects
util::mutexLock -- releasing lock (00A86340) for fileManager::clear
part[test]::gainWriteAccess -- pthread_rwlock_wrlock(00F62D38) for ~part
clearing data partition test
column[test.active]::writeLock -- pthread_rwlock_wrlock(00BE1EC8) for ~column
clearing column test.active
column[test.active]::writeLock -- pthread_rwlock_unlock(00BE1EC8) for ~column
bitvector (00BE1E34) clear the content of bitvector with m_vec at 00BE1E44
array_t<unsigned int>::freeMemory this=00BE1E44 actual=00F66C50 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66C50, 00000000) ...
column[test.book_id]::writeLock -- pthread_rwlock_wrlock(00BE1F78) for ~column
clearing column test.book_id
column[test.book_id]::writeLock -- pthread_rwlock_unlock(00BE1F78) for ~column
bitvector (00BE1EE4) clear the content of bitvector with m_vec at 00BE1EF4
array_t<unsigned int>::freeMemory this=00BE1EF4 actual=00F66E90 and
m_begin=00F686E8 (active references: 1, past references: 1)
fileManager::storage::clear(00F66E90, 00F686E8) ...
fileManager::storage::clear(00F66E90, 00F686E8) removed 28 bytes to decrease
totalBytes to 2,580,644
column[test.match_id]::writeLock -- pthread_rwlock_wrlock(00F68F20) for ~column
clearing column test.match_id
column[test.match_id]::writeLock -- pthread_rwlock_unlock(00F68F20) for ~column
bitvector (00F68E8C) clear the content of bitvector with m_vec at 00F68E9C
array_t<unsigned int>::freeMemory this=00F68E9C actual=00F66CD0 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66CD0, 00000000) ...
column[test.odd_hc]::writeLock -- pthread_rwlock_wrlock(00F68FD0) for ~column
clearing column test.odd_hc
column[test.odd_hc]::writeLock -- pthread_rwlock_unlock(00F68FD0) for ~column
bitvector (00F68F3C) clear the content of bitvector with m_vec at 00F68F4C
array_t<unsigned int>::freeMemory this=00F68F4C actual=00F66D10 and
m_begin=00000000 (active references: 1, past references: 0)
fileManager::storage::clear(00F66D10, 00000000) ...
column[test.odd_price]:
_______________________________________________
FastBit-users mailing list
[email protected]
https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
