Re: [firebird-support] Re: [FB 2.1] Firebird engine seems to slow down on high load without utilizing hardware

[liviuslivius liviusliv...@poczta.onet.pl [firebird-support]]

>>1) We do monitor the transaction gab and if needed, we interact. 
 
how often and how? By MON$ tables or you read header page?
 
>>2) We do run gbak daily. We do not use nbackup - we would like to and tried 
>>it but it's corrupting the db.
 
and this slowdown is not in time of backup i suppose? 
Will be good if you can test this corruption scenario on newer firebird version 
- especially on FB3.
And send us your feedback.
 
>>3) We do use read-only readcommited transactions with record versioning as 
>>much as we can.
>>Otherwise, same Settings but not read-only.
 
good
 
More questions:
1. as Shane ask what is your CPU utilization % but per core?
2. how do you checked that your system slowdown? Some queries are slower or all 
queries are slower.
Did you run some monitoring throught MON$ tables ten?
3. and same as Shane ask - how often do you run manual sweep? And did you 
consider to change FB to newer version
In new version sweep was optimized and do not visit unnescessary pages. page 
contain now flag if sweep is needed.
4. What is your TempCacheLimit?
5. and i am also interested about disc test with cristalmark
 
regards,
Karol Bieniaszewski
 

RE: [firebird-support] Re: [FB 2.1] Firebird engine seems to slow down on high load without utilizing hardware

['Leyne, Sean' s...@broadviewsoftware.com [firebird-support]]

> 1) We have sweep set to 0. We do monitor the transaction gab and if
> needed, we interact. Any kind of automatic sweep under high load will kill
> the server :)

1- Do you run a manual sweep on a regular basis?


2- What is the CPU % like when Firebird "slows down"?


3- Have you tried using CrystalDiskMark to measure your disk IOPs?

My local workstation SSD results are:

---
CrystalDiskMark 5.0.2 x64 (C) 2007-2015 hiyohiyo
---
   Sequential Read (Q=  2,T= 4) :   564.293 MB/s
  Sequential Write (Q=  2,T= 4) :   535.874 MB/s
  Random Read 4KiB (Q=256,T= 1) :   227.652 MB/s [ 55579.1 IOPS]
 Random Write 4KiB (Q=256,T= 1) :   195.258 MB/s [ 47670.4 IOPS]
 Sequential Read (T= 1) :   545.480 MB/s
Sequential Write (T= 1) :   520.939 MB/s
   Random Read 4KiB (Q= 1,T= 1) :36.577 MB/s [  8929.9 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :90.805 MB/s [ 22169.2 IOPS]


3- Have you tried to analyze/determine the long running SQLs being executed, to 
determine if wrong/no indexes are being used by queries or other optimizations 
that could be made?


Sean

[firebird-support] Re: [FB 2.1] Firebird engine seems to slow down on high load without utilizing hardware

[thetr...@yahoo.com [firebird-support]]

We splitted our system now to 2 databases, reducing the connections to about 
250 per DB.
 Running on same Hardware (same SAN-Storage) and splitted the CPU ressources.
 

 Both system seems stable now, but that's not really a solution we prefered. 
Just helps us to not lose customers at the moment.

[firebird-support] Re: [FB 2.1] Firebird engine seems to slow down on high load without utilizing hardware

[thetr...@yahoo.com [firebird-support]]

1) We have sweep set to 0. We do monitor the transaction gab and if needed, we 
interact. Any kind of automatic sweep under high load will kill the server :)
 

 2) We do run gbak daily. We do not use nbackup - we would like to and tried it 
but it's corrupting the db.
 

 3) We do use read-only readcommited transactions with record versioning as 
much as we can.
 Otherwise, same Settings but not read-only.

Re: [firebird-support] Embedded FB3 was killed?

['Mark Rotteveel' m...@lawinegevaar.nl [firebird-support]]

Firebird embedded still exists, but looking at the release notes, it might 
require a bit more explicit coverage.
In short, you need fbclient.dll and engine12.dll (or their Linux equivalent). 
There is no separate fbembed.dll anymore.

Mark

- Bericht beantwoorden -
Van: "galdari...@yahoo.com.br [firebird-support]" 

Aan: 
Onderwerp: [firebird-support] Embedded FB3 was killed?
Datum: di, apr. 19, 2016 19:56

There are only questions about it on google with no answer.
Also, Release Notes says nothing about it.

Re: [firebird-support] Embedded FB3 was killed?

[Dimitry Sibiryakov s...@ibphoenix.com [firebird-support]]

19.04.2016 19:56, galdari...@yahoo.com.br [firebird-support] wrote:
> Release Notes says nothing about it.

   Read carefully "Remodelled Architecture" part.

-- 
   WBR, SD.






++

Visit http://www.firebirdsql.org and click the Documentation item
on the main (top) menu.  Try FAQ and other links from the left-side menu there.

Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ 

++


Yahoo Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/firebird-support/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/firebird-support/join
(Yahoo! ID required)

<*> To change settings via email:
firebird-support-dig...@yahoogroups.com 
firebird-support-fullfeatu...@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
firebird-support-unsubscr...@yahoogroups.com

<*> Your use of Yahoo Groups is subject to:
https://info.yahoo.com/legal/us/yahoo/utos/terms/

[firebird-support] Embedded FB3 was killed?

[galdari...@yahoo.com.br [firebird-support]]

There are only questions about it on google with no answer.
 Also, Release Notes says nothing about it.

Re: [firebird-support] FB 3.0

[Dimitry Sibiryakov s...@ibphoenix.com [firebird-support]]

19.04.2016 18:39, 'Tiberiu Horvath' tiberiu_horv...@yahoo.com 
[firebird-support] wrote:
> This means that (I have some 100+ databases in use at some of my clients) I
> should wait for a way to access these ODS 11.2 databases from FB 3.0 ?

   No. Give up a hope.

> Can IBX properly access the boolean fields in FB 3.0 ?

   No.

-- 
   WBR, SD.






++

Visit http://www.firebirdsql.org and click the Documentation item
on the main (top) menu.  Try FAQ and other links from the left-side menu there.

Also search the knowledgebases at http://www.ibphoenix.com/resources/documents/ 

++


Yahoo Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/firebird-support/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/firebird-support/join
(Yahoo! ID required)

<*> To change settings via email:
firebird-support-dig...@yahoogroups.com 
firebird-support-fullfeatu...@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
firebird-support-unsubscr...@yahoogroups.com

<*> Your use of Yahoo Groups is subject to:
https://info.yahoo.com/legal/us/yahoo/utos/terms/

[firebird-support] FB 3.0

['Tiberiu Horvath' tiberiu_horv...@yahoo.com [firebird-support]]

Support for Users of Firebird ReleasesHi all,

Currently using FB 2.5.5 but starting tests with the new FB 3.0 .


A few questions :

1. The new ODS (12) is not compatible with older (<=11.2) so, according to
http://www.firebirdsql.org/file/documentation/release_notes/html/en/3_0/rnfb30-apiods.html
 
we have to do a manual backup on 2.5.5 and a restore on 3.0.
It says that “A legacy provider for databases with ODS 8 to 11.2 is planned 
for a future sub-release.”

This means that (I have some 100+ databases in use at some of my clients) I 
should wait for a way to access these ODS 11.2 databases from FB 3.0 ? It 
would be perfect ...


2. Anybody tested code with with FB 3.0 and Delphi and IBX ? Any problems ? 
Can IBX properly access the boolean fields in FB 3.0 ?





Congratulations for this new release,


Tiberiu

Re: [firebird-support] Firebird 3.0 Is Available Now!

['Carlos H. Cantu' lis...@warmboot.com.br [firebird-support]]

Re: [firebird-support] Firebird 3.0 Is Available Now!

[Michel LE CLEZIO mlcvi...@yahoo.fr [firebird-support]]

Great !Is it possible to buy it without using paypal ? and to get a price in 
Euro ?
Best Regards,MlcVista 

Le Mardi 19 avril 2016 14h57, "'Carlos H. Cantu' lis...@warmboot.com.br 
[firebird-support]"  a écrit :
 

     Awesome! Congratulations to all the people who made this possible!

Btw, I will take the opportunity to announce that my "Migration Guide
to Firebird 3" eBook is being sold at
http://www.firebirdnews.org/migration-guide-to-firebird-3/

[]s
Carlos H. Cantu
www.firebirdnews.org - www.FireBase.com.br

AKaiacfs> Firebird 3.0 Is Available Now - with major improvements in 
AKaiacfs> performance, security and SQL features

  #yiv9024262230 #yiv9024262230 -- #yiv9024262230ygrp-mkp {border:1px solid 
#d8d8d8;font-family:Arial;margin:10px 0;padding:0 10px;}#yiv9024262230 
#yiv9024262230ygrp-mkp hr {border:1px solid #d8d8d8;}#yiv9024262230 
#yiv9024262230ygrp-mkp #yiv9024262230hd 
{color:#628c2a;font-size:85%;font-weight:700;line-height:122%;margin:10px 
0;}#yiv9024262230 #yiv9024262230ygrp-mkp #yiv9024262230ads 
{margin-bottom:10px;}#yiv9024262230 #yiv9024262230ygrp-mkp .yiv9024262230ad 
{padding:0 0;}#yiv9024262230 #yiv9024262230ygrp-mkp .yiv9024262230ad p 
{margin:0;}#yiv9024262230 #yiv9024262230ygrp-mkp .yiv9024262230ad a 
{color:#ff;text-decoration:none;}#yiv9024262230 #yiv9024262230ygrp-sponsor 
#yiv9024262230ygrp-lc {font-family:Arial;}#yiv9024262230 
#yiv9024262230ygrp-sponsor #yiv9024262230ygrp-lc #yiv9024262230hd {margin:10px 
0px;font-weight:700;font-size:78%;line-height:122%;}#yiv9024262230 
#yiv9024262230ygrp-sponsor #yiv9024262230ygrp-lc .yiv9024262230ad 
{margin-bottom:10px;padding:0 0;}#yiv9024262230 #yiv9024262230actions 
{font-family:Verdana;font-size:11px;padding:10px 0;}#yiv9024262230 
#yiv9024262230activity 
{background-color:#e0ecee;float:left;font-family:Verdana;font-size:10px;padding:10px;}#yiv9024262230
 #yiv9024262230activity span {font-weight:700;}#yiv9024262230 
#yiv9024262230activity span:first-child 
{text-transform:uppercase;}#yiv9024262230 #yiv9024262230activity span a 
{color:#5085b6;text-decoration:none;}#yiv9024262230 #yiv9024262230activity span 
span {color:#ff7900;}#yiv9024262230 #yiv9024262230activity span 
.yiv9024262230underline {text-decoration:underline;}#yiv9024262230 
.yiv9024262230attach 
{clear:both;display:table;font-family:Arial;font-size:12px;padding:10px 
0;width:400px;}#yiv9024262230 .yiv9024262230attach div a 
{text-decoration:none;}#yiv9024262230 .yiv9024262230attach img 
{border:none;padding-right:5px;}#yiv9024262230 .yiv9024262230attach label 
{display:block;margin-bottom:5px;}#yiv9024262230 .yiv9024262230attach label a 
{text-decoration:none;}#yiv9024262230 blockquote {margin:0 0 0 
4px;}#yiv9024262230 .yiv9024262230bold 
{font-family:Arial;font-size:13px;font-weight:700;}#yiv9024262230 
.yiv9024262230bold a {text-decoration:none;}#yiv9024262230 dd.yiv9024262230last 
p a {font-family:Verdana;font-weight:700;}#yiv9024262230 dd.yiv9024262230last p 
span {margin-right:10px;font-family:Verdana;font-weight:700;}#yiv9024262230 
dd.yiv9024262230last p span.yiv9024262230yshortcuts 
{margin-right:0;}#yiv9024262230 div.yiv9024262230attach-table div div a 
{text-decoration:none;}#yiv9024262230 div.yiv9024262230attach-table 
{width:400px;}#yiv9024262230 div.yiv9024262230file-title a, #yiv9024262230 
div.yiv9024262230file-title a:active, #yiv9024262230 
div.yiv9024262230file-title a:hover, #yiv9024262230 div.yiv9024262230file-title 
a:visited {text-decoration:none;}#yiv9024262230 div.yiv9024262230photo-title a, 
#yiv9024262230 div.yiv9024262230photo-title a:active, #yiv9024262230 
div.yiv9024262230photo-title a:hover, #yiv9024262230 
div.yiv9024262230photo-title a:visited {text-decoration:none;}#yiv9024262230 
div#yiv9024262230ygrp-mlmsg #yiv9024262230ygrp-msg p a 
span.yiv9024262230yshortcuts 
{font-family:Verdana;font-size:10px;font-weight:normal;}#yiv9024262230 
.yiv9024262230green {color:#628c2a;}#yiv9024262230 .yiv9024262230MsoNormal 
{margin:0 0 0 0;}#yiv9024262230 o {font-size:0;}#yiv9024262230 
#yiv9024262230photos div {float:left;width:72px;}#yiv9024262230 
#yiv9024262230photos div div {border:1px solid 
#66;height:62px;overflow:hidden;width:62px;}#yiv9024262230 
#yiv9024262230photos div label 
{color:#66;font-size:10px;overflow:hidden;text-align:center;white-space:nowrap;width:64px;}#yiv9024262230
 #yiv9024262230reco-category {font-size:77%;}#yiv9024262230 
#yiv9024262230reco-desc {font-size:77%;}#yiv9024262230 .yiv9024262230replbq 
{margin:4px;}#yiv9024262230 #yiv9024262230ygrp-actbar div a:first-child 
{margin-right:2px;padding-right:5px;}#yiv9024262230 #yiv9024262230ygrp-mlmsg 
{font-size:13px;font-family:Arial, helvetica, clean, sans-serif;}#yiv9024262230 
#yiv9024262230ygrp-mlmsg table {font-size:inherit;font:100%;}#yiv9024262230 
#yiv9024262230ygrp-mlmsg select, #yiv9024262230 input, #yiv9024262230 textarea 
{font:99% Arial, Helvetica, clean, sans-serif;}#yiv9024262230 

Re: [firebird-support] Firebird 3.0 Is Available Now!

['Carlos H. Cantu' lis...@warmboot.com.br [firebird-support]]

Awesome! Congratulations to all the people who made this possible!

Btw, I will take the opportunity to announce that my "Migration Guide
to Firebird 3" eBook is being sold at
http://www.firebirdnews.org/migration-guide-to-firebird-3/

[]s
Carlos H. Cantu
www.firebirdnews.org - www.FireBase.com.br

AKaiacfs>   Firebird 3.0 Is Available Now - with major improvements in 
AKaiacfs> performance, security and SQL features

[firebird-support] Firebird 3.0 Is Available Now!

[Alexey Kovyazin a...@ib-aid.com [firebird-support]]

  Firebird 3.0 Is Available Now - with major improvements in 
performance, security and SQL features

April 19, 2016 -- The Firebird Project is pleased to announce the 
release of version 3 of Firebird, its open source relational database 
management system:
http://www.firebirdsql.org/en/firebird-3-0-0/

This version is the most extensive re-architecture of the Firebird DBMS 
since its initial release more than 14 years ago.  Its new 
multi-threaded engine processes and shared page caching enable better 
utilization of multi-core hardware and large address spaces. With these 
changes, this release features dramatic performance increases, while 
maintaining compatibility with old client libraries.

In addition, Firebird 3.0 includes a long list of SQL improvements 
(including Window and statistical functions), enhanced security features 
such as wire and database encryption and multiple security databases, 
and more -- over 100 significant improvements.  Yet even with its new 
enterprise-level features, it retains the tiny footprint and simple 
deployment and management that have made it "the right tool for the job" 
for so many applications.

Steve Summers, President of the non-profit Firebird Foundation, said: 
"We're very excited about this release. Re-architecting a system as 
complex as a relational database system is a very difficult task. We're 
extremely impressed with the skills shown by Firebird's development team 
and the great job they've done."

Dmitry Yemanov, the core team leader, agreed. "Firebird 3.0 development 
was quite a challenge but we've finally completed the work and ensured 
that it complies with our QA standards. Besides the scalability and 
security features that were our top priority tasks, I'm particularly 
happy about the performance improvements in garbage collection and 
incremental backup areas. With the renewed architecture and 
significantly refactored code, this release establishes a solid platform 
for our further progress. Thanks to all the Firebird developers and 
contributors."

Mr. Summers added: "If you're building a system that needs to store 
structured data at end-users' sites, from a few megabytes to hundreds of 
gigabytes, on a desktop or a network with thousands of users, Firebird 
has always been a great choice. It's an even better choice now. You owe 
it to yourself to at least take a look!"

Pricing and Availability

Firebird 3.0 is an open source database system that is completely free 
of charge for any use – including deployment as part of commercial 
products (not just non-profit, private or educational use like some of 
its competitors).  Both binary packages and the complete source code can 
be downloaded at no cost through the Firebird Project website:
http://www.firebirdsql.org/en/firebird-3-0-0/

No registration or activation is required.

As of today, Firebird 3.0 is available in 32 and 64 bit versions for 
both Windows and Linux. OS X and other platforms will be available soon. 
Drivers for JDBC (Java), .NET, ODBC, Python and more are also available 
through the FirebirdSQL.org web site, along with documentation.
http://www.firebirdsql.org/en/downloads/

Additional tools (drivers, administration, replication, UDF 
(user-defined-function) libraries, etc.) are also available through 
third parties:
http://www.firebirdsql.org/en/third-party-tools/

About the Firebird Foundation

The Firebird Foundation is a non-profit organization that supports the 
development and maintenance of the Firebird relational database system. 
The Foundation was incorporated in 2002 and is currently supported by 
more than 300 active members and 23 sponsors. If you find Firebird 
useful, and especially if it is helping you earn money, please join us 
to help ensure the future of this valuable tool.  For details, please 
click the Community tab on our website
http://www.firebirdsql.org/en/firebird-foundation/

For more information, contact:

Steve Summers, sesumm...@firebirdsql.org, or

Alexey Kovyazin, c...@firebirdsql.org

[firebird-support] Re: Database Corrupt ?

[hv...@users.sourceforge.net [firebird-support]]

Christine,

few questions:

- am i correctly understand that you have few different DB's and all of them 
corrupted ?
- does you use 32-bit or 64 bit build of Firebird and CentOS (i686 or x64)?
- what is glibc version ?
- could you check memory on server machine ?

Regards,
Vlad

Re: [firebird-support] Performance issues moving to new server with later Firebird version

[Alexey Kovyazin a...@ib-aid.com [firebird-support]]

Hi Bob,

In general, we recommend to apply the same configuration as at the old 
server (even if it looks not very good), and compare the performance - 
if there will be a problem, obviously it will be related with the new 
hardware/OS.


If there will be the same performance, then you can tune firebird.conf.
If you don't know exactly how changes will work, change one parameter at 
a time.


Also, you can get optimized configuration file from our web-site
http://ib-aid.com/en/optimized-firebird-configuration/

And, look at the hardware guide: 
http://ib-aid.com/en/articles/firebird-hardware-guide/


Regards,
Alexey Kovyazin
IBSurgeon HQbird





We have a 127GB Firebird database that was running on Windows Server 
2008 x64 with 16GB of RAM and Firebird SuperClassic v2.5.2.26539.  The 
database has a page size of 8192 and buffers of 6144, and ODS version 
11.2.



Due to time constraints I could not do a backup+restore on the new 
server, which is Windows 2012 with 32GB RAM and Firebird SuperClassic 
v2.5.5.26952. However, most activity on this new server with the old 
database is much slower than the old server.  I'm only seeing about 
1.5GB Private Bytes in use, jumping occasionally to 2.5GB with a 
working set of 1.1GB and Virtual Size of 2.7 (as per Process Explorer).



The only changes that I have made to the stock Firebird.conf are as 
follows:


DefaultDbCachePages = 384

FileSystemCacheSize = 50

TempBlockSize = 2048576

TempCacheLimit = 567108864


The database is comprised of many images up to 1.5MB in size, but they 
are not accessed very often. The actual data size outside of these 
images is probably 1/3 of the total DB size.



There are typically about 20 connections to the database servicing up 
to 140 users, with a mix of read and write transactions, as well as 
some reporting.



The header statistics look like this:

Database header page information:
Flags   0
Checksum12345
Generation  106862144
Page size   8192
ODS version 11.2
Oldest transaction  103869407
Oldest active   103869408
Oldest snapshot 103869408
Next transaction103870442
Bumped transaction  1
Sequence number 0
Next attachment ID  2991646
Implementation ID   26
Shadow count0
Page buffers6144
Next header page0
Database dialect3
Creation date   Feb 2, 2014 22:06:05
Attributes  force write

Variable header data:
Sweep interval: 0
*END*



I'm looking for some guidance as to how changes that should be made to 
the Firebird configuration file and to the database when I do a 
backup/restore.  For instance, I'm sure that I want to jump to 16KB 
pages, but what about buffers?



There are other services that run on this server, so I cannot use all 
resources for the database. However, I believe it is provisioned well 
enough that I can certainly use half of the resources - processor and 
memory - without affecting the application server and web server that 
are running on the same box.



Thank you for your time,


Bob M..