Re: replication question
Are you positive that you are running compatible versions of MySql on both platforms? - Original Message - From: Terry [EMAIL PROTECTED] To: Luc Foisy [EMAIL PROTECTED]; MYSQL-List (E-mail) [EMAIL PROTECTED] Sent: Monday, June 10, 2002 9:59 AM Subject: RE: replication question | hello, | | I am replicating to NT Server system from Red Hat Linux | was not aware of any issues to win2k from linux with replication | | Is there something I am not aware of? | | i dont know, but i am having major problems with it. | i keep getting Slave: Failed reading log event, reconnecting to retry, | log 'FIRST' position ... | | whats strange is that master.info has no remote logfile name in it. | | i cant think of any reason why my setup of replication between w2k and | w2k | would be different from one i am trying to setup between linux (slave) | and w2k (master) | | maybe my mysql rpm is broken ? ... | | regards, | terry | | | | - | Before posting, please check: |http://www.mysql.com/manual.php (the manual) |http://lists.mysql.com/ (the list archive) | | To request this thread, e-mail [EMAIL PROTECTED] | To unsubscribe, e-mail [EMAIL PROTECTED] | Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php | - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Bug related to large tables and it's indexes on Win2k
- Original Message - From: Keith C. Ivey [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: Jared Richardson [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 5:24 PM Subject: Re: Bug related to large tables and it's indexes on Win2k | On 4 Jun 2002, at 15:43, Jared Richardson wrote: | | | AVG_ROW_LENGTH=4096 MAX_ROWS=4294967295; | | | | Why do you use AVG_ROW_LENGTH=4096? It seems to me the max record | | length is 528...? | | | According to the MySql docs, the max table size is AVG_ROW_LENGTH * | MAX_ROWS | | We were trying to ensure the maximum amount of growth... this table | can grow very very large | | That's fine, but if you make the max size bigger than what you really | need, you bloat your index and slow things down for no benefit. As I | understand it, with the default max table size of 4 GB (for dynamic- | record MyISAM tables), the index will have 4-byte pointers to the | records. The next step would be 5-byte pointers, which would allow a | max table size of 1024 GB (or 1 TB). But you're asking for an even | higher max table size, forcing MySL to use 6-byte pointers in the | index, which allows a max table size of 256 TB. | | I don't think there's any difference between setting AVG_ROW_LENGTH | to 4096 and setting it to 528, since either will put you in the same | size range when combined with MAX_ROWS=4294967295. | That makes sense. | Think about how many rows you're actually going to have and what the | real average row length is. 528 may be your maximum row length, but | I think it's unlikely that your VARCHARs average anywhere near 255. | Most likely the numbers are low enough that the 1 TB table size is | sufficient, so your indexes will only need 5-byte pointers and thus | be smaller. | This table is part of a product that contains publicly available (and always expanding) publicly avilable biological data in addition to large companies internal data. A one terrabyte cap very well could come back to haunt us one day! (sadly enough!) We'll give it a shot with more reasonable numbers and see if we can work around this problem. Thank you very much for this input! | [Filter fodder: SQL] | | -- | Keith C. Ivey [EMAIL PROTECTED] | Tobacco Documents Online | http://tobaccodocuments.org - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Replication speed?
Hi all, Does anyone have any numbers on the speed of MySql replication? I am concerned with the transfer of up to 10 gigabytes to a master db... what state are the slaves in during the replication catch up time? Is the delay primarily related to the network bandwidth? I am assuming that all the SQL statements are processed on the master and the changes are what get propagated... is that correct? Thanks! Any info would be greatly appreciated! Jared - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Bug related to large tables and it's indexes on Win2k
Hi all, When large tables are being addressed, we seem to have encountered a bug related to having large indexes on the table. We have several tables in our system that have reached 4 gigs in size. We altered the table definition to allow it to get larger... this is our current table creation statement (for the table giving us trouble, not the entire system) CREATE TABLE IcAlias( IcAliasID BIGINT NOT NULL PRIMARY KEY, mID VARCHAR(255) NOT NULL, IcEntityID BIGINT NOT NULL, IcTypeID SMALLINT NOT NULL, IcDupSortID VARCHAR(255) NOT NULL, INDEX mIDIdx (mID), INDEX IcTypeIDIdx (IcTypeID), INDEX IcEntityIDIdx (IcEntityID), INDEX IcDupSortIDIdx (IcDupSortID)) AVG_ROW_LENGTH=4096 MAX_ROWS=4294967295; Before we added the AVG_ROW_LENGTH and MAX_ROWS settings, we generated a table that was 4 gigs in size and an index that was over 6 gigs. Now the table fails when the index file approaches 4 gigs (actually 3.5 something)! We are getting this message when trying to insert data: Error: Can't change size of indexfile, error: 22, when using table: icalias We originally saw this in 3.23.36 and have reproduced it in the latest 4.0 alpha download. The platform is a Windows 2000 box running on dual Athlons (1900+ I think) with 4 gigs of ram and a 135 gig raid. I've spent a lot of time looking in Deja and on the MySql site and have not found a solution to this problem. Given that it takes 12 hours or so to build this table, it takes a while to test any attempts at a fix. Any help would be ~greatly~ appreciated! I really don't know what to try next! - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Bug related to large tables and it's indexes on Win2k
Win2k (at least the version that we are on) does indeed support files much larger than 2 gigs. Another db we use has index files that are 6.8 gigs and 4.7 gigs. - Original Message - From: miguel solorzano [EMAIL PROTECTED] To: Jared Richardson [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Cc: Jared Richardson [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 9:40 AM Subject: Re: Bug related to large tables and it's indexes on Win2k At 08:17 4/6/2002 -0400, Jared Richardson wrote: Hi, When large tables are being addressed, we seem to have encountered a bug related to having large indexes on the table. We have several tables in our system that have reached 4 gigs in size. Did you had tested if actually your OS supports size files greater than 4 GB ?. I use Win2k Server and its default format doesn't permits files with size greater than 2 GB (even formatted with NTFS). Regards, -- For technical support contracts, goto https://order.mysql.com/ __ ___ ___ __ / |/ /_ __/ __/ __ \/ /Miguel A. Solórzano [EMAIL PROTECTED] / /|_/ / // /\ \/ /_/ / /__ MySQL AB, FullTime Developer /_/ /_/\_, /___/\___\_\___/ Mogi das Cruzes - São Paulo, Brazil ___/ www.mysql.com - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Bug related to large tables and it's indexes on Win2k
The table type is the default, MYISAM - Original Message - From: Schneck Walter [EMAIL PROTECTED] To: 'Jared Richardson ' [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 10:11 AM Subject: AW: Bug related to large tables and it's indexes on Win2k | Hi, | | what table-typ do you use ? | | rg Walter | | -Originalnachricht- | Von: Jared Richardson | An: [EMAIL PROTECTED]; [EMAIL PROTECTED] | Cc: Jared Richardson | Gesendet: 04.06.02 14:17 | Betreff: Bug related to large tables and it's indexes on Win2k | | Hi all, | | When large tables are being addressed, we seem to have encountered a bug | related to having large indexes on the table. | | We have several tables in our system that have reached 4 gigs in size. | We | altered the table definition to allow it to get larger... this is our | current table creation statement (for the table giving us trouble, not | the | entire system) | | CREATE TABLE IcAlias( |IcAliasID BIGINT NOT NULL PRIMARY KEY, |mID VARCHAR(255) NOT NULL, |IcEntityID BIGINT NOT NULL, |IcTypeID SMALLINT NOT NULL, |IcDupSortID VARCHAR(255) NOT NULL, |INDEX mIDIdx (mID), |INDEX IcTypeIDIdx (IcTypeID), |INDEX IcEntityIDIdx (IcEntityID), |INDEX IcDupSortIDIdx (IcDupSortID)) |AVG_ROW_LENGTH=4096 MAX_ROWS=4294967295; | | Before we added the AVG_ROW_LENGTH and MAX_ROWS settings, we generated | a | table that was 4 gigs in size and an index that was over 6 gigs. Now | the | table fails when the index file approaches 4 gigs (actually 3.5 | something)! | We are getting this message when trying to insert data: | Error: Can't change size of indexfile, error: 22, when using table: | icalias | | We originally saw this in 3.23.36 and have reproduced it in the latest | 4.0 | alpha download. The platform is a Windows 2000 box running on dual | Athlons | (1900+ I think) with 4 gigs of ram and a 135 gig raid. | | I've spent a lot of time looking in Deja and on the MySql site and have | not | found a solution to this problem. Given that it takes 12 hours or so to | build this table, it takes a while to test any attempts at a fix. | | Any help would be ~greatly~ appreciated! I really don't know what to try | next! | | | - | Please check http://www.mysql.com/Manual_chapter/manual_toc.html; | before | posting. To request this thread, e-mail [EMAIL PROTECTED] | | To unsubscribe, send a message to the address shown in the | List-Unsubscribe header of this message. If you cannot see it, | e-mail [EMAIL PROTECTED] instead. | - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Bug related to large tables and it's indexes on Win2k
Thanks Walter since their is no reason (that I am aware of) for the system not to handle the current problem, I want to try to solve it if possible. I have been using MySql for a number of years... if this is an actual bug, it will be the first one I've ever encountered! :) Also, we've tested InnoDB with our data (it's all meta data so it's a very large number of very small bits of data) and found it to be slower than the ISAM tables for our application. - Original Message - From: Schneck Walter [EMAIL PROTECTED] To: 'Jared Richardson ' [EMAIL PROTECTED]; Schneck Walter [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 10:20 AM Subject: AW: Bug related to large tables and it's indexes on Win2k | Well, | | im not an expert in MYSQL tabletypes, | but what if seen yet InnoDB is the most | preferred tabletyp for real appis. | if possible try out InnoDB. | | rg Walter | | -Originalnachricht- | Von: Jared Richardson | An: Schneck Walter; [EMAIL PROTECTED]; [EMAIL PROTECTED] | Gesendet: 04.06.02 16:15 | Betreff: Re: Bug related to large tables and it's indexes on Win2k | | The table type is the default, MYISAM | | - Original Message - | From: Schneck Walter [EMAIL PROTECTED] | To: 'Jared Richardson ' [EMAIL PROTECTED]; | [EMAIL PROTECTED]; [EMAIL PROTECTED] | Sent: Tuesday, June 04, 2002 10:11 AM | Subject: AW: Bug related to large tables and it's indexes on Win2k | | | | Hi, | | | | what table-typ do you use ? | | | | rg Walter | | | | -Originalnachricht- | | Von: Jared Richardson | | An: [EMAIL PROTECTED]; [EMAIL PROTECTED] | | Cc: Jared Richardson | | Gesendet: 04.06.02 14:17 | | Betreff: Bug related to large tables and it's indexes on Win2k | | | | Hi all, | | | | When large tables are being addressed, we seem to have encountered a | bug | | related to having large indexes on the table. | | | | We have several tables in our system that have reached 4 gigs in size. | | We | | altered the table definition to allow it to get larger... this is our | | current table creation statement (for the table giving us trouble, not | | the | | entire system) | | | | CREATE TABLE IcAlias( | |IcAliasID BIGINT NOT NULL PRIMARY KEY, | |mID VARCHAR(255) NOT NULL, | |IcEntityID BIGINT NOT NULL, | |IcTypeID SMALLINT NOT NULL, | |IcDupSortID VARCHAR(255) NOT NULL, | |INDEX mIDIdx (mID), | |INDEX IcTypeIDIdx (IcTypeID), | |INDEX IcEntityIDIdx (IcEntityID), | |INDEX IcDupSortIDIdx (IcDupSortID)) | |AVG_ROW_LENGTH=4096 MAX_ROWS=4294967295; | | | | Before we added the AVG_ROW_LENGTH and MAX_ROWS settings, we | generated | | a | | table that was 4 gigs in size and an index that was over 6 gigs. Now | | the | | table fails when the index file approaches 4 gigs (actually 3.5 | | something)! | | We are getting this message when trying to insert data: | | Error: Can't change size of indexfile, error: 22, when using table: | | icalias | | | | We originally saw this in 3.23.36 and have reproduced it in the latest | | 4.0 | | alpha download. The platform is a Windows 2000 box running on dual | | Athlons | | (1900+ I think) with 4 gigs of ram and a 135 gig raid. | | | | I've spent a lot of time looking in Deja and on the MySql site and | have | | not | | found a solution to this problem. Given that it takes 12 hours or so | to | | build this table, it takes a while to test any attempts at a fix. | | | | Any help would be ~greatly~ appreciated! I really don't know what to | try | | next! | | | | | | - | | Please check http://www.mysql.com/Manual_chapter/manual_toc.html; | | before | | posting. To request this thread, e-mail | [EMAIL PROTECTED] | | | | To unsubscribe, send a message to the address shown in the | | List-Unsubscribe header of this message. If you cannot see it, | | e-mail [EMAIL PROTECTED] instead. | | | - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Making fulltext index is very slow!!
1) Add 1 or 2 gigs of ram 2) Adjust the my.ini (or my.cnf) settings to use it This will get your data into memory and off the disk. This will make it run an order of magnitude faster. Also, you can buy a P4 from Dell for $599. You might want to throw more hardware at the problem. - Original Message - From: Mahdi Hajimoradi [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 2:53 PM Subject: Making fulltext index is very slow!! | Hi | I have a Huge amounts of data imported into mysql. | My database has about 1,500,000 rows.each row has a text | field with approx 70 words in it!.Size of my .MYD is 1013MB | mysql has been starting to make fulltext index on text field since 55 hours | ago!!! | and now it dose not accomplish this job yet!! | Although my HD is not very fast(128Mb 300MHZ) but this really takes a long | time to finish. | I've increased size of key_buffer_size and table_cache befor but it still a | long time! | Dose any body can recommend me any faster solution? | | TNX in Advance | --M. Hajimoradi | | | - | Before posting, please check: |http://www.mysql.com/manual.php (the manual) |http://lists.mysql.com/ (the list archive) | | To request this thread, e-mail [EMAIL PROTECTED] | To unsubscribe, e-mail [EMAIL PROTECTED] | Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php | - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Bug related to large tables and it's indexes on Win2k
I replied below - Original Message - From: Roger Baklund [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, June 04, 2002 3:24 PM Subject: Re: Bug related to large tables and it's indexes on Win2k | * Jared Richardson | [...] | CREATE TABLE IcAlias( | IcAliasID BIGINT NOT NULL PRIMARY KEY, | mID VARCHAR(255) NOT NULL, | IcEntityID BIGINT NOT NULL, | IcTypeID SMALLINT NOT NULL, | IcDupSortID VARCHAR(255) NOT NULL, | INDEX mIDIdx (mID), | INDEX IcTypeIDIdx (IcTypeID), | INDEX IcEntityIDIdx (IcEntityID), | INDEX IcDupSortIDIdx (IcDupSortID)) | AVG_ROW_LENGTH=4096 MAX_ROWS=4294967295; | | Why do you use AVG_ROW_LENGTH=4096? It seems to me the max record | length is 528...? | According to the MySql docs, the max table size is AVG_ROW_LENGTH * MAX_ROWS We were trying to ensure the maximum amount of growth... this table can grow very very large We'll try an import with only 528 AVG_ROW_LENGTH and see what happens. | Also, you do normally not want an index on 255 characters of a | column... have you considered using INDEX mIDIdx (mID(10)) and | INDEX IcDupSortIDIdx (IcDupSortID(10)) or similar? | Got a build going with that right now! :) Thanks - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Windows Threads Support
- Original Message - From: Tonu Samuel [EMAIL PROTECTED] To: Manish Mehta [EMAIL PROTECTED] Cc: mysql [EMAIL PROTECTED] Sent: Friday, October 05, 2001 6:00 AM Subject: Re: Windows Threads Support On Fri, 2001-10-05 at 08:35, Manish Mehta wrote: Hello, Windows support 2000 threads by default (with the help of thread library). Then what a mean of max_connection = 100 because MySQL One each connection on differente thread. Is i able to increase the max_connection limit. Yes, you can change any variables shown with SHOW VARIABLES. MySQL reads default values from my.cnf file Actually, on Windows, it seems to read the c:\winnt\my.ini file, not the my.cnf file. My.cnf is used on the *nix versions. I only point this out as I wasted time looking for the my.cnf file! :) - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Win2k Replication Problem
Hi all, I've done a decent amount of searching on Deja.com but haven't found anyone with this particular problem. I have two boxes running MySql on Win2k. Replication works great. One box is Master, one is Slave. After the boxes are running, any write to the Master is replicated to the Slave. However, if I have one write to the Master ~before~ the Slave starts, the Slave isn't caught up. The docs indicate that: http://www.mysql.com/doc/R/e/Replication_HOWTO.html After you have done the above, the slave(s) should connect to the master and catch up on any updates which happened since the snapshot was taken. I am not seeing the slave catch up. Is this a Win32 bug or should I follow some steps beyond what is listed in the manual? To be very clear: A write to the Master before the Slave is started is ~not~ replicated to the Slave. A write to the Master after the Slave is started ~is~ replicated. Thanks for any help or advice! On a related note, the manual is also not quite accurate for a Win32 install. There is no my.cnf file in the data directory. It's a my.ini file and (on my machines) it's located in c:\winnt\ If you create the my.cnf file in the locations indicated by the manual, it is ignored. Jared Richardson [EMAIL PROTECTED] Incellico, Inc. http://www.incellico.com - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
