Re: Large Messages and # of Buffers - z/OS
Considering each buffer is 4K , one 100MB message will require 20,000 buffers How many messages are you expecting?, how long will they remain on the queue?, how many other queues use the same buffer pool?, what is their usage? Criscione, Carol (DIS) [EMAIL PROTECTED] Sent by: MQSeries List [EMAIL PROTECTED] 11/25/2004 12:02 PM Please respond to MQSeries List To: [EMAIL PROTECTED] cc: Subject: Large Messages and # of Buffers - z/OS We have large messages ranging from 1-100Meg. I think my number of buffers is too low. What does anyone suggest for # of buffers, especially for a 100Meg message? Also, do you recommend increasing the region size if I substantially increase the number of buffers? If so, best guess on how much? ThanX! Carol Criscione [EMAIL PROTECTED] Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive The information contained in this message may be CONFIDENTIAL and is for the intended addressee only. Any unauthorized use, dissemination of the information, or copying of this message is prohibited. If you are not the intended addressee, please notify the sender immediately and delete this message.
Re: Large Messages and # of Buffers - z/OS
20,000 X 4k = 80,000k Given that not all 4k of a buffer is available for message data - would it not take more like 29,000 buffers for a 100meg message ??? This is assuming 3,600 bytes available per buffer for messageing. --- Ronald Weinger [EMAIL PROTECTED] wrote: Considering each buffer is 4K , one 100MB message will require 20,000 buffers How many messages are you expecting?, how long will they remain on the queue?, how many other queues use the same buffer pool?, what is their usage? Criscione, Carol (DIS) [EMAIL PROTECTED] Sent by: MQSeries List [EMAIL PROTECTED] 11/25/2004 12:02 PM Please respond to MQSeries List To: [EMAIL PROTECTED] cc: Subject:Large Messages and # of Buffers - z/OS We have large messages ranging from 1-100Meg. I think my number of buffers is too low. What does anyone suggest for # of buffers, especially for a 100Meg message? Also, do you recommend increasing the region size if I substantially increase the number of buffers? If so, best guess on how much? ThanX! Carol Criscione [EMAIL PROTECTED] Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive The information contained in this message may be CONFIDENTIAL and is for the intended addressee only. Any unauthorized use, dissemination of the information, or copying of this message is prohibited. If you are not the intended addressee, please notify the sender immediately and delete this message. Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive
Re: Large Messages and # of Buffers - z/OS
Sorry, screwed up the division. Too rushed. The point really is , an awful lot of buffers are needed and it is not a simple bw answer. Christopher Warneke [EMAIL PROTECTED] Sent by: MQSeries List [EMAIL PROTECTED] 11/29/2004 12:04 PM Please respond to MQSeries List To: [EMAIL PROTECTED] cc: Subject: Re: Large Messages and # of Buffers - z/OS 20,000 X 4k = 80,000k Given that not all 4k of a buffer is available for message data - would it not take more like 29,000 buffers for a 100meg message ??? This is assuming 3,600 bytes available per buffer for messageing. --- Ronald Weinger [EMAIL PROTECTED] wrote: Considering each buffer is 4K , one 100MB message will require 20,000 buffers How many messages are you expecting?, how long will they remain on the queue?, how many other queues use the same buffer pool?, what is their usage? Criscione, Carol (DIS) [EMAIL PROTECTED] Sent by: MQSeries List [EMAIL PROTECTED] 11/25/2004 12:02 PM Please respond to MQSeries List To: [EMAIL PROTECTED] cc: Subject:Large Messages and # of Buffers - z/OS We have large messages ranging from 1-100Meg. I think my number of buffers is too low. What does anyone suggest for # of buffers, especially for a 100Meg message? Also, do you recommend increasing the region size if I substantially increase the number of buffers? If so, best guess on how much? ThanX! Carol Criscione [EMAIL PROTECTED] Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive The information contained in this message may be CONFIDENTIAL and is for the intended addressee only. Any unauthorized use, dissemination of the information, or copying of this message is prohibited. If you are not the intended addressee, please notify the sender immediately and delete this message. Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive The information contained in this message may be CONFIDENTIAL and is for the intended addressee only. Any unauthorized use, dissemination of the information, or copying of this message is prohibited. If you are not the intended addressee, please notify the sender immediately and delete this message.
Re: Large Messages and # of Buffers - z/OS
I've always been intrigued what sort of apps actually create such large messages. Personally, I always felt MQ was designed to promote transactional processing and for distributing informational (non-persistent, pub-sub) messages. But, as with any product, users always find new ways to use it in ways the designer never invisioned. That's usually a good thing. But, at some point when you have to configure your resources for (what I assume) is the exception, rather than the rule, then I think it's time to consider other means for moving the data. It's a trade-off of time, effort and the impact to your resources. If you allocate huge buffers, you may impact other subsystems that have an on-going need for memory, e.g. CICS, IMS, DB2 and so forth. - Original Message - From: Criscione, Carol (DIS) [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, November 25, 2004 12:02 PM Subject: Large Messages and # of Buffers - z/OS We have large messages ranging from 1-100Meg. I think my number of buffers is too low. What does anyone suggest for # of buffers, especially for a 100Meg message? Also, do you recommend increasing the region size if I substantially increase the number of buffers? If so, best guess on how much? ThanX! Carol Criscione [EMAIL PROTECTED] Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive
Re: Large Messages and # of Buffers - z/OS
Carol, It will take you around 30,000 4k buffers for each 100 meg message that you intend to have memory resident. 100*1048576/3600=29127 rounded or, room for 9 100meg messages, per gig of memory. You'll want to turn on SMF115 records, uses not so much disk and the performance hit is arounf 5%. Employ the support pack: MP1B: WebSphere MQ for z/OS V5.3 - Interpreting accounting and statistics data to review the SMF data. They include some sample data, to verify that you've set things up correctly. Maybe, if you've got plenty of disk and can take the 11% performance hit, for a little while, you can turn on the SMF116 records (the systems team has not allowed me to do this yet). Wish I could give you a significantly more experienced answer. I'm doing this analysis myself, at work, and would be interested in collaborating with you, while you do this analysis too. My business email is: [EMAIL PROTECTED] Hope to hear from you, Chris --- Criscione, Carol (DIS) [EMAIL PROTECTED] wrote: We have large messages ranging from 1-100Meg. I think my number of buffers is too low. What does anyone suggest for # of buffers, especially for a 100Meg message? Also, do you recommend increasing the region size if I substantially increase the number of buffers? If so, best guess on how much? ThanX! Carol Criscione [EMAIL PROTECTED] Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive Instructions for managing your mailing list subscription are provided in the Listserv General Users Guide available at http://www.lsoft.com Archive: http://vm.akh-wien.ac.at/MQSeries.archive
