Re: [U2] Redback Limit
This issue has been resolved by a complete re-write. However, to answer your question: the original code was written several years ago and was working for a long time before it broke. Exactly WHEN it broke, I do not know - this process is not run on a regular basis. My basic program was collecting the data and loading it into various properties of the RBO object. It was NOT in XML originally. It was simply multi-valued (and some sub-valued) data that was passed back to Redback who passed it back to the web page (server). The web page then converted the data into arrays and built the data as an Excel file using: Response.Buffer = TRUE Response.ContentType = application/vnd.ms-excel Response.AddHeader content-disposition, attachment; filename=All_Users.xls and building the data as an HTML table. This was pretty cool while it lasted. XML was not involved with this original process. Unfortunately, this stopped working at some point, and all my testing points to a size limit hitting me somewhere. The failure was happening somewhere between the basic program returning and the web page/server taking control. As far as I can tell, the only things between these 2 points is Redback. Since everything worked cleanly on the Avanté (UNIX) box and the failure occurred AFTER returning control, I decided to completely redesign this overall process to do all the work in the basic program. I am now building the data as an XML file, sending the user an E-mail with the XML file as an attachment, then returning control back to Redback (but w/o any data to handle), who in turn returns control back to the web server. Upon regaining control, the web servers simply redisplays the web page. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ross Ferris Sent: Wednesday, March 30, 2011 9:01 PM To: U2 Users List Subject: Re: [U2] Redback Limit You said you were making XML no stray or in the data you are generating that could throw things off? Ross Ferris Stamina Software Visage Better by Design! -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: 31 March 2011 6:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit There were 13 columns with 970 rows (including a header). These columns included: E-mail address User Name Domain User Type Last Login Date Last Login Time AR Inq (1/0) Sales Inq (1/0) RMA Inq (1/0) Products Inq (1/0) Storefront (1/0) USA Companies (svm) Canadian Companies (svm) The last 2 columns contain the company # and name. Everything worked find for a while. At some point, we noticed that it was no longer working. I suspect this was when we reached a certain number of users thus hitting a limit. Using a SAMPLE XXX on my SELECT, I was able to determine the last record that would work. I looked at it and the following record for bad info, but there was none. I skipped over the offending record, but it simply blew up on the next record (thus hitting the suspected size limit). Taking the names out of the last 2 columns (thus only returning just the customer numbers) worked, but was not meaningful. I have since redesigned this whole process to created an XML file on the UNIX box then E-mailed it to the user as an attachment. Thus, the exact same info is received by the user, but no data is actually passed back to the web page. Just one of life's little mysteries. Thanks for all the input. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Holt, Jake Sent: Wednesday, March 30, 2011 2:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit How many fields do you have? From what I remember reading, there was a field limit on RBOs, it was like a thousand fields though. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 10:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2
Re: [U2] Redback Limit
Hi, Sorry, I meant within BEGIN TRANSACTION... END TRANSACTION, but if there was no writing, I wouldn't have thought this was the issue. Adam -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: 31 March 2011 13:53 To: 'U2 Users List' Subject: Re: [U2] Redback Limit I don't understand the within transaction boundaries? I was not updating (writing to disk) anything. I was just loading the RBO in my basic program, then on the web server I was pulling that data apart and building an Excel file with that data. The user was then shown a window (produced by the browser) asking if they wanted to open the file. If they say yes, it opens in Excel. Nothing was ever written to disk in the original design. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Adam Eccleshall Sent: Thursday, March 31, 2011 8:45 AM To: U2 Users List Subject: Re: [U2] Redback Limit Hi, Was the update within transaction boundaries at all? We had an issue where attempting to update all records in an import within the same transaction hit a limit and crashed the process. This was resolved by making each import line its own transaction (transaction processing had been wrapped around an existing process, rather than being designed in from the start). Adam -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: 31 March 2011 13:29 To: 'U2 Users List' Subject: Re: [U2] Redback Limit This issue has been resolved by a complete re-write. However, to answer your question: the original code was written several years ago and was working for a long time before it broke. Exactly WHEN it broke, I do not know - this process is not run on a regular basis. My basic program was collecting the data and loading it into various properties of the RBO object. It was NOT in XML originally. It was simply multi-valued (and some sub-valued) data that was passed back to Redback who passed it back to the web page (server). The web page then converted the data into arrays and built the data as an Excel file using: Response.Buffer = TRUE Response.ContentType = application/vnd.ms-excel Response.AddHeader content-disposition, attachment; filename=All_Users.xls and building the data as an HTML table. This was pretty cool while it lasted. XML was not involved with this original process. Unfortunately, this stopped working at some point, and all my testing points to a size limit hitting me somewhere. The failure was happening somewhere between the basic program returning and the web page/server taking control. As far as I can tell, the only things between these 2 points is Redback. Since everything worked cleanly on the Avanté (UNIX) box and the failure occurred AFTER returning control, I decided to completely redesign this overall process to do all the work in the basic program. I am now building the data as an XML file, sending the user an E-mail with the XML file as an attachment, then returning control back to Redback (but w/o any data to handle), who in turn returns control back to the web server. Upon regaining control, the web servers simply redisplays the web page. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ross Ferris Sent: Wednesday, March 30, 2011 9:01 PM To: U2 Users List Subject: Re: [U2] Redback Limit You said you were making XML no stray or in the data you are generating that could throw things off? Ross Ferris Stamina Software Visage Better by Design! -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: 31 March 2011 6:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit There were 13 columns with 970 rows (including a header). These columns included: E-mail address User Name Domain User Type Last Login Date Last Login Time AR Inq (1/0) Sales Inq (1/0) RMA Inq (1/0) Products Inq (1/0) Storefront (1/0) USA Companies (svm) Canadian Companies (svm) The last 2 columns contain the company # and name. Everything worked find for a while. At some point, we noticed that it was no longer working. I suspect this was when we reached a certain number of users thus hitting a limit. Using a SAMPLE XXX on my SELECT, I was able to determine the last record that would work. I looked at it and the following record for bad info, but there was none. I skipped over the offending record, but it simply
Re: [U2] Redback Limit
Hi John, I hit a Redback size limit at a clients also. The app was fine, and then all of a sudden it stopped working. The RBO was very straight forward - it captured data from the web, and then transmitted it to the back end. IIRC, the limit was just over 15,000 characters. I didn't redesign the whole app, but instead looped on the submission - limiting the # of rows submitted each itteration. The client had a bunch of RBOs with a bunch of submissions, and we were suprised to find a limit. But it was absolutely reproduceable. I don't think that they ever encountered this problem since then, and it's real possible that an application upgrade (redback, unidata) also helped. Hope that helps! Or at least you have a sympathetic ear. -Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/30/2011 11:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Redback Limit
Thanks Laura, You are the first to confirm a size limit. Like you, I found a way around it. It just would have been nice to know about this up front. For all I know, it actually is documented somewhere and folks just do not hit that limit due to other limiting factors. Any idea if it was a 15k limit on a property, or a 15k limit on the overall RBO? John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Laura Hirsh Sent: Thursday, March 31, 2011 12:58 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Redback Limit Hi John, I hit a Redback size limit at a clients also. The app was fine, and then all of a sudden it stopped working. The RBO was very straight forward - it captured data from the web, and then transmitted it to the back end. IIRC, the limit was just over 15,000 characters. I didn't redesign the whole app, but instead looped on the submission - limiting the # of rows submitted each itteration. The client had a bunch of RBOs with a bunch of submissions, and we were suprised to find a limit. But it was absolutely reproduceable. I don't think that they ever encountered this problem since then, and it's real possible that an application upgrade (redback, unidata) also helped. Hope that helps! Or at least you have a sympathetic ear. -Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/30/2011 11:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Redback Limit
Hi John, I'm pretty sure that it was a per property limit. The application had a lot of people's names: salutation + first name + middle initial + last name, etc. It took a bunch of trial and error to figure out - RBO Scope helped a ton. The team I was working with at the time, couldn't believe that there was any limit, but after I demo-ed to them, they were believers! HTH, Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/31/2011 01:08 PM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Thanks Laura, You are the first to confirm a size limit. Like you, I found a way around it. It just would have been nice to know about this up front. For all I know, it actually is documented somewhere and folks just do not hit that limit due to other limiting factors. Any idea if it was a 15k limit on a property, or a 15k limit on the overall RBO? John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Laura Hirsh Sent: Thursday, March 31, 2011 12:58 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Redback Limit Hi John, I hit a Redback size limit at a clients also. The app was fine, and then all of a sudden it stopped working. The RBO was very straight forward - it captured data from the web, and then transmitted it to the back end. IIRC, the limit was just over 15,000 characters. I didn't redesign the whole app, but instead looped on the submission - limiting the # of rows submitted each iteration. The client had a bunch of RBOs with a bunch of submissions, and we were surprised to find a limit. But it was absolutely reproduce-able. I don't think that they ever encountered this problem since then, and it's real possible that an application upgrade (redback, unidata) also helped. Hope that helps! Or at least you have a sympathetic ear. -Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/30/2011 11:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while
Re: [U2] Redback Limit
Laura, Yeah, your experience looks strikingly similar to what I experienced. It was a pain to zero in on, but reproducible over and over. Thanks again for confirmation. That looks like something we all need to keep in mind. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Laura Hirsh Sent: Thursday, March 31, 2011 1:40 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Redback Limit Hi John, I'm pretty sure that it was a per property limit. The application had a lot of people's names: salutation + first name + middle initial + last name, etc. It took a bunch of trial and error to figure out - RBO Scope helped a ton. The team I was working with at the time, couldn't believe that there was any limit, but after I demo-ed to them, they were believers! HTH, Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/31/2011 01:08 PM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Thanks Laura, You are the first to confirm a size limit. Like you, I found a way around it. It just would have been nice to know about this up front. For all I know, it actually is documented somewhere and folks just do not hit that limit due to other limiting factors. Any idea if it was a 15k limit on a property, or a 15k limit on the overall RBO? John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Laura Hirsh Sent: Thursday, March 31, 2011 12:58 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Redback Limit Hi John, I hit a Redback size limit at a clients also. The app was fine, and then all of a sudden it stopped working. The RBO was very straight forward - it captured data from the web, and then transmitted it to the back end. IIRC, the limit was just over 15,000 characters. I didn't redesign the whole app, but instead looped on the submission - limiting the # of rows submitted each iteration. The client had a bunch of RBOs with a bunch of submissions, and we were surprised to find a limit. But it was absolutely reproduce-able. I don't think that they ever encountered this problem since then, and it's real possible that an application upgrade (redback, unidata) also helped. Hope that helps! Or at least you have a sympathetic ear. -Laura -Original Message- From: Israel, John R. [johnisr...@daytonsuperior.com] Date: 03/30/2011 11:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info
Re: [U2] Redback Limit
Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Redback Limit
It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Redback Limit
How many fields do you have? From what I remember reading, there was a field limit on RBOs, it was like a thousand fields though. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 10:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Redback Limit
There were 13 columns with 970 rows (including a header). These columns included: E-mail address User Name Domain User Type Last Login Date Last Login Time AR Inq (1/0) Sales Inq (1/0) RMA Inq (1/0) Products Inq (1/0) Storefront (1/0) USA Companies (svm) Canadian Companies (svm) The last 2 columns contain the company # and name. Everything worked find for a while. At some point, we noticed that it was no longer working. I suspect this was when we reached a certain number of users thus hitting a limit. Using a SAMPLE XXX on my SELECT, I was able to determine the last record that would work. I looked at it and the following record for bad info, but there was none. I skipped over the offending record, but it simply blew up on the next record (thus hitting the suspected size limit). Taking the names out of the last 2 columns (thus only returning just the customer numbers) worked, but was not meaningful. I have since redesigned this whole process to created an XML file on the UNIX box then E-mailed it to the user as an attachment. Thus, the exact same info is received by the user, but no data is actually passed back to the web page. Just one of life's little mysteries. Thanks for all the input. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Holt, Jake Sent: Wednesday, March 30, 2011 2:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit How many fields do you have? From what I remember reading, there was a field limit on RBOs, it was like a thousand fields though. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 10:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent: Tuesday, March 29, 2011 9:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit About how much data is being passed back? Could the server be timing out while receiving it all? -Kevin http://www.PrecisOnline.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org
Re: [U2] Redback Limit
You said you were making XML no stray or in the data you are generating that could throw things off? Ross Ferris Stamina Software Visage Better by Design! -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: 31 March 2011 6:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit There were 13 columns with 970 rows (including a header). These columns included: E-mail address User Name Domain User Type Last Login Date Last Login Time AR Inq (1/0) Sales Inq (1/0) RMA Inq (1/0) Products Inq (1/0) Storefront (1/0) USA Companies (svm) Canadian Companies (svm) The last 2 columns contain the company # and name. Everything worked find for a while. At some point, we noticed that it was no longer working. I suspect this was when we reached a certain number of users thus hitting a limit. Using a SAMPLE XXX on my SELECT, I was able to determine the last record that would work. I looked at it and the following record for bad info, but there was none. I skipped over the offending record, but it simply blew up on the next record (thus hitting the suspected size limit). Taking the names out of the last 2 columns (thus only returning just the customer numbers) worked, but was not meaningful. I have since redesigned this whole process to created an XML file on the UNIX box then E-mailed it to the user as an attachment. Thus, the exact same info is received by the user, but no data is actually passed back to the web page. Just one of life's little mysteries. Thanks for all the input. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Holt, Jake Sent: Wednesday, March 30, 2011 2:16 PM To: U2 Users List Subject: Re: [U2] Redback Limit How many fields do you have? From what I remember reading, there was a field limit on RBOs, it was like a thousand fields though. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 10:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit It was not timing out. I have other pages that take longer. It really seemed to be a size limit. I develop with FF with a Web Developer plug-in that helps a lot. I validate with IE, Chrome, Opera and Safari, but FF is my preferred browser. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Glen Batchelor Sent: Wednesday, March 30, 2011 11:03 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit Try using cURL or wget, with an unlimited timeout, and get the real headers from the server. Assuming you're using IE, it rarely tells a true story when it comes to server connection issues or HTTP errors. Glen Batchelor IT Director/CIO/CTO All-Spec Industries phone: (910) 332-0424 fax: (910) 763-5664 E-mail: webmas...@all-spec.com Web: http://www.all-spec.com Blog: http://blog.all-spec.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Israel, John R. Sent: Wednesday, March 30, 2011 8:33 AM To: 'U2 Users List' Subject: Re: [U2] Redback Limit I was exporting all the user info we track with Avanté's ePortal from ePortal back to a web page which rips the data apart and automatically opens it in Excel. Over 900 records with all kinds of info (name, company, access, etc.) I was never able to find any corruption in the data. I did find that by capping the number of records OR not loading the company names of the users the problem went away. If I wrote the data to a temp file prior to loading up the RBO to pass back to the web page, there was nothing wrong. I think there is simply a limit somewhere. I am not sure if the limit is on a specific property (mv list of company/name the user has access to see) or the RBO in general. Either way, I could not wait on this and I have had to re-engineer this export. What used to automatically build an Excel file for the user via an ASP web page will now create an XML file of the same info in ePortal (on the UNIX box), then E-mail it to the user. Granted, this was a lot of data, but with today's technology, I did not think it was THAT bad. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of Kevin King Sent
[U2] Redback Limit
Is there a limit to how much data can be passed from UniData through Redback? I am getting a: Server Error: 500 - Internal server error. If I reduce the # of records processed, select the data in different order, skip the apparent offending record, it continues to blow up. I have not found any problems with the data and am suspecting that it is simply passing too much data through the RBO object. John Israel Senior Programmer/Analyst Dayton Superior Corporation 1125 Byers Road Miamisburg, OH 45342 ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
