On Fri, Nov 17, 2017 at 7:19 PM, LtColRDSChauhan <rdsc1...@gmail.com> wrote:

>
>
> On Fri, Nov 17, 2017 at 5:38 PM, <firebird-net-provider-
> requ...@lists.sourceforge.net> wrote:
>
>> Send Firebird-net-provider mailing list submissions to
>>         firebird-net-provider@lists.sourceforge.net
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>>         https://lists.sourceforge.net/lists/listinfo/firebird-net-pr
>> ovider
>> or, via email, send a message with subject or body 'help' to
>>         firebird-net-provider-requ...@lists.sourceforge.net
>>
>> You can reach the person managing the list at
>>         firebird-net-provider-ow...@lists.sourceforge.net
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of Firebird-net-provider digest..."
>>
>>
>> Today's Topics:
>>
>>    1. Error reading data from the connection (LtColRDSChauhan)
>>    2. Re: Error reading data from the connection (Gerdus van Zyl)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Thu, 16 Nov 2017 20:03:05 +0530
>> From: LtColRDSChauhan <rdsc1...@gmail.com>
>> To: firebird-net-provider@lists.sourceforge.net
>> Subject: [Firebird-net-provider] Error reading data from the
>>         connection
>> Message-ID:
>>         <camg8wxjv-2meg9j4cxo4bajxpdgb6-nlvbqivdswvr63rqc...@mail.gm
>> ail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> Hello,
>>
>> 1. I need to frequently copy a table from one database to another. This
>> has
>> started to fail now, apparently due to increase in number of records.
>> Attempting to copy about 13,26,000 records fails reporting ?Error reading
>> data from the connection?. Number of records that I can still successful
>> copy is about 13,24,510.
>>
>> 3. I copy the in batches of 50,000 records (variable) each. For each
>> batch,
>> i open and close connection. I have tried setting connection pooling true
>> and false both. Also varied the batch size to 5000, 100000 etc.
>>
>> 2. My database and client are on the same machine. Other details:
>>
>> RAM 16 GB
>>
>> Client application 64 Bit
>>
>> OS Windows 10 64 Bit
>>
>> Firebird ADO.NET Data Provider ? tried both: 5.11.0.0 and 5.12.0
>>
>> Firebird 3.0.2.32703_0_Win64
>>
>> 3. Please suggest possible solutions.
>>
>> Regards,
>>
>> Rajiv
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>>
>> ------------------------------
>>
>> Message: 2
>> Date: Thu, 16 Nov 2017 16:51:38 +0200
>> From: Gerdus van Zyl <gerdusvan...@gmail.com>
>> To: "For users and developers of the Firebird .NET providers"
>>         <firebird-net-provider@lists.sourceforge.net>
>> Subject: Re: [Firebird-net-provider] Error reading data from the
>>         connection
>> Message-ID:
>>         <CALvycTnBNwJVQVsgV3tgEkdP-MOwRGCcUJX6G7sF1dqLYmXH3g@mail.
>> gmail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> You can just catch the exception, rollback the batch transaction if
>> possible, reconnect and retry that batch again.
>> Having retry logic is the only way to ensure reliability.
>>
>
> I am using try-catch and roll back.
> Also retrying again and again after roll back for last 48hrs.
> The result is consistently the same ie copying about 13,26,000 records
> fails reporting Error reading data from the connection,
> while copying  about 13,24,510 record always succeeds.
> The issue here is more then just ensuring reliability.
>
I could pin point the issue in my case.

With the select command text for FbDataAdapter set as:

SELECT first 50000 SKIP 1260000 * FROM PATIENT_BILL order by REGDID, SER

Calling Fill raises the exception Error reading data from the connection
immediately on a freshly created single connection with no pooling.

Am I missing some setting for FbDataAdapter?


> May be I am missing out settings.
> Please suggest possible solutions.
>
>
>
>> On 16 November 2017 at 16:33, LtColRDSChauhan <rdsc1...@gmail.com> wrote:
>>
>> > Hello,
>> >
>> > 1. I need to frequently copy a table from one database to another. This
>> > has started to fail now, apparently due to increase in number of
>> records.
>> > Attempting to copy about 13,26,000 records fails reporting ?Error
>> reading
>> > data from the connection?. Number of records that I can still successful
>> > copy is about 13,24,510.
>> >
>> > 3. I copy the in batches of 50,000 records (variable) each. For each
>> > batch, i open and close connection. I have tried setting connection
>> pooling
>> > true and false both. Also varied the batch size to 5000, 100000 etc.
>> >
>> > 2. My database and client are on the same machine. Other details:
>> >
>> > RAM 16 GB
>> >
>> > Client application 64 Bit
>> >
>> > OS Windows 10 64 Bit
>> >
>> > Firebird ADO.NET Data Provider ? tried both: 5.11.0.0 and 5.12.0
>> >
>> > Firebird 3.0.2.32703_0_Win64
>> >
>> > 3. Please suggest possible solutions.
>> >
>> > Regards,
>> >
>> > Rajiv
>> >
>> >
>> >
>> > ------------------------------------------------------------
>> > ------------------
>> > Check out the vibrant tech community on one of the world's most
>> > engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> > _______________________________________________
>> > Firebird-net-provider mailing list
>> > Firebird-net-provider@lists.sourceforge.net
>> > https://lists.sourceforge.net/lists/listinfo/firebird-net-provider
>> >
>> >
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>>
>> ------------------------------
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>
>> ------------------------------
>>
>> Subject: Digest Footer
>>
>> _______________________________________________
>> Firebird-net-provider mailing list
>> Firebird-net-provider@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/firebird-net-provider
>>
>>
>> ------------------------------
>>
>> End of Firebird-net-provider Digest, Vol 139, Issue 3
>> *****************************************************
>>
>
>
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Firebird-net-provider mailing list
Firebird-net-provider@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/firebird-net-provider

Reply via email to