zy-kkk commented on issue #33380:
URL: https://github.com/apache/doris/issues/33380#issuecomment-2044015843
> > I would like to know the following situations
> >
> > 1. How many queries for external catalog can you have at most at the
same time?
> > 2. Are you using the alter catalog statement to adjust connection_pool
related parameters?
> > 3. After adjusting `connection_pool_max_size` to 10000
> > Is the error reported a new CAUSED BY: GetConnectionTimeoutException:
wait millis 5002, active 10000, maxActive 10000, creating 0, or is the error
still CAUSED BY: GetConnectionTimeoutException: wait millis 5002, active 10,
maxActive 10, creating 0. Pay attention to the difference between 10 and 10000.
the difference
> > 4. Are you in a multi-FE environment? When an error occurs, have you
paid attention to whether the connected FE is the master FE?
> > 5. Have you tried re-creating a catalog and specifying
connection_pool_max_size as a larger value, such as 100, in the properties of
the created catalog? Then run it for a period of time and observe whether there
are the following errors: CAUSED BY: GetConnectionTimeoutException: wait millis
5002, active 100, maxActive 100, creating 0
>
> 1. Majority of queries in our production requirements require joins from
external tables. In most cases we have no more than 50 queries at the same time.
> 2. Yes. Specifically, we use the statement `ALTER RESOURCE abc
PROPERTIES("connection_pool_max_size"="1000")`. After updating the value to a
different one, we were immediately able to query the external table under this
resource regardless to the size we set it to.
> 3. The former. The new error would be CAUSED BY:
GetConnectionTimeoutException: wait millis 5002, active 10000, maxActive 10000.
> 4. Yes, currently we have 3 FEs, all followers. We observed the same error
regardless if we were connected to the master node. We also see that the IP
reported from the error is always from the BE nodes. Furthermore, we hit the
same error when we only had 1 FE.
> 5. Yes. We observed that dropping and re-adding the resource and table has
the same effect as using the alter statements.
This seems a bit tricky. I also tested it using the method you mentioned,
but I did not reproduce the problem. Is there any way I can contact you so that
we can synchronize in time?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
