Re: jdk 17 and accumulo testing
Thank you for the response Christopher. I did not test that a snapshot after cshannon:accumulo-3094-fix was merged because cshannon appeared to be pretty confident that he was able to create a test that duplicated my issue and was able to fix it, but I can build a snapshot and see if my tests pass on Monday. Thanks again, Vincent On Fri, Apr 28, 2023 at 8:42 AM Christopher wrote: > There's a few outstanding issues. Notably, the issue mentioned on > https://github.com/apache/accumulo/issues/3346 > There's also ensuring some stuff is marked as deprecated in 2.1.1 that > is mentioned in > https://github.com/apache/accumulo/pull/3265#discussion_r1177315428 > (but that's really minor). > > The project tracker is at > https://github.com/apache/accumulo/projects/25 and there's a few > things in flight. > > I'm bad at estimating time (there was a time I thought we'd have 3.0 > out in December 2022 and I thought we'd have 2.1.1 sometime around > February). Technically, we could put together a release candidate now, > but if it doesn't include some important things, we'll want to do > anther one right away, and that rapid churn is tiring for both devs > and users. I would watch #3346, as that seems to be the most critical > issue right now. Once that's figured out, releasing should be able to > follow shortly after. > > I'm curious if the issue addressed in > https://github.com/apache/accumulo/pull/3134 actually fixes your > issue. Have you tried a recent snapshot version to see if the problem > is fixed for you? I looked for, but didn't see, any comment from you > about that. > > On Fri, Apr 28, 2023 at 7:07 AM Vincent Russell > wrote: > > > > Hello, > > > > Just checking in on if there is a timeframe for 2.1.1. > > > > This has been delaying our upgrade to jdk 17 for almost 5 month now. > > > > > > Thanks, > > Vincent > > > > > > > > On Fri, Dec 30, 2022, 12:57 PM Vincent Russell < > vincent.russ...@gmail.com> > > wrote: > > > > > Ok.. Thank you for the update. > > > > > > On Fri, Dec 30, 2022 at 11:55 AM Christopher > wrote: > > > > > >> For reference, here's the PR working on the fix for 2.1.1: > > >> https://github.com/apache/accumulo/pull/3134 > > >> > > >> On Fri, Dec 30, 2022 at 11:39 AM Christopher Shannon > > >> wrote: > > >> > > > >> > Version 2.1.1 will be released with bug fixes and this fix (when > > >> finished > > >> > and merged) is planned to be included as part of that release. I > don't > > >> know > > >> > the exact time frame yet though. > > >> > > > >> > On Fri, Dec 30, 2022 at 11:04 AM Vincent Russell < > > >> vincent.russ...@gmail.com> > > >> > wrote: > > >> > > > >> > > Hello, > > >> > > > > >> > > Are there any plans to release an accumulo 2.1 patch to fix this > > >> issue? > > >> > > > > >> > > Thanks, > > >> > > > > >> > > On Sat, Dec 17, 2022 at 7:36 PM Vincent Russell < > > >> vincent.russ...@gmail.com > > >> > > > > > >> > > wrote: > > >> > > > > >> > > > No worries. I'm glad I was able to help in some small way. > > >> > > > > > >> > > > Thank you for fixing the issue. > > >> > > > > > >> > > > On Sat, Dec 17, 2022 at 11:49 AM Christopher Shannon < > > >> > > > christopher.l.shan...@gmail.com> wrote: > > >> > > > > > >> > > >> I created https://github.com/apache/accumulo/pull/3134 and > that > > >> should > > >> > > >> fix > > >> > > >> this issue. > > >> > > >> > > >> > > >> Thanks Vincent for pointing out the issue in TServerUtils, your > > >> testing > > >> > > >> made this easy to track down and fix. > > >> > > >> > > >> > > >> > > >> > > >> On Sat, Dec 17, 2022 at 9:00 AM Christopher Shannon < > > >> > > >> christopher.l.shan...@gmail.com> wrote: > > >> > > >> > > >> > > >> > I was able to reproduce the issue by setting the value size > for a > > >> > > >> mutation > > >> > > >> > to size 16384001 to make sure it's greater than the default > > >> value for > > >> > > >> > Thrift and it fails immediately. I will work on a fix now > that > > >> we know > > >> > > >> how > > >> > > >> > to reproduce it. > > >> > > >> > > > >> > > >> > On Fri, Dec 16, 2022 at 2:31 PM Christopher < > ctubb...@apache.org > > >> > > > >> > > >> wrote: > > >> > > >> > > > >> > > >> >> I don't think it's intentional. This might be the source of > the > > >> > > >> problem. > > >> > > >> >> > > >> > > >> >> On Thu, Dec 15, 2022 at 3:39 PM Vincent Russell > > >> > > >> >> wrote: > > >> > > >> >> > > > >> > > >> >> > Also in TserverUtils:270, when the > TNonblockingServerSocket is > > >> > > >> created > > >> > > >> >> it > > >> > > >> >> > looks like it ends up using the default frame size. I am > not > > >> sure > > >> > > if > > >> > > >> >> this > > >> > > >> >> > is intentional or not. > > >> > > >> >> > > > >> > > >> >> > On Thu, Dec 15, 2022 at 3:26 PM Vincent Russell < > > >> > > >> >> vincent.russ...@gmail.com> > > >> > > >> >> > wrote: > > >> > > >> >> > > > >> > > >> >> > > Christopher, > > >> > > >> >> > > > > >> > > >> >> > > I am not sure if this issue is related to 3042 or not. >
Re: [DRAFT][ANNOUNCE] Apache Accumulo 1.10.3
Thanks, that's at least two more pairs of eyes. I'll go ahead and send it out while it's still early in the day, so people have a chance to see it before the weekend. On Fri, Apr 28, 2023 at 8:33 AM Mark Owens wrote: > > LGTM > > On Fri, Apr 28, 2023 at 6:49 AM Brian Loss wrote: > > > LGTM. Thanks Christopher. > > > > > On Apr 28, 2023, at 2:18 AM, Christopher wrote: > > > > > > Accumulo Devs, > > > > > > See the below draft release announcement that will be sent to the > > > users list and the Apache announce list. I intend to submit this later > > > today, and am requesting a second pair of eyes to check for typos, > > > errors, omissions. Thanks! > > > > > > *** > > > The Apache Accumulo project is pleased to announce the release > > > of Apache Accumulo 1.10.3! Apache Accumulo 1.10.3 is a bug fix > > > release of the 1.10 LTM release line. This release includes several > > > minor bug fixes and performance improvements. > > > See the release notes linked below for details. > > > > > > Users of 1.10.2 or earlier are encouraged to upgrade to take > > > advantage of these included bug fixes and improvements prior to > > > upgrading to the newer 2.1 LTM release series, to ensure the best > > > upgrade experience. > > > > > > Please note that 1.10 will be end-of-life in November 2023, and we > > > encourage all users to migrate to 2.1 (or later) by then. > > > > > > *** > > > > > > Apache Accumulo® is a sorted, distributed key/value store that > > > provides robust, scalable data storage and retrieval. With > > > Apache Accumulo, users can store and manage large data sets > > > across a cluster. Accumulo uses Apache Hadoop's HDFS to store > > > its data and Apache ZooKeeper for consensus. > > > > > > This version is now available in Maven Central, and at: > > > https://accumulo.apache.org/downloads/ > > > > > > The full release notes can be viewed at: > > > https://accumulo.apache.org/release/accumulo-1.10.3/ > >
Re: jdk 17 and accumulo testing
There's a few outstanding issues. Notably, the issue mentioned on https://github.com/apache/accumulo/issues/3346 There's also ensuring some stuff is marked as deprecated in 2.1.1 that is mentioned in https://github.com/apache/accumulo/pull/3265#discussion_r1177315428 (but that's really minor). The project tracker is at https://github.com/apache/accumulo/projects/25 and there's a few things in flight. I'm bad at estimating time (there was a time I thought we'd have 3.0 out in December 2022 and I thought we'd have 2.1.1 sometime around February). Technically, we could put together a release candidate now, but if it doesn't include some important things, we'll want to do anther one right away, and that rapid churn is tiring for both devs and users. I would watch #3346, as that seems to be the most critical issue right now. Once that's figured out, releasing should be able to follow shortly after. I'm curious if the issue addressed in https://github.com/apache/accumulo/pull/3134 actually fixes your issue. Have you tried a recent snapshot version to see if the problem is fixed for you? I looked for, but didn't see, any comment from you about that. On Fri, Apr 28, 2023 at 7:07 AM Vincent Russell wrote: > > Hello, > > Just checking in on if there is a timeframe for 2.1.1. > > This has been delaying our upgrade to jdk 17 for almost 5 month now. > > > Thanks, > Vincent > > > > On Fri, Dec 30, 2022, 12:57 PM Vincent Russell > wrote: > > > Ok.. Thank you for the update. > > > > On Fri, Dec 30, 2022 at 11:55 AM Christopher wrote: > > > >> For reference, here's the PR working on the fix for 2.1.1: > >> https://github.com/apache/accumulo/pull/3134 > >> > >> On Fri, Dec 30, 2022 at 11:39 AM Christopher Shannon > >> wrote: > >> > > >> > Version 2.1.1 will be released with bug fixes and this fix (when > >> finished > >> > and merged) is planned to be included as part of that release. I don't > >> know > >> > the exact time frame yet though. > >> > > >> > On Fri, Dec 30, 2022 at 11:04 AM Vincent Russell < > >> vincent.russ...@gmail.com> > >> > wrote: > >> > > >> > > Hello, > >> > > > >> > > Are there any plans to release an accumulo 2.1 patch to fix this > >> issue? > >> > > > >> > > Thanks, > >> > > > >> > > On Sat, Dec 17, 2022 at 7:36 PM Vincent Russell < > >> vincent.russ...@gmail.com > >> > > > > >> > > wrote: > >> > > > >> > > > No worries. I'm glad I was able to help in some small way. > >> > > > > >> > > > Thank you for fixing the issue. > >> > > > > >> > > > On Sat, Dec 17, 2022 at 11:49 AM Christopher Shannon < > >> > > > christopher.l.shan...@gmail.com> wrote: > >> > > > > >> > > >> I created https://github.com/apache/accumulo/pull/3134 and that > >> should > >> > > >> fix > >> > > >> this issue. > >> > > >> > >> > > >> Thanks Vincent for pointing out the issue in TServerUtils, your > >> testing > >> > > >> made this easy to track down and fix. > >> > > >> > >> > > >> > >> > > >> On Sat, Dec 17, 2022 at 9:00 AM Christopher Shannon < > >> > > >> christopher.l.shan...@gmail.com> wrote: > >> > > >> > >> > > >> > I was able to reproduce the issue by setting the value size for a > >> > > >> mutation > >> > > >> > to size 16384001 to make sure it's greater than the default > >> value for > >> > > >> > Thrift and it fails immediately. I will work on a fix now that > >> we know > >> > > >> how > >> > > >> > to reproduce it. > >> > > >> > > >> > > >> > On Fri, Dec 16, 2022 at 2:31 PM Christopher >> > > >> > > >> wrote: > >> > > >> > > >> > > >> >> I don't think it's intentional. This might be the source of the > >> > > >> problem. > >> > > >> >> > >> > > >> >> On Thu, Dec 15, 2022 at 3:39 PM Vincent Russell > >> > > >> >> wrote: > >> > > >> >> > > >> > > >> >> > Also in TserverUtils:270, when the TNonblockingServerSocket is > >> > > >> created > >> > > >> >> it > >> > > >> >> > looks like it ends up using the default frame size. I am not > >> sure > >> > > if > >> > > >> >> this > >> > > >> >> > is intentional or not. > >> > > >> >> > > >> > > >> >> > On Thu, Dec 15, 2022 at 3:26 PM Vincent Russell < > >> > > >> >> vincent.russ...@gmail.com> > >> > > >> >> > wrote: > >> > > >> >> > > >> > > >> >> > > Christopher, > >> > > >> >> > > > >> > > >> >> > > I am not sure if this issue is related to 3042 or not. > >> > > >> >> > > > >> > > >> >> > > On the client side it does look like TConfiguration ends up > >> being > >> > > >> >> called > >> > > >> >> > > with the default constructor. I am not sure if this is > >> > > intentional > >> > > >> >> or not. > >> > > >> >> > > > >> > > >> >> > > On the server side I see this stack, so it also looks like: > >> > > >> >> > > > >> > > >> >> > > at > >> > > org.apache.thrift.TConfiguration.(TConfiguration.java:36) > >> > > >> >> > > at > >> > > >> >> > >> > > org.apache.thrift.TConfiguration$Builder.build(TConfiguration.java:99) > >> > > >> >> > > at > >> > > >> org.apache.thrift.TConfiguration.(TConfiguration.java:65) > >> > > >> >> > > at > >> > > >> >> > > > >> > > >>
Re: [DRAFT][ANNOUNCE] Apache Accumulo 1.10.3
LGTM On Fri, Apr 28, 2023 at 6:49 AM Brian Loss wrote: > LGTM. Thanks Christopher. > > > On Apr 28, 2023, at 2:18 AM, Christopher wrote: > > > > Accumulo Devs, > > > > See the below draft release announcement that will be sent to the > > users list and the Apache announce list. I intend to submit this later > > today, and am requesting a second pair of eyes to check for typos, > > errors, omissions. Thanks! > > > > *** > > The Apache Accumulo project is pleased to announce the release > > of Apache Accumulo 1.10.3! Apache Accumulo 1.10.3 is a bug fix > > release of the 1.10 LTM release line. This release includes several > > minor bug fixes and performance improvements. > > See the release notes linked below for details. > > > > Users of 1.10.2 or earlier are encouraged to upgrade to take > > advantage of these included bug fixes and improvements prior to > > upgrading to the newer 2.1 LTM release series, to ensure the best > > upgrade experience. > > > > Please note that 1.10 will be end-of-life in November 2023, and we > > encourage all users to migrate to 2.1 (or later) by then. > > > > *** > > > > Apache Accumulo® is a sorted, distributed key/value store that > > provides robust, scalable data storage and retrieval. With > > Apache Accumulo, users can store and manage large data sets > > across a cluster. Accumulo uses Apache Hadoop's HDFS to store > > its data and Apache ZooKeeper for consensus. > > > > This version is now available in Maven Central, and at: > > https://accumulo.apache.org/downloads/ > > > > The full release notes can be viewed at: > > https://accumulo.apache.org/release/accumulo-1.10.3/ >
Re: jdk 17 and accumulo testing
Hello, Just checking in on if there is a timeframe for 2.1.1. This has been delaying our upgrade to jdk 17 for almost 5 month now. Thanks, Vincent On Fri, Dec 30, 2022, 12:57 PM Vincent Russell wrote: > Ok.. Thank you for the update. > > On Fri, Dec 30, 2022 at 11:55 AM Christopher wrote: > >> For reference, here's the PR working on the fix for 2.1.1: >> https://github.com/apache/accumulo/pull/3134 >> >> On Fri, Dec 30, 2022 at 11:39 AM Christopher Shannon >> wrote: >> > >> > Version 2.1.1 will be released with bug fixes and this fix (when >> finished >> > and merged) is planned to be included as part of that release. I don't >> know >> > the exact time frame yet though. >> > >> > On Fri, Dec 30, 2022 at 11:04 AM Vincent Russell < >> vincent.russ...@gmail.com> >> > wrote: >> > >> > > Hello, >> > > >> > > Are there any plans to release an accumulo 2.1 patch to fix this >> issue? >> > > >> > > Thanks, >> > > >> > > On Sat, Dec 17, 2022 at 7:36 PM Vincent Russell < >> vincent.russ...@gmail.com >> > > > >> > > wrote: >> > > >> > > > No worries. I'm glad I was able to help in some small way. >> > > > >> > > > Thank you for fixing the issue. >> > > > >> > > > On Sat, Dec 17, 2022 at 11:49 AM Christopher Shannon < >> > > > christopher.l.shan...@gmail.com> wrote: >> > > > >> > > >> I created https://github.com/apache/accumulo/pull/3134 and that >> should >> > > >> fix >> > > >> this issue. >> > > >> >> > > >> Thanks Vincent for pointing out the issue in TServerUtils, your >> testing >> > > >> made this easy to track down and fix. >> > > >> >> > > >> >> > > >> On Sat, Dec 17, 2022 at 9:00 AM Christopher Shannon < >> > > >> christopher.l.shan...@gmail.com> wrote: >> > > >> >> > > >> > I was able to reproduce the issue by setting the value size for a >> > > >> mutation >> > > >> > to size 16384001 to make sure it's greater than the default >> value for >> > > >> > Thrift and it fails immediately. I will work on a fix now that >> we know >> > > >> how >> > > >> > to reproduce it. >> > > >> > >> > > >> > On Fri, Dec 16, 2022 at 2:31 PM Christopher > > >> > > >> wrote: >> > > >> > >> > > >> >> I don't think it's intentional. This might be the source of the >> > > >> problem. >> > > >> >> >> > > >> >> On Thu, Dec 15, 2022 at 3:39 PM Vincent Russell >> > > >> >> wrote: >> > > >> >> > >> > > >> >> > Also in TserverUtils:270, when the TNonblockingServerSocket is >> > > >> created >> > > >> >> it >> > > >> >> > looks like it ends up using the default frame size. I am not >> sure >> > > if >> > > >> >> this >> > > >> >> > is intentional or not. >> > > >> >> > >> > > >> >> > On Thu, Dec 15, 2022 at 3:26 PM Vincent Russell < >> > > >> >> vincent.russ...@gmail.com> >> > > >> >> > wrote: >> > > >> >> > >> > > >> >> > > Christopher, >> > > >> >> > > >> > > >> >> > > I am not sure if this issue is related to 3042 or not. >> > > >> >> > > >> > > >> >> > > On the client side it does look like TConfiguration ends up >> being >> > > >> >> called >> > > >> >> > > with the default constructor. I am not sure if this is >> > > intentional >> > > >> >> or not. >> > > >> >> > > >> > > >> >> > > On the server side I see this stack, so it also looks like: >> > > >> >> > > >> > > >> >> > > at >> > > org.apache.thrift.TConfiguration.(TConfiguration.java:36) >> > > >> >> > > at >> > > >> >> >> > > org.apache.thrift.TConfiguration$Builder.build(TConfiguration.java:99) >> > > >> >> > > at >> > > >> org.apache.thrift.TConfiguration.(TConfiguration.java:65) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.transport.TNonblockingSocket.(TNonblockingSocket.java:74) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.transport.TNonblockingSocket.(TNonblockingSocket.java:68) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.transport.TNonblockingServerSocket.accept(TNonblockingServerSocket.java:135) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.transport.TNonblockingServerSocket.accept(TNonblockingServerSocket.java:36) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.server.TNonblockingServer$SelectAcceptThread.handleAccept(TNonblockingServer.java:218) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.server.TNonblockingServer$SelectAcceptThread.select(TNonblockingServer.java:186) >> > > >> >> > > at >> > > >> >> > > >> > > >> >> >> > > >> >> > > >> org.apache.thrift.server.TNonblockingServer$SelectAcceptThread.run(TNonblockingServer.java:142) >> > > >> >> > > >> > > >> >> > > >> > > >> >> > > I see this in the server log so it does look like it should >> be >> > > >> using >> > > >> >> 1G: >> > > >> >> > > 2022-09-01 16:59:41 INFO >> > > >> [org.apache.accumulo.tserver.TabletServer] >> > > >> >> > > ServerUtil:124 - general.server.message.size.max = 1G >> > > >> >> > > >> > > >> >> > > Thanks, >> > > >> >> > >
Re: [DRAFT][ANNOUNCE] Apache Accumulo 1.10.3
LGTM. Thanks Christopher. > On Apr 28, 2023, at 2:18 AM, Christopher wrote: > > Accumulo Devs, > > See the below draft release announcement that will be sent to the > users list and the Apache announce list. I intend to submit this later > today, and am requesting a second pair of eyes to check for typos, > errors, omissions. Thanks! > > *** > The Apache Accumulo project is pleased to announce the release > of Apache Accumulo 1.10.3! Apache Accumulo 1.10.3 is a bug fix > release of the 1.10 LTM release line. This release includes several > minor bug fixes and performance improvements. > See the release notes linked below for details. > > Users of 1.10.2 or earlier are encouraged to upgrade to take > advantage of these included bug fixes and improvements prior to > upgrading to the newer 2.1 LTM release series, to ensure the best > upgrade experience. > > Please note that 1.10 will be end-of-life in November 2023, and we > encourage all users to migrate to 2.1 (or later) by then. > > *** > > Apache Accumulo® is a sorted, distributed key/value store that > provides robust, scalable data storage and retrieval. With > Apache Accumulo, users can store and manage large data sets > across a cluster. Accumulo uses Apache Hadoop's HDFS to store > its data and Apache ZooKeeper for consensus. > > This version is now available in Maven Central, and at: > https://accumulo.apache.org/downloads/ > > The full release notes can be viewed at: > https://accumulo.apache.org/release/accumulo-1.10.3/
[DRAFT][ANNOUNCE] Apache Accumulo 1.10.3
Accumulo Devs, See the below draft release announcement that will be sent to the users list and the Apache announce list. I intend to submit this later today, and am requesting a second pair of eyes to check for typos, errors, omissions. Thanks! *** The Apache Accumulo project is pleased to announce the release of Apache Accumulo 1.10.3! Apache Accumulo 1.10.3 is a bug fix release of the 1.10 LTM release line. This release includes several minor bug fixes and performance improvements. See the release notes linked below for details. Users of 1.10.2 or earlier are encouraged to upgrade to take advantage of these included bug fixes and improvements prior to upgrading to the newer 2.1 LTM release series, to ensure the best upgrade experience. Please note that 1.10 will be end-of-life in November 2023, and we encourage all users to migrate to 2.1 (or later) by then. *** Apache Accumulo® is a sorted, distributed key/value store that provides robust, scalable data storage and retrieval. With Apache Accumulo, users can store and manage large data sets across a cluster. Accumulo uses Apache Hadoop's HDFS to store its data and Apache ZooKeeper for consensus. This version is now available in Maven Central, and at: https://accumulo.apache.org/downloads/ The full release notes can be viewed at: https://accumulo.apache.org/release/accumulo-1.10.3/
