Hi all! I tested:
* a local building on maven 3.6.3 and 3.9.7, * web UI * parquet query * checked dependencies versions to match the release notes * sqlline Everything looks good except for the following warning message on connection through sqlline. Was it there before? It's not critical, but may be annoying. My vote: +1 apache drill> !connect jdbc:drill:drillbit=localhost; WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by javassist.util.proxy.SecurityActions (file:/home/rymarm/sandbox/test-drill-rc/apache-drill-1.21.2/jars/3rdparty/javassist-3.28.0-GA.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain) WARNING: Please consider reporting this to the maintainers of javassist.util.proxy.SecurityActions WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release apache drill> Regards, Maksym Rymar ________________________________ Від: James Turton <dz...@apache.org> Надіслано: 7 червня 2024 р. 9:53 Кому: dev@drill.apache.org <dev@drill.apache.org>; Charles Givre <cgi...@gmail.com> Тема: Re: [VOTE] Release Apache Drill 1.21.2 - RC1 P.S. the version of Maven that got installed in the mentioned VM (Debian Bookworm) was 3.8.7. I wonder if your Maven is too /new/ to be compatible with the MapR repo? I'm just throwing out guesses now. On 2024/06/07 08:51, James Turton wrote: > You could create a clean "build box"? I just created an new VM in GCP, > downloaded apache-drill-1.21.2-src.tar.gz, built it and then ran it > this way. The MapR artifacts were pulled without trouble. > > Something related to checksum verification is whacky in your local > Maven config but I'm out of ideas for tracking that down and I think > we can resolve that independently of the RC... > > On 2024/06/06 19:57, Charles Givre wrote: >> Hey James, >> How’s it going? I may have lost the email, but what are next steps >> for this. In its current state, I’d have to vote -1 because I can’t >> build it. >> However, I did try the workaround of setting the checksum to `warn` >> and was able to build Drill from source. How would you like to proceed? >> Best, >> — C >> >> >>> On May 27, 2024, at 2:18 AM, James Turton <dz...@apache.org> wrote: >>> >>> Yes, I didn't backport its removal because that would amount to >>> dropping features from the stable branch. I guess the idea would be >>> that 1.21.x, however long we keep it going, becomes the last series >>> that users who need these plugins can can still have them in >>> official releases while continuing to receiving bug fixes... >>> >>> On 2024/05/27 04:10, Charles Givre wrote: >>>> Hey James, >>>> One more thing, I noticed that for 1.21.2, MapR is still being >>>> included in the build list. (See below). I did a search and >>>> couldn't seem to find where/why this is happening. I did confirm >>>> that this isn’t happening on the current master. >>>> Best, >>>> — C >>>> (base) ➜ apache-drill-1.21.2-src mvn clean install -DskipTests >>>> [INFO] Scanning for projects... >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> >>>> [INFO] Detecting the operating system and CPU architecture >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> >>>> [INFO] os.detected.name: osx >>>> [INFO] os.detected.arch: aarch_64 >>>> [INFO] os.detected.version: 14.5 >>>> [INFO] os.detected.version.major: 14 >>>> [INFO] os.detected.version.minor: 5 >>>> [INFO] os.detected.classifier: osx-aarch_64 >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> >>>> [INFO] Reactor Build Order: >>>> [INFO] >>>> [INFO] Drill : [pom] >>>> [INFO] Drill : Tools >>>> : [pom] >>>> [INFO] Drill : Tools : Freemarker codegen >>>> [maven-plugin] >>>> [INFO] Drill : Protocol [jar] >>>> [INFO] Drill : Common [jar] >>>> [INFO] Drill : Logical >>>> Plan [jar] >>>> [INFO] Drill : Exec >>>> : [pom] >>>> [INFO] Drill : Exec : Memory >>>> : [pom] >>>> [INFO] Drill : Exec : Memory : >>>> Base [jar] >>>> [INFO] Drill : Exec : >>>> RPC [jar] >>>> [INFO] Drill : Exec : >>>> Vectors [jar] >>>> [INFO] Drill : Contrib >>>> : [pom] >>>> [INFO] Drill : Contrib : Data >>>> : [pom] >>>> [INFO] Drill : Contrib : Data : TPCH >>>> Sample [jar] >>>> [INFO] Drill : Metastore >>>> : [pom] >>>> [INFO] Drill : Metastore : >>>> API [jar] >>>> [INFO] Drill : Metastore : >>>> Iceberg [jar] >>>> [INFO] Drill : Exec : Java Execution >>>> Engine [jar] >>>> [INFO] Drill : Exec : JDBC Driver using >>>> dependencies [jar] >>>> [INFO] Drill : Exec : JDBC JAR with all >>>> dependencies [jar] >>>> [INFO] Drill : On-YARN [jar] >>>> [INFO] Drill : Metastore : >>>> RDBMS [jar] >>>> [INFO] Drill : Metastore : >>>> Mongo [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Kudu [jar] >>>> [INFO] Drill : Contrib : Format : >>>> XML [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> HTTP [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> OpenTSDB [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> MongoDB [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> HBase [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> JDBC [jar] >>>> [INFO] Drill : Contrib : Storage : Hive >>>> : [pom] >>>> [INFO] Drill : Contrib : Storage : Hive : Exec >>>> Shaded [jar] >>>> [INFO] Drill : Contrib : Storage : Hive : >>>> Core [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Kafka [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Cassandra [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> ElasticSearch [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Splunk [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> GoogleSheets [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Phoenix [jar] >>>> [INFO] Drill : Contrib : >>>> UDFs [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Syslog [jar] >>>> [INFO] Drill : Contrib : Format : Httpd/Nginx Access >>>> Log [jar] >>>> [INFO] Drill : Contrib : Format : >>>> PDF [jar] >>>> [INFO] Drill : Contrib : Format : >>>> HDF5 [jar] >>>> [INFO] Drill : Contrib : Format : >>>> SPSS [jar] >>>> [INFO] Drill : Contrib : Format : >>>> SAS [jar] >>>> [INFO] Drill : Contrib : Format : >>>> LTSV [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Image [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Pcap-NG [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Esri [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Excel [jar] >>>> [INFO] Drill : Contrib : Format : MS >>>> Access [jar] >>>> [INFO] Drill : Contrib : Format : Log >>>> Regex [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Druid [jar] >>>> [INFO] Drill : Contrib : Format : >>>> Iceberg [jar] >>>> [INFO] Drill : Contrib : Format : Delta >>>> Lake [jar] >>>> [INFO] Drill : Contrib : Storage : >>>> Drill [jar] >>>> [INFO] Drill : Packaging and Distribution >>>> Assembly [pom] >>>> [INFO] Drill : Contrib : Format : >>>> MaprDB [jar] >>>>> On May 24, 2024, at 11:01 AM, Charles Givre <cgi...@gmail.com> wrote: >>>>> >>>>> No go unfortunately. I deleted the mapr cache in my ~/.m2 >>>>> directory. Same error. I’m using maven version 3.9.6. >>>>> >>>>> Any other suggestions? >>>>> Best, >>>>> — C >>>>> >>>>> >>>>>> On May 23, 2024, at 11:53 PM, James Turton <dz...@apache.org> wrote: >>>>>> >>>>>> Interesting. I didn't want to drop a feature from the stable >>>>>> branch so the MapR stuff is still in 1.21, while gone from >>>>>> master. To try to reproduce the problem I ran rm -rf >>>>>> ~/.local/share/m2/repository/com/mapr locally but could still >>>>>> build Drill, and the CI also didn't have any trouble[2]. >>>>>> >>>>>> I can see that the 107d... digest is returned in an HTTP ETag >>>>>> header for the mapr-release artifact by repository.mapr.com, but >>>>>> also that the digest 6cfb... is stored as >>>>>> mapr-release-6.1.0-mapr.pom.sha1 in the MapR repo[1]. I can only >>>>>> guess that your local build is comparing two incompatible digests >>>>>> for some reason so >>>>>> >>>>>> * did you build in an IDE that might have some Maven configuration >>>>>> of its own and >>>>>> * have you tried an equivalent of rm -rf >>>>>> ~/.local/share/m2/repository/com/mapr; mvn install -DskipTests? >>>>>> >>>>>> >>>>>> 1. >>>>>> https://repository.mapr.com/nexus/content/groups/mapr-public/com/mapr/mapr-release/6.1.0-mapr/ >>>>>> 2. https://github.com/apache/drill/actions/runs/9132581568 >>>>>> >>>>>> >>>>>> On 2024/05/23 15:38, Charles Givre wrote: >>>>>>> Hi James, >>>>>>> Upon further research, it would seem that we already did this in >>>>>>> DRILL-8454. Was this included in RC1? >>>>>>> Best, >>>>>>> — C >>>>>>> >>>>>>> <2825.png> >>>>>>> DRILL-8454: Disable unsupported MapR profile and plugin by >>>>>>> jnturton · Pull Request #2825 · apache/drill >>>>>>> <https://github.com/apache/drill/pull/2825> >>>>>>> github.com <http://github.com/> >>>>>>> <https://github.com/apache/drill/pull/2825> >>>>>>> >>>>>>> <https://github.com/apache/drill/pull/2825> >>>>>>> >>>>>>> >>>>>>> >>>>>>>> On May 23, 2024, at 9:23 AM, Charles Givre <cgi...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>> Hi James, >>>>>>>> I attempted to build RC1 from source and ran into an error: >>>>>>>> >>>>>>>> [ERROR] Failed to execute goal on project drill-format-mapr: >>>>>>>> Could not resolve dependencies for project >>>>>>>> org.apache.drill.contrib:drill-format-mapr:jar:1.21.2: Failed >>>>>>>> to collect dependencies at >>>>>>>> com.mapr.hadoop:maprfs:jar:6.1.0-mapr: Failed to read artifact >>>>>>>> descriptor for com.mapr.hadoop:maprfs:jar:6.1.0-mapr: The >>>>>>>> following artifacts could not be resolved: >>>>>>>> com.mapr:mapr-release:pom:6.1.0-mapr (absent): Could not >>>>>>>> transfer artifact com.mapr:mapr-release:pom:6.1.0-mapr from/to >>>>>>>> mapr-releases (https://repository.mapr.com/maven/ ): Checksum >>>>>>>> validation failed, expected >>>>>>>> '107daa44a0b4a2c6dc1c28aa3546f288487def66' (REMOTE_INCLUDED) >>>>>>>> but is actually '6cfb3d48635ec74fcdf36c35c4bb945fd32cf3a8' -> >>>>>>>> [Help 1] >>>>>>>> [ERROR] >>>>>>>> [ERROR] To see the full stack trace of the errors, re-run Maven >>>>>>>> with the -e switch. >>>>>>>> [ERROR] Re-run Maven using the -X switch to enable full debug >>>>>>>> logging. >>>>>>>> [ERROR] >>>>>>>> [ERROR] For more information about the errors and possible >>>>>>>> solutions, please read the following articles: >>>>>>>> [ERROR] [Help 1] >>>>>>>> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException >>>>>>>> [ERROR] >>>>>>>> [ERROR] After correcting the problems, you can resume the build >>>>>>>> with the command >>>>>>>> [ERROR] mvn <args> -rf :drill-format-mapr >>>>>>>> >>>>>>>> I don’t really know the cause of this, but I’m guessing that it >>>>>>>> can’t find some MapR dependency. I think there’s a point where >>>>>>>> we might want to remove the MapR code from the contrib folder. >>>>>>>> What do you think? >>>>>>>> >>>>>>>> Best, >>>>>>>> — C >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>>> On May 19, 2024, at 5:42 AM, James Turton <dz...@apache.org> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>> Tested >>>>>>>>> >>>>>>>>> * web UI >>>>>>>>> * htpasswd authn >>>>>>>>> * JDBC over SSL >>>>>>>>> * JSON query >>>>>>>>> * Parquet query >>>>>>>>> * sys.version query >>>>>>>>> * PostgreSQL query. >>>>>>>>> >>>>>>>>> Vote: +1. >>>>>>>>> >>>>>>>>> On 2024/05/17 20:22, James Turton wrote: >>>>>>>>>> Hi all >>>>>>>>>> >>>>>>>>>> I'd like to propose the second release candidate (RC1) of >>>>>>>>>> Apache Drill, version 1.21.2. >>>>>>>>>> >>>>>>>>>> The release candidate covers a total of 44 resolved Jira >>>>>>>>>> issues [1]. Thanks to everyone who contributed to this release. >>>>>>>>>> >>>>>>>>>> The tarball artefacts are hosted at [2] and the Maven >>>>>>>>>> artefacts are hosted at [3]. >>>>>>>>>> >>>>>>>>>> This release candidate is based on >>>>>>>>>> 6b6a90fb6a03576d8d2b6a1858f72fb01b86d877 located at [4]. >>>>>>>>>> >>>>>>>>>> CI runs for the release candidate are viewable at [5]. >>>>>>>>>> >>>>>>>>>> [ ] +1 >>>>>>>>>> [ ] +0 >>>>>>>>>> [ ] -1 >>>>>>>>>> >>>>>>>>>> [1] >>>>>>>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12353550 >>>>>>>>>> [2] https://dist.apache.org/repos/dist/dev/drill/1.21.2-rc1/ >>>>>>>>>> [3] >>>>>>>>>> https://repository.apache.org/content/repositories/orgapachedrill-1109/ >>>>>>>>>> >>>>>>>>>> [4] https://github.com/jnturton/drill/commits/drill-1.21.2 >>>>>>>>>> [5] https://github.com/apache/drill/actions/runs/9132581568 >> >>
