P.S. the version of Maven that got installed in the mentioned VM (Debian
Bookworm) was 3.8.7. I wonder if your Maven is too /new/ to be
compatible with the MapR repo? I'm just throwing out guesses now.
On 2024/06/07 08:51, James Turton wrote:
You could create a clean "build box"? I just created an new VM in GCP,
downloaded apache-drill-1.21.2-src.tar.gz, built it and then ran it
this way. The MapR artifacts were pulled without trouble.
Something related to checksum verification is whacky in your local
Maven config but I'm out of ideas for tracking that down and I think
we can resolve that independently of the RC...
On 2024/06/06 19:57, Charles Givre wrote:
Hey James,
How’s it going? I may have lost the email, but what are next steps
for this. In its current state, I’d have to vote -1 because I can’t
build it.
However, I did try the workaround of setting the checksum to `warn`
and was able to build Drill from source. How would you like to proceed?
Best,
— C
On May 27, 2024, at 2:18 AM, James Turton <dz...@apache.org> wrote:
Yes, I didn't backport its removal because that would amount to
dropping features from the stable branch. I guess the idea would be
that 1.21.x, however long we keep it going, becomes the last series
that users who need these plugins can can still have them in
official releases while continuing to receiving bug fixes...
On 2024/05/27 04:10, Charles Givre wrote:
Hey James,
One more thing, I noticed that for 1.21.2, MapR is still being
included in the build list. (See below). I did a search and
couldn't seem to find where/why this is happening. I did confirm
that this isn’t happening on the current master.
Best,
— C
(base) ➜ apache-drill-1.21.2-src mvn clean install -DskipTests
[INFO] Scanning for projects...
[INFO]
------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO]
------------------------------------------------------------------------
[INFO] os.detected.name: osx
[INFO] os.detected.arch: aarch_64
[INFO] os.detected.version: 14.5
[INFO] os.detected.version.major: 14
[INFO] os.detected.version.minor: 5
[INFO] os.detected.classifier: osx-aarch_64
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Drill : [pom]
[INFO] Drill : Tools
: [pom]
[INFO] Drill : Tools : Freemarker codegen
[maven-plugin]
[INFO] Drill : Protocol [jar]
[INFO] Drill : Common [jar]
[INFO] Drill : Logical
Plan [jar]
[INFO] Drill : Exec
: [pom]
[INFO] Drill : Exec : Memory
: [pom]
[INFO] Drill : Exec : Memory :
Base [jar]
[INFO] Drill : Exec :
RPC [jar]
[INFO] Drill : Exec :
Vectors [jar]
[INFO] Drill : Contrib
: [pom]
[INFO] Drill : Contrib : Data
: [pom]
[INFO] Drill : Contrib : Data : TPCH
Sample [jar]
[INFO] Drill : Metastore
: [pom]
[INFO] Drill : Metastore :
API [jar]
[INFO] Drill : Metastore :
Iceberg [jar]
[INFO] Drill : Exec : Java Execution
Engine [jar]
[INFO] Drill : Exec : JDBC Driver using
dependencies [jar]
[INFO] Drill : Exec : JDBC JAR with all
dependencies [jar]
[INFO] Drill : On-YARN [jar]
[INFO] Drill : Metastore :
RDBMS [jar]
[INFO] Drill : Metastore :
Mongo [jar]
[INFO] Drill : Contrib : Storage :
Kudu [jar]
[INFO] Drill : Contrib : Format :
XML [jar]
[INFO] Drill : Contrib : Storage :
HTTP [jar]
[INFO] Drill : Contrib : Storage :
OpenTSDB [jar]
[INFO] Drill : Contrib : Storage :
MongoDB [jar]
[INFO] Drill : Contrib : Storage :
HBase [jar]
[INFO] Drill : Contrib : Storage :
JDBC [jar]
[INFO] Drill : Contrib : Storage : Hive
: [pom]
[INFO] Drill : Contrib : Storage : Hive : Exec
Shaded [jar]
[INFO] Drill : Contrib : Storage : Hive :
Core [jar]
[INFO] Drill : Contrib : Storage :
Kafka [jar]
[INFO] Drill : Contrib : Storage :
Cassandra [jar]
[INFO] Drill : Contrib : Storage :
ElasticSearch [jar]
[INFO] Drill : Contrib : Storage :
Splunk [jar]
[INFO] Drill : Contrib : Storage :
GoogleSheets [jar]
[INFO] Drill : Contrib : Storage :
Phoenix [jar]
[INFO] Drill : Contrib :
UDFs [jar]
[INFO] Drill : Contrib : Format :
Syslog [jar]
[INFO] Drill : Contrib : Format : Httpd/Nginx Access
Log [jar]
[INFO] Drill : Contrib : Format :
PDF [jar]
[INFO] Drill : Contrib : Format :
HDF5 [jar]
[INFO] Drill : Contrib : Format :
SPSS [jar]
[INFO] Drill : Contrib : Format :
SAS [jar]
[INFO] Drill : Contrib : Format :
LTSV [jar]
[INFO] Drill : Contrib : Format :
Image [jar]
[INFO] Drill : Contrib : Format :
Pcap-NG [jar]
[INFO] Drill : Contrib : Format :
Esri [jar]
[INFO] Drill : Contrib : Format :
Excel [jar]
[INFO] Drill : Contrib : Format : MS
Access [jar]
[INFO] Drill : Contrib : Format : Log
Regex [jar]
[INFO] Drill : Contrib : Storage :
Druid [jar]
[INFO] Drill : Contrib : Format :
Iceberg [jar]
[INFO] Drill : Contrib : Format : Delta
Lake [jar]
[INFO] Drill : Contrib : Storage :
Drill [jar]
[INFO] Drill : Packaging and Distribution
Assembly [pom]
[INFO] Drill : Contrib : Format :
MaprDB [jar]
On May 24, 2024, at 11:01 AM, Charles Givre <cgi...@gmail.com> wrote:
No go unfortunately. I deleted the mapr cache in my ~/.m2
directory. Same error. I’m using maven version 3.9.6.
Any other suggestions?
Best,
— C
On May 23, 2024, at 11:53 PM, James Turton <dz...@apache.org> wrote:
Interesting. I didn't want to drop a feature from the stable
branch so the MapR stuff is still in 1.21, while gone from
master. To try to reproduce the problem I ran rm -rf
~/.local/share/m2/repository/com/mapr locally but could still
build Drill, and the CI also didn't have any trouble[2].
I can see that the 107d... digest is returned in an HTTP ETag
header for the mapr-release artifact by repository.mapr.com, but
also that the digest 6cfb... is stored as
mapr-release-6.1.0-mapr.pom.sha1 in the MapR repo[1]. I can only
guess that your local build is comparing two incompatible digests
for some reason so
* did you build in an IDE that might have some Maven configuration
of its own and
* have you tried an equivalent of rm -rf
~/.local/share/m2/repository/com/mapr; mvn install -DskipTests?
1.
https://repository.mapr.com/nexus/content/groups/mapr-public/com/mapr/mapr-release/6.1.0-mapr/
2. https://github.com/apache/drill/actions/runs/9132581568
On 2024/05/23 15:38, Charles Givre wrote:
Hi James,
Upon further research, it would seem that we already did this in
DRILL-8454. Was this included in RC1?
Best,
— C
<2825.png>
DRILL-8454: Disable unsupported MapR profile and plugin by
jnturton · Pull Request #2825 · apache/drill
<https://github.com/apache/drill/pull/2825>
github.com <http://github.com/>
<https://github.com/apache/drill/pull/2825>
<https://github.com/apache/drill/pull/2825>
On May 23, 2024, at 9:23 AM, Charles Givre <cgi...@gmail.com>
wrote:
Hi James,
I attempted to build RC1 from source and ran into an error:
[ERROR] Failed to execute goal on project drill-format-mapr:
Could not resolve dependencies for project
org.apache.drill.contrib:drill-format-mapr:jar:1.21.2: Failed
to collect dependencies at
com.mapr.hadoop:maprfs:jar:6.1.0-mapr: Failed to read artifact
descriptor for com.mapr.hadoop:maprfs:jar:6.1.0-mapr: The
following artifacts could not be resolved:
com.mapr:mapr-release:pom:6.1.0-mapr (absent): Could not
transfer artifact com.mapr:mapr-release:pom:6.1.0-mapr from/to
mapr-releases (https://repository.mapr.com/maven/): Checksum
validation failed, expected
'107daa44a0b4a2c6dc1c28aa3546f288487def66' (REMOTE_INCLUDED)
but is actually '6cfb3d48635ec74fcdf36c35c4bb945fd32cf3a8' ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven
with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug
logging.
[ERROR]
[ERROR] For more information about the errors and possible
solutions, please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build
with the command
[ERROR] mvn <args> -rf :drill-format-mapr
I don’t really know the cause of this, but I’m guessing that it
can’t find some MapR dependency. I think there’s a point where
we might want to remove the MapR code from the contrib folder.
What do you think?
Best,
— C
On May 19, 2024, at 5:42 AM, James Turton <dz...@apache.org>
wrote:
Tested
* web UI
* htpasswd authn
* JDBC over SSL
* JSON query
* Parquet query
* sys.version query
* PostgreSQL query.
Vote: +1.
On 2024/05/17 20:22, James Turton wrote:
Hi all
I'd like to propose the second release candidate (RC1) of
Apache Drill, version 1.21.2.
The release candidate covers a total of 44 resolved Jira
issues [1]. Thanks to everyone who contributed to this release.
The tarball artefacts are hosted at [2] and the Maven
artefacts are hosted at [3].
This release candidate is based on
6b6a90fb6a03576d8d2b6a1858f72fb01b86d877 located at [4].
CI runs for the release candidate are viewable at [5].
[ ] +1
[ ] +0
[ ] -1
[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12353550
[2] https://dist.apache.org/repos/dist/dev/drill/1.21.2-rc1/
[3]
https://repository.apache.org/content/repositories/orgapachedrill-1109/
[4] https://github.com/jnturton/drill/commits/drill-1.21.2
[5] https://github.com/apache/drill/actions/runs/9132581568
