Hi Jinfeng,
Interestingly last time this test failed was for You - on March
2nd, 2017 (see below; on a local cluster node)
The conclusion then was that this was one of
permission/configuration/timing issues. Possibly same this time ?
Boaz
=-=-=-=-=-=-=-= 3 / 2 / 2017 Jinfeng Ni <j...@mapr.com> =-=-=-=-=-=-=
Also, I'm seeing intermittent failures in unit test
TestInBoundImpersonation. Seems to me the failure is caused by the
permission of view file.
The failure for that testcase seems to be on node 104.58, but not on
104.57. Is there something configured different on 104.58 node?
177,095B comp, 1 paTests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
18.181 sec <<< FAILURE! - in
org.apache.drill.exec.impersonation.TestInboundImpersonation
selectChainedView(org.apache.drill.exec.impersonation.TestInboundImpersonation) Time
elapsed: 0.182 sec <<< ERROR!
java.lang.Exception: org.apache.drill.common.exceptions.UserRemoteException:
PERMISSION ERROR: Not authorized to read view [u0_lineitem] in schema
[miniDfsPlugin.user0_1]
On 8/3/18 2:52 PM, Jinfeng Ni wrote:
I keep seeing multiple unit test failures in TestImpersonationMetadata. If
I run the test case individually, still hit the error.
I notice those testcases are marked as "SlowTest", "SecurityTest". Did
people have a way to skip those tests, or those failures are probably
caused by environment setting?
05:44:32.626 [main] ERROR org.apache.drill.TestReporter - Test Failed (d:
16.0 KiB(1.0 MiB), h: 19.4 MiB(424.3 MiB), nh: 726.3 KiB(86.3 MiB)):
testShowFilesInWSWithOtherPermissionsForQueryUser(org.apache.drill.exec.impersonation.TestImpersonationMetadata)
org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR:
Invalid FROM/IN clause [miniDfsPlugin.drillTestGrp0_755]
Results :
Tests in error:
TestImpersonationMetadata.testShowFilesInWSWithOtherPermissionsForQueryUser
» UserRemote
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0
On Fri, Aug 3, 2018 at 2:22 PM, Karthikeyan Manivannan <kmanivan...@mapr.com
wrote:
Built drill from src tarball, on Linux.
Ran unit tests on Linux - 3 tests (in TestSimpleExternalSort) timed-out but
I guess it is because of my setup, since no one else is seeing them.
Ran some queries with different batch-size limits and verified the output
batch-sizes via the logs.
Downloaded the binary onto my Mac and ran some simple queries on
employee.json
+1
Thanks
Karthik
On Fri, Aug 3, 2018 at 1:48 PM, Abhishek Girish <agir...@apache.org>
wrote:
+1 (non-binding)
- Ran unit tests - for both default and mapr profiles
- Deployed Drill built with mapr profile on a multi-node cluster
- Ran Functional and Advanced tests from [5]. These include thousands of
regression tests, which cover the most commonly used features of Drill.
- Basic Web UI and Sqlline tests
[5] https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_mapr_drill-2Dtest-2Dframework&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=
HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8&m=HG9OS_
a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=P9wWtN0JnfHarV-
QKH3GrBIQ-BncSoQtoZ9I0NzP2C8&e=
On Fri, Aug 3, 2018 at 1:27 PM Parth Chandra <par...@apache.org> wrote:
+1
Checked signature, binary and source tarball. (signature is good).
Checked sha512, binary and source tarball. (matches).
Compiled from source.
Built sample application with maven artifacts. (app does nothing, just
checking the artifacts are published correctly).
Ran some interesting sql test queries (especially ones with
lateral-unnest).
Seeing some unexpected failures in JDBC and Kafka unit tests. Not sure
if
these are environment related. Since others are able to run these
tests,
I'm ignoring these failures.
All else looks good.
On Fri, Aug 3, 2018 at 11:56 AM, Sorabh Hamirwasia <
shamirwa...@mapr.com
wrote:
Thanks for verifying Abhishek. I marked mongo tests as platform
dependent
failure and looks like no-one else is seeing it.
Also for the regression on secure cluster I have opened a JIRA:
DRILL-6663
<https://urldefense.proofpoint.com/v2/url?u=https-
3A__issues.apache.org_jira_browse_DRILL-2D6663&d=DwIBaQ&
c=cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8&
m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=3MDobpWejF_
GsXBTzdscRYC1mQ8azBEyiK_7ClHj-9Q&e=> with details. There
are
2 cases on secure cluster (with only auth enabled and without https)
for
shutdown request:
- When WebUI is accessed using IP address (for which JIRA is
opened)
- WebUI is accessed using the hostname - This case is working fine
and
it was due to missing /etc/hosts file entry on the setup. Thanks
to
Kunal/Abhishek for pointing it out.
Given one case is working, the impact for this issue is very low. I
change
my vote to +1.
Thanks,
Sorabh
On Fri, Aug 3, 2018 at 10:48 AM, Abhishek Girish <agir...@apache.org
wrote:
@Sorabh, the Kafka unit test failures I observed were on Linux - so
it
doesn't seem to be platform specific.
On Fri, Aug 3, 2018 at 9:42 AM Aman Sinha <amansi...@apache.org>
wrote:
- Downloaded the source tarball from [2] on my Linux VM, built
and
ran
the
unit tests. 2 tests in 'TestUtf8SupportInQueryString' had errors
but
passed when run independently.
- Downloaded the binary tarball from [2] onto my Macbook,
untarred
and
ran
Drill in embedded mode
- Ran a few queries against a TPC-DS SF1 data set
- Examined the run-time query profiles of these queries with and
without
parallelism.
- Checked the maven artifacts on [3].
- Checked the KEYS, README files
LGTM. +1 (binding)
PS: Regarding the regression reported by Sorabh, I presume this
is
not
tested through automated tests. I cannot say what's the net
impact
of
that
issue on user base
but given the 230+ JIRAs fixed in this release, I think the RC
is
pretty
strong.
On Thu, Aug 2, 2018 at 11:20 PM Sorabh Hamirwasia <
shamirwa...@mapr.com>
wrote:
Downloaded source from [4] and built and ran unit tests on
linux
and
mac
environment.
- KafkaFilterPushdownTest is failing on mac environment and
passing
on
linux. Same as DRILL-6625
- MongoDB storage plugin unit tests is failing on linux but
passing
on
mac for me. [Platform dependent failure]
- Is anyone else observing this ?
Downloaded tarball from [2] and installed Drillbit in
distributed
mode.
1. Tested graceful shutdown feature and it's not working
when
auth
or
https is enabled. [Regression]
- Verified that it's working on 1.13.0 branch
2. Tested Kerberos and Plain mechanism with and without SASL
encryption
enabled [Pass]
- Used sqlline for java client and querysubmitter to test
for
c++
client.
3. Tested SSL encryption with and without cert/hostname
verification
with a generated certificate. [Pass]
- Used sqlline for java client and querysubmitter to test
for
c++
client.
Based on above regression my vote is -1.
Thanks,
Sorabh
On Thu, Aug 2, 2018 at 9:53 PM, Abhishek Girish <
agir...@apache.org>
wrote:
I am observing unit test failures in Kafka module - looks
identical
to
DRILL-6625
<https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=Ko27MHJAQk1GvKhvs7Zr-1_rUjsgTJY3jfE1t2l5urY&e=.
proofpoint.com/v2/url?u=https-
3A__issues.apache.org_jira_browse_DRILL-2D6625&d=DwIBaQ&
c=cskdkSMqhcnjZxdQVpwTXg&r=gRpEl0WzXE3EMrwj0KFbZXGXRyadOt
hF2jlYxvhTlQg&m=
VuCGvvHXP9kHQJIVtwWDuQF-Cn_kaf83TqGGATU78y4&s=iuhik-
LIdAD80y6KgoiOvS1TnLPw9YtWaW7YNN5UH6c&e=> - but only
intermittently (had multiple runs, but only one failed so
far).
Is
this
something to be investigated for the release?
On Thu, Aug 2, 2018 at 2:10 AM Volodymyr Vysotskyi <
volody...@apache.org
wrote:
- Downloaded source archive at [2], built and ran unit
tests,
no issues were found.
- Downloaded built archive at [2], ran Drill in embedded
mode,
created and queried views, submitted several TPC-DS queries
from
UI
on
sf1
data,
checked that profiles are displayed correctly.
- Connected from SQuirrel to Drill in embedded mode using
drill-jdbc-driver
from a built archive, ran several queries; ran queries
from a
java
application,
no issues were found.
- Connected directly to drillbit on the cluster using
drill-jdbc-driver
built with mapr profile,
submitted several queries.
Have a problem with connecting to Drill on the cluster
using
zookeeper,
but
looks like this is a config issue.
+1 (non-binding)
Kind regards,
Volodymyr Vysotskyi
On Thu, Aug 2, 2018 at 9:04 AM Khurram Faraaz <
kfar...@mapr.com>
wrote:
- Downloaded tarballs and deployed binaries on 4 node
cluster.
- Executed basic SQL queries from sqlline and from Web
UI.
- Verified features on the Web UI.
Looks good.
+1 (non-binding)
On Wed, Aug 1, 2018 at 9:55 PM, Kunal Khatua <
ku...@apache.org
wrote:
Built from source and tried the binaries.
Tested spill-to-disk behavior, a couple of concurrent
queries
and
general
UX checks. LGTM.
+1 (non-binding)
On 8/1/2018 4:58:08 PM, Boaz Ben-Zvi <b...@apache.org>
wrote:
Thanks Vlad for bringing these two points to our
attention.
Therefore the vote on RC3 should be open till Friday,
August
3rd,
at
6
PM PDT.
And we should (sans any new issue) get enough PMC +1
votes
on
RC3
by
Friday.
Thanks,
Boaz
On 8/1/18 8:40 AM, Vlad Rozov wrote:
Apache release votes should be open for at least 72
hours
[1]
and
every
new RC requires that PMC "Before voting +1 PMC members
are
required
to
download the signed source code package, compile it as
provided,
and
test
the resulting executable on their own platform, along
with
also
verifying
that the package meets the requirements of the ASF
policy
on
releases".
Thank you,
Vlad
[1]https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.apache.org_legal_release-2Dpolicy.html&d=
DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meG
OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD
YE6dlKvw&s=
GuxbeqAnbOHCDsEpaMRlPd4ursbQfyIQl5wPywp0V2g&e=
On 2018/07/31 22:09:04, Boaz Ben-Zvi wrote:
Hi RC reviewers and testers,
There are a couple of RC2 minor issues that are
flagged
as
errors
in the IDE ( in Eclipse, and may be in IntelliJ ).
See
DRILL-6650
and
DRILL-6651 for detail.
These two do *not* matter for the Maven build, or
for
testing
the
tarballs, etc. So if you started a long testing
cycle
with
RC2,
you
may
continue.
I will produce a new RC3 soon to include the fixes
for
the
above.
(Note
that this RC3 would be *force-pushed* into branch
1.14.0 ,
thus
erasing
the RC2 commit ID)
And if no one objects, the voting deadline would
remain
as
is
(Aug
2nd)
as the differences have a very minor impact.
Thanks,
Boaz
On 7/30/18 3:57 PM, Boaz Ben-Zvi wrote:
Hi Drillers,
Proposing the *third* Release Candidate (RC2) for
the
Apache
Drill,
version 1.14.0 .
This RC2 includes 235 committed Jiras [1]. Thanks
to
all
the
Drill
developers who works hard and contributed to this
release.
The RC2 tarballs are hosted at [2] , and the Maven
artifacts
are
at
[3].
This Release Candidate is based on (Apache Drill
branch
named
"1.14.0") commit ID:
4da8aff88966adee5d7438024a826bb599450a6f ,
available at [4].
Please download and try/test this Release
Candidate.
Given that our bylaws require 3 business days, the
vote
would
end
on
Thursday, August 2nd, 2018 at 5:00 PM PDT .
[ ] +1
[ ] +0
[ ] -1
My vote is +1 !!
Thank you,
Boaz
[1]
https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=GNXE_QQ1NJuSSdlX9HZiEGYanTnoqZc5ikPDo_H2FFc&e=.
com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8&
m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=
DrdAWdvHVkavIhX4eE721vE2-
nCpbe8uO3KRMz3DbX4&e=.
com/v2/url?u=https-3A__issues.
apache.org_jira_secure_ReleaseNote.jspa-3FprojectId-
3D12313820-26version-
3D12342097&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=7cmJ-
j2LSiMs7xMoaBk4MmgV24HxaR5LzmDYE6dlKvw&s=
wPpmkjpk5reuOsI2Zhwg0-9vvYAQb_
bWrhoJmkw4Bbc&e=
[2]https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=Ko27MHJAQk1GvKhvs7Zr-1_rUjsgTJY3jfE1t2l5urY&e=.
proofpoint.com/v2/url?u=http-
3A__home.apache.org_-7Eboaz_drill_releases_1.14.0_rc2_&d=
DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meG
OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD
YE6dlKvw&s=dINsXomnONCGf0t39_
J5VB1_T16dqj7yq34sNyU72_M&e=
[3]
https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=GNXE_QQ1NJuSSdlX9HZiEGYanTnoqZc5ikPDo_H2FFc&e=.
com/v2/url?u=https-3A__
repository.apache.org_content_
repositories_orgapachedrill-
2D1050&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meG
OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD
YE6dlKvw&s=K2ffEjpPckQ9-7YybbeHm_ClMS-F7K9pv_
N4xbAhs4E&e=
[4]https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=Ko27MHJAQk1GvKhvs7Zr-1_rUjsgTJY3jfE1t2l5urY&e=.
proofpoint.com/v2/url?u=https-
3A__github.com_apache_drill_tree_1.14.0&d=DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meG
OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD
YE6dlKvw&s=
x4FT03yAXZOcnqY0kI1vmRJmuGa25ZGVhKVKjXH2ML4&e=
OR
https://urldefense.proofpoint.com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIFaQ&c=cskdkSMqhcnjZxdQVpwTXg&r=PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=Q3RFKMgFN1M5KwN5HB05B7Lr2Mp4W3Rf7PUflzDvJuw&s=GNXE_QQ1NJuSSdlX9HZiEGYanTnoqZc5ikPDo_H2FFc&e=.
com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8&
m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=
DrdAWdvHVkavIhX4eE721vE2-
nCpbe8uO3KRMz3DbX4&e=.
com/v2/url?u=https-3A__github.
com_Ben-2DZvi_drill_tree_drill-2D1.14.0&d=DwIBaQ&c=
cskdkSMqhcnjZxdQVpwTXg&r=
PqKay2uOMZUqopDRKNfBtZSlsp2meG
OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD
YE6dlKvw&s=
aGU2JYBo3RzIdTX6yNrVzyoqz9evUi9smRYMs2YfG2A&e=
