I keep seeing multiple unit test failures in TestImpersonationMetadata. If I run the test case individually, still hit the error.
I notice those testcases are marked as "SlowTest", "SecurityTest". Did people have a way to skip those tests, or those failures are probably caused by environment setting? 05:44:32.626 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 16.0 KiB(1.0 MiB), h: 19.4 MiB(424.3 MiB), nh: 726.3 KiB(86.3 MiB)): testShowFilesInWSWithOtherPermissionsForQueryUser(org.apache.drill.exec.impersonation.TestImpersonationMetadata) org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR: Invalid FROM/IN clause [miniDfsPlugin.drillTestGrp0_755] Results : Tests in error: TestImpersonationMetadata.testShowFilesInWSWithOtherPermissionsForQueryUser ยป UserRemote Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 On Fri, Aug 3, 2018 at 2:22 PM, Karthikeyan Manivannan <[email protected] > wrote: > Built drill from src tarball, on Linux. > Ran unit tests on Linux - 3 tests (in TestSimpleExternalSort) timed-out but > I guess it is because of my setup, since no one else is seeing them. > Ran some queries with different batch-size limits and verified the output > batch-sizes via the logs. > > Downloaded the binary onto my Mac and ran some simple queries on > employee.json > > +1 > > Thanks > > Karthik > > On Fri, Aug 3, 2018 at 1:48 PM, Abhishek Girish <[email protected]> > wrote: > > > +1 (non-binding) > > > > - Ran unit tests - for both default and mapr profiles > > - Deployed Drill built with mapr profile on a multi-node cluster > > - Ran Functional and Advanced tests from [5]. These include thousands of > > regression tests, which cover the most commonly used features of Drill. > > - Basic Web UI and Sqlline tests > > > > > > [5] https://urldefense.proofpoint.com/v2/url?u=https-3A__github. > > com_mapr_drill-2Dtest-2Dframework&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r= > > HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8&m=HG9OS_ > > a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=P9wWtN0JnfHarV- > > QKH3GrBIQ-BncSoQtoZ9I0NzP2C8&e= > > > > On Fri, Aug 3, 2018 at 1:27 PM Parth Chandra <[email protected]> wrote: > > > > > +1 > > > > > > Checked signature, binary and source tarball. (signature is good). > > > Checked sha512, binary and source tarball. (matches). > > > Compiled from source. > > > Built sample application with maven artifacts. (app does nothing, just > > > checking the artifacts are published correctly). > > > Ran some interesting sql test queries (especially ones with > > > lateral-unnest). > > > Seeing some unexpected failures in JDBC and Kafka unit tests. Not sure > if > > > these are environment related. Since others are able to run these > tests, > > > I'm ignoring these failures. > > > All else looks good. > > > > > > > > > > > > > > > > > > > > > On Fri, Aug 3, 2018 at 11:56 AM, Sorabh Hamirwasia < > [email protected] > > > > > > wrote: > > > > > > > Thanks for verifying Abhishek. I marked mongo tests as platform > > dependent > > > > failure and looks like no-one else is seeing it. > > > > > > > > Also for the regression on secure cluster I have opened a JIRA: > > > DRILL-6663 > > > > <https://urldefense.proofpoint.com/v2/url?u=https- > > 3A__issues.apache.org_jira_browse_DRILL-2D6663&d=DwIBaQ& > > c=cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8& > > m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s=3MDobpWejF_ > > GsXBTzdscRYC1mQ8azBEyiK_7ClHj-9Q&e=> with details. There > > > are > > > > 2 cases on secure cluster (with only auth enabled and without https) > > for > > > > shutdown request: > > > > > > > > - When WebUI is accessed using IP address (for which JIRA is > opened) > > > > - WebUI is accessed using the hostname - This case is working fine > > and > > > > it was due to missing /etc/hosts file entry on the setup. Thanks > to > > > > Kunal/Abhishek for pointing it out. > > > > > > > > Given one case is working, the impact for this issue is very low. I > > > change > > > > my vote to +1. > > > > > > > > Thanks, > > > > Sorabh > > > > > > > > On Fri, Aug 3, 2018 at 10:48 AM, Abhishek Girish <[email protected] > > > > > > wrote: > > > > > > > > > @Sorabh, the Kafka unit test failures I observed were on Linux - so > > it > > > > > doesn't seem to be platform specific. > > > > > > > > > > On Fri, Aug 3, 2018 at 9:42 AM Aman Sinha <[email protected]> > > > wrote: > > > > > > > > > > > - Downloaded the source tarball from [2] on my Linux VM, built > and > > > ran > > > > > the > > > > > > unit tests. 2 tests in 'TestUtf8SupportInQueryString' had errors > > but > > > > > > passed when run independently. > > > > > > - Downloaded the binary tarball from [2] onto my Macbook, > untarred > > > and > > > > > ran > > > > > > Drill in embedded mode > > > > > > - Ran a few queries against a TPC-DS SF1 data set > > > > > > - Examined the run-time query profiles of these queries with and > > > > without > > > > > > parallelism. > > > > > > - Checked the maven artifacts on [3]. > > > > > > - Checked the KEYS, README files > > > > > > > > > > > > LGTM. +1 (binding) > > > > > > > > > > > > PS: Regarding the regression reported by Sorabh, I presume this > > is > > > > not > > > > > > tested through automated tests. I cannot say what's the net > impact > > > of > > > > > that > > > > > > issue on user base > > > > > > but given the 230+ JIRAs fixed in this release, I think the RC > is > > > > pretty > > > > > > strong. > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 2, 2018 at 11:20 PM Sorabh Hamirwasia < > > > > [email protected]> > > > > > > wrote: > > > > > > > > > > > > > Downloaded source from [4] and built and ran unit tests on > linux > > > and > > > > > mac > > > > > > > environment. > > > > > > > > > > > > > > - KafkaFilterPushdownTest is failing on mac environment and > > > > passing > > > > > on > > > > > > > linux. Same as DRILL-6625 > > > > > > > - MongoDB storage plugin unit tests is failing on linux but > > > > passing > > > > > on > > > > > > > mac for me. [Platform dependent failure] > > > > > > > - Is anyone else observing this ? > > > > > > > > > > > > > > Downloaded tarball from [2] and installed Drillbit in > > distributed > > > > > mode. > > > > > > > > > > > > > > 1. Tested graceful shutdown feature and it's not working > when > > > auth > > > > > or > > > > > > > https is enabled. [Regression] > > > > > > > - Verified that it's working on 1.13.0 branch > > > > > > > 2. Tested Kerberos and Plain mechanism with and without SASL > > > > > > encryption > > > > > > > enabled [Pass] > > > > > > > - Used sqlline for java client and querysubmitter to test > > for > > > > c++ > > > > > > > client. > > > > > > > 3. Tested SSL encryption with and without cert/hostname > > > > verification > > > > > > > with a generated certificate. [Pass] > > > > > > > - Used sqlline for java client and querysubmitter to test > > for > > > > c++ > > > > > > > client. > > > > > > > > > > > > > > > > > > > > > Based on above regression my vote is -1. > > > > > > > > > > > > > > Thanks, > > > > > > > Sorabh > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 2, 2018 at 9:53 PM, Abhishek Girish < > > > [email protected]> > > > > > > > wrote: > > > > > > > > > > > > > > > I am observing unit test failures in Kafka module - looks > > > identical > > > > > to > > > > > > > > DRILL-6625 <https://urldefense. > proofpoint.com/v2/url?u=https- > > > > > > > > 3A__issues.apache.org_jira_browse_DRILL-2D6625&d=DwIBaQ& > > > > > > > > > > > > > > c=cskdkSMqhcnjZxdQVpwTXg&r=gRpEl0WzXE3EMrwj0KFbZXGXRyadOt > > > > > hF2jlYxvhTlQg&m= > > > > > > > > VuCGvvHXP9kHQJIVtwWDuQF-Cn_kaf83TqGGATU78y4&s=iuhik- > > > > > > > > LIdAD80y6KgoiOvS1TnLPw9YtWaW7YNN5UH6c&e=> - but only > > > > > > > > intermittently (had multiple runs, but only one failed so > far). > > > Is > > > > > this > > > > > > > > something to be investigated for the release? > > > > > > > > > > > > > > > > On Thu, Aug 2, 2018 at 2:10 AM Volodymyr Vysotskyi < > > > > > > [email protected] > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > - Downloaded source archive at [2], built and ran unit > tests, > > > > > > > > > no issues were found. > > > > > > > > > - Downloaded built archive at [2], ran Drill in embedded > > mode, > > > > > > > > > created and queried views, submitted several TPC-DS queries > > > from > > > > UI > > > > > > on > > > > > > > > sf1 > > > > > > > > > data, > > > > > > > > > checked that profiles are displayed correctly. > > > > > > > > > - Connected from SQuirrel to Drill in embedded mode using > > > > > > > > drill-jdbc-driver > > > > > > > > > from a built archive, ran several queries; ran queries > from a > > > > java > > > > > > > > > application, > > > > > > > > > no issues were found. > > > > > > > > > - Connected directly to drillbit on the cluster using > > > > > > drill-jdbc-driver > > > > > > > > > built with mapr profile, > > > > > > > > > submitted several queries. > > > > > > > > > Have a problem with connecting to Drill on the cluster > using > > > > > > zookeeper, > > > > > > > > but > > > > > > > > > looks like this is a config issue. > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > Kind regards, > > > > > > > > > Volodymyr Vysotskyi > > > > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Aug 2, 2018 at 9:04 AM Khurram Faraaz < > > > [email protected]> > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > - Downloaded tarballs and deployed binaries on 4 node > > > cluster. > > > > > > > > > > - Executed basic SQL queries from sqlline and from Web > UI. > > > > > > > > > > - Verified features on the Web UI. > > > > > > > > > > > > > > > > > > > > Looks good. > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > > > On Wed, Aug 1, 2018 at 9:55 PM, Kunal Khatua < > > > [email protected] > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Built from source and tried the binaries. > > > > > > > > > > > > > > > > > > > > > > Tested spill-to-disk behavior, a couple of concurrent > > > queries > > > > > and > > > > > > > > > general > > > > > > > > > > > UX checks. LGTM. > > > > > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > On 8/1/2018 4:58:08 PM, Boaz Ben-Zvi <[email protected]> > > > > wrote: > > > > > > > > > > > Thanks Vlad for bringing these two points to our > > attention. > > > > > > > > > > > > > > > > > > > > > > Therefore the vote on RC3 should be open till Friday, > > > August > > > > > 3rd, > > > > > > > at > > > > > > > > 6 > > > > > > > > > > > PM PDT. > > > > > > > > > > > > > > > > > > > > > > And we should (sans any new issue) get enough PMC +1 > > votes > > > on > > > > > RC3 > > > > > > > by > > > > > > > > > > > Friday. > > > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > > > > > > > Boaz > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 8/1/18 8:40 AM, Vlad Rozov wrote: > > > > > > > > > > > > Apache release votes should be open for at least 72 > > hours > > > > [1] > > > > > > and > > > > > > > > > every > > > > > > > > > > > new RC requires that PMC "Before voting +1 PMC members > > are > > > > > > required > > > > > > > > to > > > > > > > > > > > download the signed source code package, compile it as > > > > > provided, > > > > > > > and > > > > > > > > > test > > > > > > > > > > > the resulting executable on their own platform, along > > with > > > > also > > > > > > > > > verifying > > > > > > > > > > > that the package meets the requirements of the ASF > policy > > > on > > > > > > > > releases". > > > > > > > > > > > > > > > > > > > > > > > > Thank you, > > > > > > > > > > > > > > > > > > > > > > > > Vlad > > > > > > > > > > > > > > > > > > > > > > > > [1]https://urldefense.proofpoint.com/v2/url?u=http- > > > > > > > > > > > 3A__www.apache.org_legal_release-2Dpolicy.html&d= > > DwIBaQ&c= > > > > > > > > > > > cskdkSMqhcnjZxdQVpwTXg&r= > PqKay2uOMZUqopDRKNfBtZSlsp2meG > > > > > > > > > > > OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD > > > > YE6dlKvw&s= > > > > > > > > > > > GuxbeqAnbOHCDsEpaMRlPd4ursbQfyIQl5wPywp0V2g&e= > > > > > > > > > > > > > > > > > > > > > > > > On 2018/07/31 22:09:04, Boaz Ben-Zvi wrote: > > > > > > > > > > > >> Hi RC reviewers and testers, > > > > > > > > > > > >> > > > > > > > > > > > >> There are a couple of RC2 minor issues that are > > flagged > > > as > > > > > > > errors > > > > > > > > > > > >> in the IDE ( in Eclipse, and may be in IntelliJ ). > See > > > > > > > DRILL-6650 > > > > > > > > > and > > > > > > > > > > > >> DRILL-6651 for detail. > > > > > > > > > > > >> > > > > > > > > > > > >> These two do *not* matter for the Maven build, or > for > > > > > testing > > > > > > > the > > > > > > > > > > > >> tarballs, etc. So if you started a long testing > cycle > > > with > > > > > > RC2, > > > > > > > > you > > > > > > > > > > may > > > > > > > > > > > >> continue. > > > > > > > > > > > >> > > > > > > > > > > > >> I will produce a new RC3 soon to include the fixes > for > > > the > > > > > > > above. > > > > > > > > > > (Note > > > > > > > > > > > >> that this RC3 would be *force-pushed* into branch > > > 1.14.0 , > > > > > > thus > > > > > > > > > > erasing > > > > > > > > > > > >> the RC2 commit ID) > > > > > > > > > > > >> And if no one objects, the voting deadline would > > remain > > > as > > > > > is > > > > > > > (Aug > > > > > > > > > > 2nd) > > > > > > > > > > > >> as the differences have a very minor impact. > > > > > > > > > > > >> > > > > > > > > > > > >> Thanks, > > > > > > > > > > > >> > > > > > > > > > > > >> Boaz > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> On 7/30/18 3:57 PM, Boaz Ben-Zvi wrote: > > > > > > > > > > > >>> Hi Drillers, > > > > > > > > > > > >>> > > > > > > > > > > > >>> Proposing the *third* Release Candidate (RC2) for > the > > > > > Apache > > > > > > > > Drill, > > > > > > > > > > > >>> version 1.14.0 . > > > > > > > > > > > >>> > > > > > > > > > > > >>> This RC2 includes 235 committed Jiras [1]. Thanks > to > > > all > > > > > the > > > > > > > > Drill > > > > > > > > > > > >>> developers who works hard and contributed to this > > > > release. > > > > > > > > > > > >>> > > > > > > > > > > > >>> The RC2 tarballs are hosted at [2] , and the Maven > > > > > artifacts > > > > > > > are > > > > > > > > at > > > > > > > > > > > [3]. > > > > > > > > > > > >>> > > > > > > > > > > > >>> This Release Candidate is based on (Apache Drill > > branch > > > > > named > > > > > > > > > > > >>> "1.14.0") commit ID: > > > > > > 4da8aff88966adee5d7438024a826bb599450a6f , > > > > > > > > > > > >>> available at [4]. > > > > > > > > > > > >>> > > > > > > > > > > > >>> Please download and try/test this Release > Candidate. > > > > > > > > > > > >>> > > > > > > > > > > > >>> Given that our bylaws require 3 business days, the > > vote > > > > > would > > > > > > > end > > > > > > > > > on > > > > > > > > > > > >>> Thursday, August 2nd, 2018 at 5:00 PM PDT . > > > > > > > > > > > >>> > > > > > > > > > > > >>> [ ] +1 > > > > > > > > > > > >>> [ ] +0 > > > > > > > > > > > >>> [ ] -1 > > > > > > > > > > > >>> > > > > > > > > > > > >>> My vote is +1 !! > > > > > > > > > > > >>> > > > > > > > > > > > >>> Thank you, > > > > > > > > > > > >>> > > > > > > > > > > > >>> Boaz > > > > > > > > > > > >>> > > > > > > > > > > > >>> > > > > > > > > > > > >>> [1] > > > > > > > > > > > >>> https://urldefense.proofpoint. > > com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIBaQ&c= > > cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8& > > m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s= > DrdAWdvHVkavIhX4eE721vE2- > > nCpbe8uO3KRMz3DbX4&e=. > > > > > com/v2/url?u=https-3A__issues. > > > > > > > > > > > > > > > > > > > > apache.org_jira_secure_ReleaseNote.jspa-3FprojectId- > > > > > > > > 3D12313820-26version- > > > > > > > > > > > 3D12342097&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r= > > > > > > > > > > > PqKay2uOMZUqopDRKNfBtZSlsp2meGOxWNAVHxHnXCk&m=7cmJ- > > > > > > > > > > > j2LSiMs7xMoaBk4MmgV24HxaR5LzmDYE6dlKvw&s= > > > > > > > > wPpmkjpk5reuOsI2Zhwg0-9vvYAQb_ > > > > > > > > > > > bWrhoJmkw4Bbc&e= > > > > > > > > > > > >>> > > > > > > > > > > > >>> > > > > > > > > > > > >>> [2]https://urldefense. > proofpoint.com/v2/url?u=http- > > > > > > > > > > > > > > > > > 3A__home.apache.org_-7Eboaz_drill_releases_1.14.0_rc2_&d= > DwIBaQ&c= > > > > > > > > > > > cskdkSMqhcnjZxdQVpwTXg&r= > PqKay2uOMZUqopDRKNfBtZSlsp2meG > > > > > > > > > > > OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD > > > > > > > > > > > YE6dlKvw&s=dINsXomnONCGf0t39_ > > J5VB1_T16dqj7yq34sNyU72_M&e= > > > > > > > > > > > >>> > > > > > > > > > > > >>> [3] > > > > > > > > > > > >>> https://urldefense.proofpoint. > > com/v2/url?u=https-3A__ > > > > > > > > > > > repository.apache.org_content_ > > repositories_orgapachedrill- > > > > > > > > > > > > > > > > > > > > 2D1050&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r= > > > > > > > > PqKay2uOMZUqopDRKNfBtZSlsp2meG > > > > > > > > > > > OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD > > > > > > > > > > > YE6dlKvw&s=K2ffEjpPckQ9-7YybbeHm_ClMS-F7K9pv_ > > N4xbAhs4E&e= > > > > > > > > > > > >>> > > > > > > > > > > > >>> [4]https://urldefense. > proofpoint.com/v2/url?u=https- > > > > > > > > > > > 3A__github.com_apache_drill_tree_1.14.0&d=DwIBaQ&c= > > > > > > > > > > > cskdkSMqhcnjZxdQVpwTXg&r= > PqKay2uOMZUqopDRKNfBtZSlsp2meG > > > > > > > > > > > OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD > > > > YE6dlKvw&s= > > > > > > > > > > > x4FT03yAXZOcnqY0kI1vmRJmuGa25ZGVhKVKjXH2ML4&e= > > > > > > > > > > > >>> > > > > > > > > > > > >>> OR > > > > > > > > > > > >>> > > > > > > > > > > > >>> https://urldefense.proofpoint. > > com/v2/url?u=https-3A__urldefense.proofpoint&d=DwIBaQ&c= > > cskdkSMqhcnjZxdQVpwTXg&r=HlugibuI4IVjs-VMnFvNTcaBtEaDDqE4Ya96cugWqJ8& > > m=HG9OS_a0kLXdIsK1TvkfCK4RrlzneNHG3_g4OIZ5R9o&s= > DrdAWdvHVkavIhX4eE721vE2- > > nCpbe8uO3KRMz3DbX4&e=. > > > > > com/v2/url?u=https-3A__github. > > > > > > > > > > > com_Ben-2DZvi_drill_tree_drill-2D1.14.0&d=DwIBaQ&c= > > > > > > > > > > > cskdkSMqhcnjZxdQVpwTXg&r= > PqKay2uOMZUqopDRKNfBtZSlsp2meG > > > > > > > > > > > OxWNAVHxHnXCk&m=7cmJ-j2LSiMs7xMoaBk4MmgV24HxaR5LzmD > > > > YE6dlKvw&s= > > > > > > > > > > > aGU2JYBo3RzIdTX6yNrVzyoqz9evUi9smRYMs2YfG2A&e= > > > > > > > > > > > >>> > > > > > > > > > > > >>> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
