[ 
https://issues.apache.org/jira/browse/DRILL-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985207#comment-16985207
 ] 

ASF GitHub Bot commented on DRILL-7393:
---------------------------------------

paul-rogers commented on pull request #1910: DRILL-7393: Revisit Drill tests to 
ensure that patching is executed b…
URL: https://github.com/apache/drill/pull/1910#discussion_r352251662
 
 

 ##########
 File path: common/src/test/java/org/apache/drill/test/BaseTest.java
 ##########
 @@ -15,24 +15,25 @@
  * See the License for the specific language governing permissions and
  * limitations under the License.
  */
-package org.apache.drill.exec.expr;
+package org.apache.drill.test;
 
-import org.apache.drill.BaseTestQuery;
-import org.apache.drill.common.util.TestTools;
-import org.junit.Test;
+import org.apache.drill.common.util.GuavaPatcher;
+import org.apache.drill.common.util.ProtobufPatcher;
 
-public class TestPrune extends BaseTestQuery {
+public class BaseTest {
 
 Review comment:
   The term `BaseTest` is too generic: soon this will contain all manner of 
common code. Better solutions are:
   
   * MapRTestBase and HBaseTestBase to patch the code as needed for just those 
clients.
   * Patchers as a service added to tests where needed, such as is done with 
the "dirTestWatcher"
   * The patch-on-load approach suggested below.
   
   The approach here is really far too much of a hack to maintain.
   
   Also, this patching means that code running in tests operates in a different 
environment than the same code running in production. That will become the 
cause of very mysterious bugs.
   
   Can we rethink our approach?
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Revisit Drill tests to ensure that patching is executed before any test run
> ---------------------------------------------------------------------------
>
>                 Key: DRILL-7393
>                 URL: https://issues.apache.org/jira/browse/DRILL-7393
>             Project: Apache Drill
>          Issue Type: Task
>    Affects Versions: 1.16.0, 1.17.0
>            Reporter: Arina Ielchiieva
>            Assignee: Anton Gozhiy
>            Priority: Major
>              Labels: ready-to-commit
>
> Apache Drill patches some Protobuf and Guava classes (see GuavaPatcher, 
> ProtobufPatcher), patching should be done before classes to be patched are 
> loaded. That's why this operation is executed in static block in Drillbit 
> class.
> Some tests in java-exec module use Drillbit class, some extend DrillTest 
> class, both of them patch Guava. But there are some tests that do not call 
> patcher but load classes to be patched. For example, 
> {{org.apache.drill.exec.sql.TestSqlBracketlessSyntax}} loads Guava 
> Preconditions class. If such tests run before tests that require patching, 
> tests run will fail since patching won't be successful. Patchers code does 
> not fail application if patching was not complete, just logs warning 
> ({{logger.warn("Unable to patch Guava classes.", e);}}), so sometimes it hard 
> to identify unit tests failure root cause.
> We need to revisit all Drill tests to ensure that all of them extend common 
> test base class which patchers Protobuf and Guava classes in static block. 
> Also refactor Patcher classes to have assert to fail if patching fails during 
> unit testing if there are any problems.
> After all tests are revised, we can remove {{metastore-test}} execution from 
> main.xml in {{maven-surefire-plugin}} which was added to ensure that all 
> Metastore tests run in a separate JVM where patching is done in first place 
> since Iceberg Metastore heavily depends on patched Guava Preconditions class.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to