Stamatis Zampetakis created HIVE-25684:
------------------------------------------
Summary: Many (~16K) skipped tests in
TestGenericUDFInitializeOnCompareUDF
Key: HIVE-25684
URL: https://issues.apache.org/jira/browse/HIVE-25684
Project: Hive
Issue Type: Task
Components: Testing Infrastructure
Affects Versions: 4.0.0
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis
Attachments: skipped_tests.png
TestGenericUDFInitializeOnCompareUDF is a parameterized test leading to 24K
possible test combinations. From those only 7K are actually run and the rest
(~16K) are skipped.
{noformat}
mvn test -Dtest=TestGenericUDFInitializeOnCompareUDF
...
[WARNING] Tests run: 24300, Failures: 0, Errors: 0, Skipped: 16452, Time
elapsed: 7.098 s - in
org.apache.hadoop.hive.ql.udf.generic.TestGenericUDFInitializeOnCompareUDF
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 7848, Failures: 0, Errors: 0, Skipped: 0
{noformat}
This generates a lot of noise in Jenkins CI, where many tests appear as
skipped, and it may make people believe it is a problem (side effect of their
changes). Moreover, we know in advance which tests are skipped and why so
instead of generating invalid parameter combinations we could simply remove
those combinations altogether.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)