[
https://issues.apache.org/jira/browse/HIVE-26277?focusedWorklogId=784259&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-784259
]
ASF GitHub Bot logged work on HIVE-26277:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 23/Jun/22 15:05
Start Date: 23/Jun/22 15:05
Worklog Time Spent: 10m
Work Description: asolimando commented on code in PR #3339:
URL: https://github.com/apache/hive/pull/3339#discussion_r905141497
##########
standalone-metastore/metastore-server/src/test/java/org/apache/hadoop/hive/metastore/StatisticsTestUtils.java:
##########
@@ -0,0 +1,172 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.hadoop.hive.metastore;
+
+import org.apache.hadoop.hive.common.ndv.fm.FMSketch;
+import org.apache.hadoop.hive.common.ndv.hll.HyperLogLog;
+import org.apache.hadoop.hive.metastore.api.ColumnStatistics;
+import org.apache.hadoop.hive.metastore.api.ColumnStatisticsData;
+import org.apache.hadoop.hive.metastore.api.ColumnStatisticsDesc;
+import org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj;
+import org.apache.hadoop.hive.metastore.api.FieldSchema;
+import org.apache.hadoop.hive.metastore.api.Table;
+import
org.apache.hadoop.hive.metastore.utils.MetaStoreServerUtils.ColStatsObjWithSourceInfo;
+
+import java.util.Collections;
+import java.util.List;
+import java.util.stream.Collectors;
+import java.util.stream.IntStream;
+
+import static org.apache.hadoop.hive.metastore.Warehouse.DEFAULT_CATALOG_NAME;
+
+public class StatisticsTestUtils {
+
+ private static final String HIVE_ENGINE = "hive";
+
+ private StatisticsTestUtils() {
+ throw new AssertionError("Suppress default constructor for non
instantiation");
+ }
+
+ /**
+ * Creates column statistics for a given table and partition.
+ * @param data the statistics data
+ * @param tbl the target table
+ * @param column the target column
+ * @param partName the target partition
+ * @return column statistics for a given table and partition.
+ */
+ public static ColumnStatistics createColStats(ColumnStatisticsData data,
Table tbl, FieldSchema column, String partName) {
+ ColumnStatisticsObj statObj = new ColumnStatisticsObj(column.getName(),
column.getType(), data);
+ ColumnStatistics colStats = new ColumnStatistics();
+ ColumnStatisticsDesc statsDesc = new ColumnStatisticsDesc(true,
tbl.getDbName(), tbl.getTableName());
+ statsDesc.setPartName(partName);
+ colStats.setStatsDesc(statsDesc);
+ colStats.setStatsObj(Collections.singletonList(statObj));
+ colStats.setEngine(HIVE_ENGINE);
+ return colStats;
+ }
+
+ public static ColStatsObjWithSourceInfo
createStatsWithInfo(ColumnStatisticsData data, Table tbl,
Review Comment:
No, this method is more than enough for now, I have refactored the other
tests and removed the redundant methods from here.
Issue Time Tracking
-------------------
Worklog Id: (was: 784259)
Time Spent: 3.5h (was: 3h 20m)
> NPEs and rounding issues in ColumnStatsAggregator classes
> ---------------------------------------------------------
>
> Key: HIVE-26277
> URL: https://issues.apache.org/jira/browse/HIVE-26277
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore, Statistics, Tests
> Affects Versions: 4.0.0-alpha-2
> Reporter: Alessandro Solimando
> Assignee: Alessandro Solimando
> Priority: Major
> Labels: pull-request-available
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> Fix NPEs and rounding errors in _ColumnStatsAggregator_ classes, add
> unit-tests for all the involved classes.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
