Author: taklwu
Date: Wed Oct 18 04:59:49 2023
New Revision: 64597
Log:
Apache hbase-connectors 1.0.1RC0
Added:
dev/hbase/hbase-connectors-1.0.1RC0/
dev/hbase/hbase-connectors-1.0.1RC0/CHANGELOG.md
dev/hbase/hbase-connectors-1.0.1RC0/RELEASENOTES.md
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz
(with props)
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.asc
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.sha512
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz
(with props)
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.asc
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.sha512
Added: dev/hbase/hbase-connectors-1.0.1RC0/CHANGELOG.md
==============================================================================
--- dev/hbase/hbase-connectors-1.0.1RC0/CHANGELOG.md (added)
+++ dev/hbase/hbase-connectors-1.0.1RC0/CHANGELOG.md Wed Oct 18 04:59:49 2023
@@ -0,0 +1,226 @@
+
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+-->
+# HBASE Changelog
+
+## Release hbase-connectors-1.0.1 - Unreleased (as of 2023-10-18)
+
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-28152](https://issues.apache.org/jira/browse/HBASE-28152) | Replace
scala.util.parsing.json with org.json4s.jackson which used in Spark too |
Major | spark |
+| [HBASE-28137](https://issues.apache.org/jira/browse/HBASE-28137) | Add
scala-parser-combinators dependency to connectors for Spark 3.4 | Major |
spark |
+| [HBASE-27397](https://issues.apache.org/jira/browse/HBASE-27397) |
Spark-hbase support for 'startWith' predicate. | Minor | hbase-connectors |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-27625](https://issues.apache.org/jira/browse/HBASE-27625) | Bump
commons-lang3 to 3.12.0, surefire to 3.0.0 and dependency manage reload4j to
1.2.25 to support jdk11 | Major | hbase-connectors, spark |
+| [HBASE-27705](https://issues.apache.org/jira/browse/HBASE-27705) | Respect
SparkContext hadoop configuration | Major | spark |
+| [HBASE-27639](https://issues.apache.org/jira/browse/HBASE-27639) | Support
hbase-connectors compilation with HBase 2.5.3, Hadoop 3.2.4 and Spark 3.2.3 |
Major | hbase-connectors, spark |
+| [HBASE-26534](https://issues.apache.org/jira/browse/HBASE-26534) | Update
dependencies in hbase-connectors: HBase version to 2.4.8, and make Hadoop 3 and
Spark 3 defaults | Minor | hadoop3, hbase-connectors, spark |
+| [HBASE-25684](https://issues.apache.org/jira/browse/HBASE-25684) |
Dependency manage log4j in hbase-connectors | Minor | hbase-connectors |
+| [HBASE-25326](https://issues.apache.org/jira/browse/HBASE-25326) | Allow
hbase-connector to be used with Apache Spark 3.0 | Minor | . |
+| [HBASE-23606](https://issues.apache.org/jira/browse/HBASE-23606) | Remove
external deprecations in hbase-connectors | Minor | . |
+| [HBASE-24230](https://issues.apache.org/jira/browse/HBASE-24230) | Support
user-defined version timestamp when bulk load data | Minor | hbase-connectors |
+| [HBASE-23608](https://issues.apache.org/jira/browse/HBASE-23608) | Remove
redundant groupId from spark module in hbase-connectors | Trivial | . |
+| [HBASE-23592](https://issues.apache.org/jira/browse/HBASE-23592) | Refactor
tests in hbase-kafka-proxy in hbase-connectors | Trivial | . |
+| [HBASE-24110](https://issues.apache.org/jira/browse/HBASE-24110) | Move to
Apache parent POM version 23 for connectors | Minor | hbase-connectors |
+| [HBASE-23603](https://issues.apache.org/jira/browse/HBASE-23603) | Update
Apache POM to version 21 for hbase-connectors | Trivial | . |
+| [HBASE-23607](https://issues.apache.org/jira/browse/HBASE-23607) | Update
Maven plugins in hbase-connectors | Minor | . |
+| [HBASE-23579](https://issues.apache.org/jira/browse/HBASE-23579) | Fix
Checkstyle errors in hbase-connectors | Minor | . |
+| [HBASE-23586](https://issues.apache.org/jira/browse/HBASE-23586) | Use
StandardCharsets instead of String in TestQualifierMatching in hbase-connectors
| Trivial | . |
+| [HBASE-23580](https://issues.apache.org/jira/browse/HBASE-23580) | Refactor
TestRouteRules in hbase-connectors | Trivial | . |
+| [HBASE-23576](https://issues.apache.org/jira/browse/HBASE-23576) | Bump
Checkstyle from 8.11 to 8.18 in hbase-connectors | Minor | . |
+| [HBASE-22817](https://issues.apache.org/jira/browse/HBASE-22817) | Use
hbase-shaded dependencies in hbase-spark | Major | hbase-connectors |
+| [HBASE-23075](https://issues.apache.org/jira/browse/HBASE-23075) | Upgrade
jackson to version 2.9.10 due to CVE-2019-16335 and CVE-2019-14540 | Major |
dependencies, hbase-connectors, REST, security |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-26863](https://issues.apache.org/jira/browse/HBASE-26863) | Rowkey
pushdown does not work with complex conditions | Major | hbase-connectors |
+| [HBASE-27488](https://issues.apache.org/jira/browse/HBASE-27488) |
[hbase-connectors] Duplicate result when searching HBase by Spark | Major |
hbase-connectors |
+| [HBASE-27656](https://issues.apache.org/jira/browse/HBASE-27656) | Make sure
the close method of the SmartSonnection is called | Major | spark |
+| [HBASE-27176](https://issues.apache.org/jira/browse/HBASE-27176) |
[hbase-connectors] Fail to build hbase-connectors because of checkstyle error |
Major | build, hbase-connectors |
+| [HBASE-27801](https://issues.apache.org/jira/browse/HBASE-27801) | Remove
redundant avro.version property from Kafka connector | Minor |
hbase-connectors, kafka |
+| [HBASE-27630](https://issues.apache.org/jira/browse/HBASE-27630) |
hbase-spark bulkload stage directory limited to hdfs only | Major | spark |
+| [HBASE-27624](https://issues.apache.org/jira/browse/HBASE-27624) | Cannot
Specify Namespace via the hbase.table Option in Spark Connector | Major |
hbase-connectors, spark |
+| [HBASE-22338](https://issues.apache.org/jira/browse/HBASE-22338) | LICENSE
file only contains Apache 2.0 | Critical | hbase-connectors |
+| [HBASE-26211](https://issues.apache.org/jira/browse/HBASE-26211) |
[hbase-connectors] Pushdown filters in Spark do not work correctly with long
types | Major | hbase-connectors |
+| [HBASE-25236](https://issues.apache.org/jira/browse/HBASE-25236) |
[hbase-connectors] Run package phase on spark modules | Major |
hbase-connectors |
+| [HBASE-24276](https://issues.apache.org/jira/browse/HBASE-24276) | hbase
spark connector doesn't support writing to table not in default namespace |
Major | hbase-connectors, spark |
+| [HBASE-24088](https://issues.apache.org/jira/browse/HBASE-24088) | Solve the
ambiguous reference for scala 2.12 | Minor | hbase-connectors |
+| [HBASE-23295](https://issues.apache.org/jira/browse/HBASE-23295) |
hbase-connectors HBaseContext should use most recent delegation token | Major
| hbase-connectors |
+| [HBASE-23351](https://issues.apache.org/jira/browse/HBASE-23351) | Updating
hbase version to 2.2.2 | Major | hbase-connectors |
+| [HBASE-23348](https://issues.apache.org/jira/browse/HBASE-23348) | Spark's
createTable method throws an exception while the table is being split | Major
| hbase-connectors |
+| [HBASE-23346](https://issues.apache.org/jira/browse/HBASE-23346) | Import
ReturnCode in SparkSQLPushDownFilter | Major | hbase-connectors |
+| [HBASE-23327](https://issues.apache.org/jira/browse/HBASE-23327) | Add
missing maven functions for hb\_maven | Critical | hbase-connectors |
+| [HBASE-23059](https://issues.apache.org/jira/browse/HBASE-23059) | Run mvn
install for root in precommit | Major | hbase-connectors |
+| [HBASE-22711](https://issues.apache.org/jira/browse/HBASE-22711) | Spark
connector doesn't use the given mapping when inserting data | Major |
hbase-connectors |
+| [HBASE-22674](https://issues.apache.org/jira/browse/HBASE-22674) | precommit
docker image installs JRE over JDK (multiple repos) | Critical | build,
hbase-connectors |
+| [HBASE-22336](https://issues.apache.org/jira/browse/HBASE-22336) | Add
CHANGELOG, README and RELEASENOTES to binary tarball | Critical |
hbase-connectors |
+| [HBASE-22320](https://issues.apache.org/jira/browse/HBASE-22320) |
hbase-connectors personality skips non-scaladoc tests | Critical | . |
+| [HBASE-22319](https://issues.apache.org/jira/browse/HBASE-22319) | Fix for
warning The assembly descriptor contains a filesystem-root relative reference |
Minor | hbase-connectors |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-28054](https://issues.apache.org/jira/browse/HBASE-28054) |
[hbase-connectors] Add spotless in hbase-connectors pre commit check | Major |
build, community, hbase-connectors, jenkins |
+| [HBASE-28006](https://issues.apache.org/jira/browse/HBASE-28006) |
[hbase-connectors] Run spotless:apply on code base | Major | build,
hbase-connectors |
+| [HBASE-27178](https://issues.apache.org/jira/browse/HBASE-27178) |
[hbase-connectors] Add spotless plugin to format code (including scala code) |
Major | build, hbase-connectors |
+| [HBASE-25136](https://issues.apache.org/jira/browse/HBASE-25136) | Migrate
HBase-Connectors-PreCommit jenkins job from Hadoop to hbase | Major |
hbase-connectors, jenkins |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-27114](https://issues.apache.org/jira/browse/HBASE-27114) | Upgrade
scalatest maven plugin for thread-safety | Major | build, spark |
+| [HBASE-27883](https://issues.apache.org/jira/browse/HBASE-27883) |
[hbase-connectors] Use log4j2 instead of log4j for logging | Blocker |
hbase-connectors |
+| [HBASE-27679](https://issues.apache.org/jira/browse/HBASE-27679) | Bump
junit to 4.13.2 in hbase-connectors | Major | hbase-connectors |
+| [HBASE-27680](https://issues.apache.org/jira/browse/HBASE-27680) | Bump
hbase, hbase-thirdparty, hadoop and spark for hbase-connectors | Major |
hbase-connectors |
+| [HBASE-27678](https://issues.apache.org/jira/browse/HBASE-27678) | Update
checkstyle in hbase-connectors | Major | hbase-connectors |
+| [HBASE-27285](https://issues.apache.org/jira/browse/HBASE-27285) | Fix sonar
report paths | Minor | hbase-connectors |
+| [HBASE-27272](https://issues.apache.org/jira/browse/HBASE-27272) | Enable
code coverage reporting to SonarQube in hbase-connectors | Minor |
hbase-connectors |
+| [HBASE-26664](https://issues.apache.org/jira/browse/HBASE-26664) |
HBASE-26664 hbase-connector upgrades extra-enforcer-rules to 1.5.1 | Major |
hbase-connectors |
+| [HBASE-26334](https://issues.apache.org/jira/browse/HBASE-26334) | Upgrade
commons-io to 2.11.0 in hbase-connectors | Major | hbase-connectors |
+| [HBASE-26314](https://issues.apache.org/jira/browse/HBASE-26314) | Upgrade
commons-io to 2.8.0 in hbase-connectors | Major | hbase-connectors |
+| [HBASE-25579](https://issues.apache.org/jira/browse/HBASE-25579) | HBase
Connectors pom should include nexus staging repo management | Major |
community, hbase-connectors |
+| [HBASE-25479](https://issues.apache.org/jira/browse/HBASE-25479) |
[connectors] Purge use of VisibleForTesting | Major | hbase-connectors |
+| [HBASE-25388](https://issues.apache.org/jira/browse/HBASE-25388) | Replacing
Producer implementation with an extension of MockProducer on testing side in
hbase-connectors | Major | hbase-connectors |
+| [HBASE-24883](https://issues.apache.org/jira/browse/HBASE-24883) | Migrate
hbase-connectors testing to ci-hadoop | Major | build, hbase-connectors |
+| [HBASE-23565](https://issues.apache.org/jira/browse/HBASE-23565) | Execute
tests in hbase-connectors precommit | Critical | hbase-connectors |
+| [HBASE-23032](https://issues.apache.org/jira/browse/HBASE-23032) | Upgrade
to Curator 4.2.0 | Major | . |
+| [HBASE-22599](https://issues.apache.org/jira/browse/HBASE-22599) | Let
hbase-connectors compile against HBase 2.2.0 | Major | hbase-connectors |
+| [HBASE-22698](https://issues.apache.org/jira/browse/HBASE-22698) |
[hbase-connectors] Add license header to README.md | Major | hbase-connectors |
+| [HBASE-22636](https://issues.apache.org/jira/browse/HBASE-22636) | hbase
spark module README is in txt format. | Trivial | hbase-connectors |
+| [HBASE-22318](https://issues.apache.org/jira/browse/HBASE-22318) | Fix for
warning The POM for org.glassfish:javax.el:jar is missing | Minor |
hbase-connectors |
+
+
+## Release connector-1.0.0 - Unreleased (as of 2019-04-26)
+
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-13992](https://issues.apache.org/jira/browse/HBASE-13992) | Integrate
SparkOnHBase into HBase | Major | hbase-connectors, spark |
+| [HBASE-14150](https://issues.apache.org/jira/browse/HBASE-14150) | Add
BulkLoad functionality to HBase-Spark Module | Major | hbase-connectors, spark
|
+| [HBASE-14181](https://issues.apache.org/jira/browse/HBASE-14181) | Add Spark
DataFrame DataSource to HBase-Spark Module | Minor | hbase-connectors, spark |
+| [HBASE-14340](https://issues.apache.org/jira/browse/HBASE-14340) | Add
second bulk load option to Spark Bulk Load to send puts as the value | Minor |
hbase-connectors, spark |
+| [HBASE-14849](https://issues.apache.org/jira/browse/HBASE-14849) | Add
option to set block cache to false on SparkSQL executions | Major |
hbase-connectors, spark |
+| [HBASE-15572](https://issues.apache.org/jira/browse/HBASE-15572) | Adding
optional timestamp semantics to HBase-Spark | Major | hbase-connectors, spark |
+| [HBASE-17933](https://issues.apache.org/jira/browse/HBASE-17933) |
[hbase-spark] Support Java api for bulkload | Major | hbase-connectors, spark
|
+| [HBASE-15320](https://issues.apache.org/jira/browse/HBASE-15320) | HBase
connector for Kafka Connect | Major | hbase-connectors, Replication |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-14515](https://issues.apache.org/jira/browse/HBASE-14515) | Allow
spark module unit tests to be skipped with a profile | Minor | build,
hbase-connectors, spark |
+| [HBASE-14158](https://issues.apache.org/jira/browse/HBASE-14158) | Add
documentation for Initial Release for HBase-Spark Module integration | Major |
documentation, hbase-connectors, spark |
+| [HBASE-14159](https://issues.apache.org/jira/browse/HBASE-14159) | Resolve
warning introduced by HBase-Spark module | Minor | build, hbase-connectors,
spark |
+| [HBASE-15434](https://issues.apache.org/jira/browse/HBASE-15434) |
[findbugs] Exclude scala generated source and protobuf generated code in
hbase-spark module | Major | hbase-connectors, spark |
+| [HBASE-16638](https://issues.apache.org/jira/browse/HBASE-16638) | Reduce
the number of Connection's created in classes of hbase-spark module | Critical
| hbase-connectors, spark |
+| [HBASE-16823](https://issues.apache.org/jira/browse/HBASE-16823) | Add
examples in HBase Spark module | Major | hbase-connectors, spark |
+| [HBASE-17549](https://issues.apache.org/jira/browse/HBASE-17549) |
HBase-Spark Module : Incorrect log at println and unwanted comment code |
Major | hbase-connectors, spark |
+| [HBASE-18176](https://issues.apache.org/jira/browse/HBASE-18176) | add
enforcer rule to make sure hbase-spark / scala aren't dependencies of
unexpected modules | Major | build, hbase-connectors, spark |
+| [HBASE-21491](https://issues.apache.org/jira/browse/HBASE-21491) |
[hbase-connectors] Edit on spark connector README | Trivial | hbase-connectors
|
+| [HBASE-21841](https://issues.apache.org/jira/browse/HBASE-21841) | Allow
inserting null values throw DataSource API | Major | spark |
+| [HBASE-21880](https://issues.apache.org/jira/browse/HBASE-21880) |
[hbase-connectors] clean up site target | Minor | hbase-connectors |
+| [HBASE-21842](https://issues.apache.org/jira/browse/HBASE-21842) | Properly
use flatten-maven-plugin in hbase-connectors | Major | hbase-connectors |
+| [HBASE-21931](https://issues.apache.org/jira/browse/HBASE-21931) |
[hbase-connectors] Bump surefire version | Major | hbase-connectors |
+| [HBASE-14789](https://issues.apache.org/jira/browse/HBASE-14789) | Enhance
the current spark-hbase connector | Major | hbase-connectors, spark |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-14377](https://issues.apache.org/jira/browse/HBASE-14377) |
JavaHBaseContextSuite not being run | Critical | hbase-connectors, spark |
+| [HBASE-14406](https://issues.apache.org/jira/browse/HBASE-14406) | The
dataframe datasource filter is wrong, and will result in data loss or
unexpected behavior | Blocker | hbase-connectors, spark |
+| [HBASE-15184](https://issues.apache.org/jira/browse/HBASE-15184) | SparkSQL
Scan operation doesn't work on kerberos cluster | Critical | hbase-connectors,
spark |
+| [HBASE-16804](https://issues.apache.org/jira/browse/HBASE-16804) |
JavaHBaseContext.streamBulkGet is void but should be JavaDStream | Major |
hbase-connectors, spark |
+| [HBASE-17547](https://issues.apache.org/jira/browse/HBASE-17547) |
HBase-Spark Module : TableCatelog doesn't support multiple columns from Single
Column family | Major | hbase-connectors, spark |
+| [HBASE-17574](https://issues.apache.org/jira/browse/HBASE-17574) | Clean up
how to run tests under hbase-spark module | Major | hbase-connectors, spark |
+| [HBASE-15597](https://issues.apache.org/jira/browse/HBASE-15597) | Clean up
configuration keys used in hbase-spark module | Critical | hbase-connectors,
spark |
+| [HBASE-17909](https://issues.apache.org/jira/browse/HBASE-17909) | Redundant
exclusion of jruby-complete in pom of hbase-spark | Minor | hbase-connectors,
spark |
+| [HBASE-17546](https://issues.apache.org/jira/browse/HBASE-17546) | Incorrect
syntax at HBase-Spark Module Examples | Minor | hbase-connectors, spark |
+| [HBASE-19387](https://issues.apache.org/jira/browse/HBASE-19387) |
HBase-spark snappy.SnappyError on Arm64 | Minor | hbase-connectors, spark,
test |
+| [HBASE-16179](https://issues.apache.org/jira/browse/HBASE-16179) | Fix
compilation errors when building hbase-spark against Spark 2.0 | Critical |
hbase-connectors, spark |
+| [HBASE-20124](https://issues.apache.org/jira/browse/HBASE-20124) | Make
hbase-spark module work with hadoop3 | Major | dependencies, hadoop3,
hbase-connectors, spark |
+| [HBASE-20177](https://issues.apache.org/jira/browse/HBASE-20177) | Fix
warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-spark |
Minor | hbase-connectors |
+| [HBASE-20375](https://issues.apache.org/jira/browse/HBASE-20375) | Remove
use of getCurrentUserCredentials in hbase-spark module | Major |
hbase-connectors, spark |
+| [HBASE-20880](https://issues.apache.org/jira/browse/HBASE-20880) | Fix for
warning It would fail on the following input in hbase-spark | Minor |
hbase-connectors |
+| [HBASE-21038](https://issues.apache.org/jira/browse/HBASE-21038) |
SAXParseException when hbase.spark.use.hbasecontext=false | Major |
hbase-connectors |
+| [HBASE-20175](https://issues.apache.org/jira/browse/HBASE-20175) |
hbase-spark needs scala dependency convergance | Major | dependencies,
hbase-connectors, spark |
+| [HBASE-21429](https://issues.apache.org/jira/browse/HBASE-21429) |
[hbase-connectors] pom refactoring adding kafka dir intermediary | Minor |
hbase-connectors, kafka |
+| [HBASE-21431](https://issues.apache.org/jira/browse/HBASE-21431) |
[hbase-connectors] Fix build and test issues | Blocker | hbase-connectors |
+| [HBASE-21434](https://issues.apache.org/jira/browse/HBASE-21434) |
[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version |
Major | hbase-connectors, kafka |
+| [HBASE-21446](https://issues.apache.org/jira/browse/HBASE-21446) |
[hbase-connectors] Update spark and scala versions; add some doc on how to
generate artifacts with different versions | Major | hbase-connectors, spark |
+| [HBASE-21448](https://issues.apache.org/jira/browse/HBASE-21448) |
[hbase-connectors] Make compile/tests pass on scala 2.10 AND 2.11 | Major |
hbase-connectors, spark |
+| [HBASE-21878](https://issues.apache.org/jira/browse/HBASE-21878) |
[hbase-connectors] Fix hbase-checkstyle version reference | Critical |
hbase-connectors |
+| [HBASE-21923](https://issues.apache.org/jira/browse/HBASE-21923) |
[hbase-connectors] Make apache-rat pass | Critical | hbase-connectors |
+| [HBASE-21450](https://issues.apache.org/jira/browse/HBASE-21450) |
[documentation] Point spark doc at hbase-connectors spark | Major |
documentation, hbase-connectors, spark |
+
+
+### TESTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-18175](https://issues.apache.org/jira/browse/HBASE-18175) | Add
hbase-spark integration test into hbase-spark-it | Critical |
hbase-connectors, spark |
+| [HBASE-20176](https://issues.apache.org/jira/browse/HBASE-20176) | Fix
warnings about Logging import in hbase-spark test code | Minor |
hbase-connectors |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-15336](https://issues.apache.org/jira/browse/HBASE-15336) | Support
Dataframe writer to the spark connector | Major | hbase-connectors, spark |
+| [HBASE-15333](https://issues.apache.org/jira/browse/HBASE-15333) |
[hbase-spark] Enhance dataframe filters to handle naively encoded short,
integer, long, float and double | Major | hbase-connectors, spark |
+| [HBASE-15473](https://issues.apache.org/jira/browse/HBASE-15473) |
Documentation for the usage of hbase dataframe user api (JSON, Avro, etc) |
Blocker | documentation, hbase-connectors, spark |
+| [HBASE-19482](https://issues.apache.org/jira/browse/HBASE-19482) | Fix
Checkstyle errors in hbase-spark-it | Minor | hbase-connectors |
+| [HBASE-19597](https://issues.apache.org/jira/browse/HBASE-19597) | Fix
Checkstyle errors in hbase-spark | Minor | hbase-connectors, spark |
+| [HBASE-21002](https://issues.apache.org/jira/browse/HBASE-21002) | Create
assembly and scripts to start Kafka Proxy | Minor | hbase-connectors |
+| [HBASE-21435](https://issues.apache.org/jira/browse/HBASE-21435) |
[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version;
addendum | Minor | hbase-connectors, kafka |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-14184](https://issues.apache.org/jira/browse/HBASE-14184) | Fix
indention and typo in JavaHBaseContext | Minor | hbase-connectors, spark |
+| [HBASE-21022](https://issues.apache.org/jira/browse/HBASE-21022) | Review
kafka-connection repo's POMs | Major | hbase-connectors, kafka |
+| [HBASE-20257](https://issues.apache.org/jira/browse/HBASE-20257) |
hbase-spark should not depend on com.google.code.findbugs.jsr305 | Minor |
build, hbase-connectors, spark |
+| [HBASE-21273](https://issues.apache.org/jira/browse/HBASE-21273) | Move
classes out of org.apache.spark namespace | Major | hbase-connectors, spark |
+| [HBASE-21432](https://issues.apache.org/jira/browse/HBASE-21432) |
[hbase-connectors] Add Apache Yetus integration for hbase-connectors repository
| Major | build, hbase-connectors |
+| [HBASE-22221](https://issues.apache.org/jira/browse/HBASE-22221) | Extend
kafka-proxy documentation with required hbase settings | Major |
hbase-connectors |
+| [HBASE-22210](https://issues.apache.org/jira/browse/HBASE-22210) | Fix
hbase-connectors-assembly to include every jar | Major | hbase-connectors |
+| [HBASE-22266](https://issues.apache.org/jira/browse/HBASE-22266) | Add yetus
personality to connectors to avoid scaladoc issues | Major | hbase-connectors |
+| [HBASE-22257](https://issues.apache.org/jira/browse/HBASE-22257) | Remove
json4s and jackson dependency from hbase spark connector | Major |
hbase-connectors |
Added: dev/hbase/hbase-connectors-1.0.1RC0/RELEASENOTES.md
==============================================================================
--- dev/hbase/hbase-connectors-1.0.1RC0/RELEASENOTES.md (added)
+++ dev/hbase/hbase-connectors-1.0.1RC0/RELEASENOTES.md Wed Oct 18 04:59:49 2023
@@ -0,0 +1,194 @@
+# RELEASENOTES
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+-->
+# HBASE hbase-connectors-1.0.1 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities,
important issues, features, and major improvements.
+
+
+---
+
+* [HBASE-26534](https://issues.apache.org/jira/browse/HBASE-26534) | *Minor* |
**Update dependencies in hbase-connectors: HBase version to 2.4.8, and make
Hadoop 3 and Spark 3 defaults**
+
+HBASE-26534 upgrades hbase-thirdparty to 4.0.1, hbase to 2.4.9, spark to
3.1.2, and hadoop to 3.2.0. Also It builds with spark3 with scala-2.12 and
hadoop3 profile as default option.
+
+
+---
+
+* [HBASE-26334](https://issues.apache.org/jira/browse/HBASE-26334) | *Major* |
**Upgrade commons-io to 2.11.0 in hbase-connectors**
+
+Upgraded commons-io to 2.11.0.
+
+
+---
+
+* [HBASE-26314](https://issues.apache.org/jira/browse/HBASE-26314) | *Major* |
**Upgrade commons-io to 2.8.0 in hbase-connectors**
+
+Upgraded commons-io to 2.8.0.
+
+
+---
+
+* [HBASE-23576](https://issues.apache.org/jira/browse/HBASE-23576) | *Minor* |
**Bump Checkstyle from 8.11 to 8.18 in hbase-connectors**
+
+Bumped the Checkstyle version from 8.11 to 8.18
+
+
+---
+
+* [HBASE-22817](https://issues.apache.org/jira/browse/HBASE-22817) | *Major* |
**Use hbase-shaded dependencies in hbase-spark**
+
+<!-- markdown -->
+The HBase connector for working with Apache Spark now works with the shaded
client artifacts provided by the Apache HBase project and avoids adding
additional third party dependencies to the classpath.
+
+
+
+# HBase connector-1.0.0 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities,
important issues, features, and major improvements.
+
+
+---
+
+* [HBASE-13992](https://issues.apache.org/jira/browse/HBASE-13992) | *Major* |
**Integrate SparkOnHBase into HBase**
+
+This release includes initial support for running Spark against HBase with a
richer feature set than was previously possible with MapReduce bindings:
+
+\* Support for Spark and Spark Streaming against Spark 2.1.1
+\* RDD/DStream formation from scan operations
+\* convenience methods for interacting with HBase from an HBase backed RDD /
DStream instance
+\* examples in both the Spark Java API and Spark Scala API
+\* support for running against a secure HBase cluster
+
+
+---
+
+* [HBASE-14849](https://issues.apache.org/jira/browse/HBASE-14849) | *Major* |
**Add option to set block cache to false on SparkSQL executions**
+
+For user configurable parameters for HBase datasources. Please refer to
org.apache.hadoop.hbase.spark.datasources.HBaseSparkConf for details.
+
+User can either set them in SparkConf, which will take effect globally, or
configure it per table, which will overwrite the value set in SparkConf. If not
set, the default value will take effect.
+
+Currently three parameters are supported.
+1. spark.hbase.blockcache.enable for blockcache enable/disable. Default is
enable, but note that this potentially may slow down the system.
+2. spark.hbase.cacheSize for cache size when performing HBase table scan.
Default value is 1000
+3. spark.hbase.batchNum for the batch number when performing HBase table scan.
Default value is 1000.
+
+
+---
+
+* [HBASE-15184](https://issues.apache.org/jira/browse/HBASE-15184) |
*Critical* | **SparkSQL Scan operation doesn't work on kerberos cluster**
+
+Before this patch, users of the spark HBaseContext would fail due to lack of
privilege exceptions.
+
+Note:
+\* It is preferred to have spark in spark-on-yarn mode if Kerberos is used.
+\* This is orthogonal to issues with a kerberized spark cluster via
InputFormats.
+
+
+---
+
+* [HBASE-15572](https://issues.apache.org/jira/browse/HBASE-15572) | *Major* |
**Adding optional timestamp semantics to HBase-Spark**
+
+Right now the timestamp is always latest. With this patch, users can select
timestamps they want.
+In this patch, 4 parameters, "timestamp", "minTimestamp", "maxiTimestamp" and
"maxVersions" are added to HBaseSparkConf. Users can select a timestamp, they
can also select a time range with minimum timestamp and maximum timestamp.
+
+
+---
+
+* [HBASE-17574](https://issues.apache.org/jira/browse/HBASE-17574) | *Major* |
**Clean up how to run tests under hbase-spark module**
+
+Run test under root dir or hbase-spark dir
+1. mvn test //run all small and medium java tests, and all scala tests
+2. mvn test -P skipSparkTests //skip all scala and java tests in hbase-spark
+3. mvn test -P runAllTests //run all tests, including scala and all java test
even the large test
+
+Run specified test case, since we have two plugins, we need specify both java
and scala.
+When only test scala or jave test case, disable the other one use -Dxx=None as
follow:
+1. mvn test -Dtest=TestJavaHBaseContext -DwildcardSuites=None // java unit test
+2. mvn test -Dtest=None
-DwildcardSuites=org.apache.hadoop.hbase.spark.BulkLoadSuite //scala unit test,
only support full name in scalatest plugin
+
+
+---
+
+* [HBASE-17933](https://issues.apache.org/jira/browse/HBASE-17933) | *Major* |
**[hbase-spark] Support Java api for bulkload**
+
+<!-- markdown -->
+The integration module for Apache Spark now includes Java-friendly equivalents
for the `bulkLoad` and `bulkLoadThinRows` methods in `JavaHBaseContext`.
+
+
+---
+
+* [HBASE-18175](https://issues.apache.org/jira/browse/HBASE-18175) |
*Critical* | **Add hbase-spark integration test into hbase-spark-it**
+
+<!-- markdown -->
+HBase now ships with an integration test for our integration with Apache Spark.
+
+You can run this test on a cluster by using an equivalent to the below, e.g.
if the version of HBase is 2.0.0-alpha-2
+
+```
+spark-submit --class
org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad
HBASE_HOME/lib/hbase-spark-it-2.0.0-alpha-2-tests.jar
-Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic
+```
+
+
+---
+
+* [HBASE-16179](https://issues.apache.org/jira/browse/HBASE-16179) |
*Critical* | **Fix compilation errors when building hbase-spark against Spark
2.0**
+
+As of this JIRA, Spark version is upgraded from 1.6 to 2.1.1
+
+
+---
+
+* [HBASE-21002](https://issues.apache.org/jira/browse/HBASE-21002) | *Minor* |
**Create assembly and scripts to start Kafka Proxy**
+
+Adds a kafka proxy that appears to hbase as a replication peer. Use to tee
table edits to kafka. Has mechanism for dropping/routing updates. See
https://github.com/apache/hbase-connectors/tree/master/kafka for documentation.
+
+
+---
+
+* [HBASE-21434](https://issues.apache.org/jira/browse/HBASE-21434) | *Major* |
**[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version**
+
+Cleaned up kafka submodule dependencies. Added used dependencies to pom and
removed the unused. Depends explicitly on hadoop2. No messing w/ hadoop3
versions.
+
+
+---
+
+* [HBASE-21446](https://issues.apache.org/jira/browse/HBASE-21446) | *Major* |
**[hbase-connectors] Update spark and scala versions; add some doc on how to
generate artifacts with different versions**
+
+Updates our hbase-spark integration so defaults spark 2.4.0 (October 2018)
from 2.1.1 and Scala 2.11.12 (from 2.11.8).
+
+
+---
+
+* [HBASE-15320](https://issues.apache.org/jira/browse/HBASE-15320) | *Major* |
**HBase connector for Kafka Connect**
+
+This commit adds a kafka connector. The connectors acts as a replication peer
and sends modifications in HBase to kafka.
+
+For further information, please refer to kafka/README.md.
+
+
+---
+
+* [HBASE-14789](https://issues.apache.org/jira/browse/HBASE-14789) | *Major* |
**Enhance the current spark-hbase connector**
+
+New features in hbase-spark:
+\* native type support (short, int, long, float, double),
+\* support for Dataframe writes,
+\* avro support,
+\* catalog can be defined in json.
Added: dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz
==============================================================================
Binary file - no diff available.
Propchange:
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz
------------------------------------------------------------------------------
svn:mime-type = application/octet-stream
Added: dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.asc
==============================================================================
--- dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.asc
(added)
+++ dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.asc
Wed Oct 18 04:59:49 2023
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCAAdFiEEYVJfGm2bU3nrNAMbCSFVWuk1rVQFAmUvZiMACgkQCSFVWuk1
+rVRWTQ//czTr43PRnrjkg9Wrjk8rp0irzjtANJsHac/Vyb2F7VolAZJedxNih/kY
+t28iNGImsbZAPnYdG8AiSqHu1cmwH0eusyk8718PLHhUPB9qHlW8M8PtlDQ3Zvh1
+O7J38sdLn7s/90h5E5Fv4P4N/XAcd0XfB1IlehXpjUI6v9wZ0y62tWpDAkpfP9nm
+ZaKwtERKA7MT7PMQ5AH9wxTl8dFvWkdeBarr6jVwfKdd0va0kLy+n/yqDKm8VmMb
+R5r/P8RHe5O5sJNN5frnJPnTDnIN6yNvV0uQXaImO5PNLpU9L3ZBtNJCwaTaogbe
+538MiKeI1HJLuj8s6EJfQBQQxm6q1nMCDwibZZBatASZG7zdUcZ8646d5uwoT+5S
+LTMUyVVUAz6/ji+Pk9dZXFvmAM7UO6ApIoOMVk/iT9bTjOmbOCePRe4fknVoCHUc
+JN04+Dwo8764AtqR+AcZBT15PfCjXKSL2Rj0pPYs+soRKOXLEGD2sfEDSa36I6vs
+hLEyu1KGVzO0u+WLBKkXQW1nxAqt4p3LvpfcuMf/SxOwDrO4zPZB/dA561pw2V6U
+bw/K+Uahq0cQh4ESpZgwaiWnkpN40FIih5mPg038TGgGK7z25X2G3tJgfSSHas7Z
+rycV4ydHF3ha+xHe0EqTXn2DqBzW0q4jGQfYE5WNs7HKD5x/4rA=
+=vrf9
+-----END PGP SIGNATURE-----
Added:
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.sha512
==============================================================================
---
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.sha512
(added)
+++
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-bin.tar.gz.sha512
Wed Oct 18 04:59:49 2023
@@ -0,0 +1,4 @@
+hbase-connectors-1.0.1-bin.tar.gz: 29EA45B0 EF153DC4 A5896A84 013F34D8 45B06104
+ D753C63D 89919BF9 CC348BB2 ED718E7A C09E9453
+ 32EFD6DA 9F51CBEA 1644AF65 2DEA9F12 07E51CA0
+ DB4B2397
Added: dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz
==============================================================================
Binary file - no diff available.
Propchange:
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz
------------------------------------------------------------------------------
svn:mime-type = application/octet-stream
Added: dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.asc
==============================================================================
--- dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.asc
(added)
+++ dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.asc
Wed Oct 18 04:59:49 2023
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCAAdFiEEYVJfGm2bU3nrNAMbCSFVWuk1rVQFAmUvY4UACgkQCSFVWuk1
+rVQqBA/+Ka4KMUWk4O938h6neM/aSTXpOaDlEtmYY/cc3PEsAawD7cNzNmdV+CPg
+7fJ1FxuQELISoPTVb02rNhcPs6jh5iKuN2lsFd9bnN5gHfhHAMV4iX312mOAJNB1
+LLT4CFNyAAkObdthwl0Q/jlSpRf3kUwifJYMZMCGTHt1qvkQjTDILTEuUGGjjgts
+4NzMjvIOtlz8NiU0sWLwF8+RLKzX1ijIY7Uw1wit1qZvCa7wn53QxiH+/0Ow//bf
+Ir6HBL1TorsgDPT1H6jL38qliYNjhVCbjAQZYYc7kHmFIOyYGZZfIYxl8W6GiDEt
+J4wcRdhKcVzUP9hMT9eoo95+J1SSiCKymtrmyxa1UV5SuQlceMQl7bE/+VXb7iXb
+TZyYJci9XHmf9GCiYBPJ2EubKvO7bPBHFq2tkSlqpdtDPzwwTkrgNUmxIM4V93dy
+PAR5GRo4IyeT/WDopA3joo15Uxw1/61TfsbelKnnfqtainMdbTh5I3Jv1aXYUkZk
+Vl32oKgJ4Or52uHYYSJO5eds3wXe+g7ZI7O1EKGEeQQ8XhAragY5sf+F1pVxwsXB
+87fTcb2fLOxDgMqcZBZXQJXDJi1e6Q1f7VtslskrbHf/tg4evlM+nm9SpOBgRrZJ
+iEkZKyglHcg6iQ7Ey9H6tjdJynsqWmI3v6iouvSqxhP9sOdZD8Y=
+=wtoe
+-----END PGP SIGNATURE-----
Added:
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.sha512
==============================================================================
---
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.sha512
(added)
+++
dev/hbase/hbase-connectors-1.0.1RC0/hbase-connectors-1.0.1-src.tar.gz.sha512
Wed Oct 18 04:59:49 2023
@@ -0,0 +1,4 @@
+hbase-connectors-1.0.1-src.tar.gz: F48AC5A6 770F0DF3 0AE262D9 EE6D13B3 62C9F362
+ 279F8191 28E081CC D524A8A3 58B3BCAA 28C4A594
+ F1E101FB B5337E61 DA6D6EBD C93E435B 665394FC
+ 11492F24
