[
https://issues.apache.org/jira/browse/PHOENIX-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264745#comment-17264745
]
Viraj Jasani commented on PHOENIX-6314:
---------------------------------------
4.16.0 discrepancies:
{code:java}
$ python3 dev/misc_utils/git_jira_fix_version_check.py
First commit hash to start excluding commits from history:
a2adf5e572c5a4bcccee7f8ac43bad6b84293ec6
Fix Version: 4.16.0
Check git status output and verify expected branch
On branch 4.x
Your branch is up to date with 'origin/4.x'.
Untracked files:
(use "git add <file>..." to include in what will be committed)
dev/misc_utils/
nothing added to commit but untracked files present (use "git add" to track)
Jira/Git commit message diff starting:
##############################################
Jira not present with version: 4.16.0. Commit:
96f7a28aacff1828c425fe50f7fef43641910e1f PHOENIX-6120 Addendum for license
header
Jira not present with version: 4.16.0. Commit:
67268793412789e3806664f90845e074b1f21a36 PHOENIX-6219 GlobalIndexChecker
doesn't work for SingleCell indexes
Jira not present with version: 4.16.0. Commit:
ad70231581506dc954f6d27df43778343de8fbc0 PHOENIX-6120 Change IndexMaintainer
for SINGLE_CELL_ARRAY_WITH_OFFSETS indexes
Jira not present with version: 4.16.0. Commit:
182a6015ee5aa17110a17f862cf98f0934d1aca1 PHOENIX-6220 CREATE INDEX shouldn't
ignore IMMUTABLE_STORAGE_SCHEME and COLUMN_ENDCODED_BYTES
Jira not present with version: 4.16.0. Commit:
8a764813e4e4c9aa421923dc530a52d1bf8b4301 PHOENIX-6276: Log when hconnection is
getting closed in ConnectionQueryServicesImpl
Jira not present with version: 4.16.0. Commit:
976d7751f0a3e5273d41de8465e228c6574d6033 PHOENIX-6276: Log when hconnection is
getting closed in ConnectionQueryServicesImpl
Jira is not resolved yet? Commit:
237b7248dafe51087a8a95aa5bc67e5ce141e89d PHOENIX-6288 Minicluster startup
problems on Jenkins
Jira not present with version: 4.16.0. Commit:
3b6ea0240de9d4a0ad4747c3cd43cac5c949cc23 Merge PHOENIX-6182: IndexTool to
verify and repair every index row (#1022)
Commit seems reverted. Commit:
a3b6d0b410b6eab43cef9fa4fa9074af592f8c81 Revert "PHOENIX-5140
TableNotFoundException occurs when we create local asynchronous index"
Jira is not resolved yet? Commit:
adb5263c9a90baefbb94b0569e37f834595ca0c2 PHOENIX-5140 TableNotFoundException
occurs when we create local asynchronous index get parent physical table name
with colon seperator
Jira not present with version: 4.16.0. Commit:
e1ee29d4e68cefd2639eca88ed27cec0bc714eef [PHOENIX-6213] Extend Cell Tags to
Delete object to store source of operation.
Commit seems reverted. Commit:
a38518d4b3bff131393fe2a753bbf002e49b0f0c Revert "PHOENIX-6223 could not find or
load main class sqline.SqLine"
Jira not present with version: 4.16.0. Commit:
6600c072b49c2acc8ced3a411caca2f295b84eda PHOENIX-6078 Remove Internal Phoenix
Connections from parent LinkedQueue when closed
WARN: Jira not found. Commit:
cd657db52357aa73aabc707f8617cf09d9125d66 fixing white spaces
Commit seems reverted. Commit:
893a05065d7cac58f57e2cb4f6ebc06d32269c5d Revert "PHOENIX-6179 : Relax
maxLookBackAge check during an upgrade"
Jira is not resolved yet? Commit:
9f91707f5f0fe108d316ebda8df8b38aadd63b16 PHOENIX-6083 View index creation does
a checkAndPut on an incorrect row key
Jira not present with version: 4.16.0. Commit:
5b06628709e1dcbf4f4688d1a20fd00c572525db PHOENIX-6202: New column in index gets
added as PK with CASCADE INDEX (#934)
Jira not present with version: 4.16.0. Commit:
fe787bfd594bc80cfd4f133afc9693ee60ae846f PHOENIX-6188 Jenkins job history uses
too much storage (addendum: do not compress Yetus logs)
Jira is not resolved yet? Commit:
264310bd1e6c14996c3cfb11557fc66a012cb01b PHOENIX-5946 (Addendum to use slf4j
logging) (#922)
Jira not present with version: 4.16.0. Commit:
65f1ef6c1c6d58beb4d0e1fe3117bf886c72c5f9 PHOENIX-6188 Jenkins job history uses
too much storage (addendum: gzip artifacts)
Jira not present with version: 4.16.0. Commit:
2e56e0ff33daa1b29d6754cd02b2474083448296 PHOENIX-6188 Jenkins job history uses
too much storage
Jira not present with version: 4.16.0. Commit:
f6a5b939b08cdceb995f9fa166e25741c762bad8 PHOENIX-6160 Simplifying concurrent
mutation handling for global Indexes
Jira not present with version: 4.16.0. Commit:
acb2123f0c84879309054addc20383f4aa2fae9f PHOENIX-6183 Page size tests are not
propagating test override values to server (#914)
Commit seems reverted. Commit:
85bce0517bbfb7456b972e72f537048d0badc2ef Revert missing jira number commit
"Phoenix-pherf writes the result file even disableRuntimeResult flag is true"
WARN: Jira not found. Commit:
4f778ec8df316907910de82f2c1ba8e06bd1cd02 Phoenix-pherf writes the result file
even disableRuntimeResult flag is true
Jira not present with version: 4.16.0. Commit:
54ba102debd5fa39f5134831271d5f8b399a6720 PHOENIX-6055: Not matching index
mutation error needs to report more information rather than first expected
mutation
Jira not present with version: 4.16.0. Commit:
2c702a989ed4e0aa09c2638e5b02eeb3fb4666ef PHOENIX-5261: Implement ALTER TABLE
ADD COLUMN CASCADE (#864)
Jira is not resolved yet? Commit:
5cbb8134033530322ff42f992ea254eb79be6445 PHOENIX-6065 Add OWASP dependency
check, and update the flagged direct dependencies
Jira not present with version: 4.16.0. Commit:
35431837cbd4fc39c1d5f5fc4652776db92c542b PHOENIX-6056 Migrate from
builds.apache.org by August 15 (addendum: use stage level timout instead of
global)
Jira not present with version: 4.16.0. Commit:
bad7aee54370f86996b9e124e48ff8de657ed28e PHOENIX-6056 Migrate from
builds.apache.org by August 15 (addendum: fix node selection, clean up workDir,
really use hbase.profile)
Jira is not resolved yet? Commit:
832464c447c9dc3167a4484a1f485639632d8919 PHOENIX-5946 (Addendum for ASL)
WARN: Jira not found. Commit:
355d95a4762c3ccac1be35659f3c02c385e17b3b Update jacoco plugin version to 0.8.5.
WARN: Jira not found. Commit:
daa6816dcb3ac035bf8553e6bf2ff8a18e80e6e4 Local indexes get out of sync after
changes for global consistent indexes.
Jira is not resolved yet? Commit:
48970e98e8c0038455942a10e0604fba80885ddb PHOENIX-6080: Add a check to Index
Rebuild jobs to check region closing before every inner batch (#860)
Jira not present with version: 4.16.0. Commit:
833ea6ec3075484d8a2595b6fb9ba954295592f9 PHOENIX-6056 Migrate from
builds.apache.org by August 15
Jira not present with version: 4.16.0. Commit:
a99db61cd82ae2b83add2a1bd74fd80baa5c91c7 PHOENIX-6059 Adding more pagination
tests
Jira is not resolved yet? Commit:
bba7d59f81f2b91342fa5a7ee213170739573d6a PHOENIX-5946: Implement
SchemaExtractionTool utility to get effective DDL from the cluster (Co-authored
by Tanuj Khurana)
Jira not present with version: 4.16.0. Commit:
350c928107e3161b1ad507b9d4eaa8bb96ed6555 PHOENIX-6011:ServerCacheClient throw
NullPointerException (#835)
Jira not present with version: 4.16.0. Commit:
6ecc66738e576a5349605c2f5b20003df03f95de PHOENIX-5935 Select with non primary
keys and PHOENIX_ROW_TIMESTAMP() in where clause fails
Jira not present with version: 4.16.0. Commit:
751f944b4b403ce2d13efb5dddf9539c09414b8a PHOENIX-5783: Implement starttime in
IndexTool for rebuild and verification (#789)
Jira not present with version: 4.16.0. Commit:
7107b2bb9d62fa0e103c29f9f0d6ebe1d236c95f PHOENIX-5870: IndexRegionObserver
should retry before mappers in case of rebuild (#770)
Jira is not resolved yet? Commit:
786ce96c8b4fa8f4ad1206b381e82b5bb99646b3 PHOENIX-5876 Let indexTool running
with ONLY option not change index state (#774)
Jira not present with version: 4.16.0. Commit:
c27357978e8df14f9fa97b61e3a246bd12d9d80c PHOENIX-5874: IndexTool does not set
TTL on its log tables correctly (#773)
Jira is not resolved yet? Commit:
6372e95c35f5498e4a2091bffab0e3c77cd984a6 PHOENIX-5872 Close Internal Phoenix
Connections that were running during cancel
Jira not present with version: 4.16.0. Commit:
a4361c52be04ce873a802a4c87b7c34203a48583 PHOENIX-5841 add a counter for
mismatching num of columns
Jira not present with version: 4.16.0. Commit:
b8ba647664c50cc6f677f463f928d3f9bc214766 PHOENIX-5804: Implement strong
verification with -v ONLY option for old design of secondry indexes (#758)
Jira is not resolved yet? Commit:
0c35eb73783db621683751e86887a37ca23414b0 PHOENIX-5496 Ensure that we handle all
server-side mutation codes on the client(for create table)
Jira not present with version: 4.16.0. Commit:
1c3724a2d835e8a77f10f7f817203a51304046eb PHOENIX-5840: IndexTool inline
verification should not fail with -v ONLY option (#760)
Jira is not resolved yet? Commit:
245d286a9ad7b11dd9020fcea225edfb6a3403f1 PHOENIX-5629 Phoenix Function to
Return HBase row timestamp
Jira is not resolved yet? Commit:
339a22d29b3c5f268935c8c013aaa1e1f4bbbf69 PHOENIX-5735 IndexTool's inline
verification should not verify rows beyond max lookback age
Jira not present with version: 4.16.0. Commit:
ff77018d6b09497d1f30d3018ff58b4660b7c59f PHOENIX-5798 IndexUpgrade tool command
line improvements
Jira not present with version: 4.16.0. Commit:
9d133b0489076d712c8d48a5774fe721064b451e PHOENIX-5719 IndexRebuildTaskIT
sometimes fails
Jira not present with version: 4.16.0. Commit:
2555bd9ea563e8c346ffaf2aa24b17ecb6630072 PHOENIX-5814 disable trimStackTrace
Jira not present with version: 4.16.0. Commit:
ba47c5808c2b93943718d0e958306e3623bd99e3 PHOENIX-5816 IndexToolTimeRangeIT
hangs forever
Jira not present with version: 4.16.0. Commit:
4fc2206cdf6649afa9717029d8f28a19649868de PHOENIX-5807 Index rows without empty
column should be treated as unverified
Jira not present with version: 4.16.0. Commit:
000c6a7f2aebf126c9bf4235a9fa29495948b59d PHOENIX-5747 Add upsert tests for
immutable table indexes
Jira is not resolved yet? Commit:
0089788e612289a6632f0a9bc511a6a5cd3c72c4 PHOENIX-5732: Implement endtime in
IndexTool for rebuild and verification
WARN: Jira not found. Commit:
b338f9f866810614db62b4aeab614659dafda9d5 Phoenix-5760 Pherf Support Sequential
Datatypes for INTEGER type fields and have fixed row distribution
Jira not present with version: 4.16.0. Commit:
814723fa6f53615fa3fac230c8f1a2e4615dcabf PHOENIX-5768 Supporting partial
overwrites for immutable tables with indexes
Jira not present with version: 4.16.0. Commit:
a6c4c6100b2eb93edff3abd891bcfb33e18cbb73 PHOENIX-5757 IndexUpgrade tool set
Phoenix query and Hbase rpc timeouts
Jira not present with version: 4.16.0. Commit:
593e662ecba7edfc8704085da9c76987d8cb0172 PHOENIX-5766 PhoenixMetricsIT failure
in 4.x for HBase 1.3
Jira is not resolved yet? Commit:
545330e90c7348fc1245438527d179373012452e PHOENIX-4845 Support using Row Value
Constructors in OFFSET clause for paging in tables where the sort order of PK
columns varies
Jira not present with version: 4.16.0. Commit:
20886148a0f89817bdeafedae55843fc48a3d103 PHOENIX-5743 addendum for multi-column
family indexes
Jira not present with version: 4.16.0. Commit:
36900e8caff49884cb237cd6ae0363d66e207816 PHOENIX-5743 Concurrent read repairs
on the same index row should be idempotent
Jira is not resolved yet? Commit:
1622ef974ccd7d4ecd5d73058a6ff91a18b900c3 PHOENIX-5723
PhoenixIndexImportDirectReducer cleanup method updates index state to active
Jira is not resolved yet? Commit:
09f97e05b68167dc2abab5d632a0d89822e98353 PHOENIX-5714 Upgrade to 4.16 throwing
ColumnNotFoundException
Jira is not resolved yet? Commit:
d11e8511809c941bdcf28889167f01198190ddfd PHOENIX-5629 Phoenix Function to
return HBase row timestamp
Commit seems reverted. Commit:
6507d4597d27d2a81658c24eb773593ce6a50bc1 Revert "PHOENIX-5601 Add a new
Coprocessor - ViewTTLAware Coprocessor"
Jira not present with version: 4.16.0. Commit:
e393eff2a99e5c25c96d569ecf03fc79ee2f6394 PHOENIX-5720 Multiple scans on the
same table region cause incorrect IndexTool counters
Jira is not resolved yet? Commit:
36c642b1f46088f8031a4f7ba5dee9e4ee3427e5 PHOENIX-5713: Incorrectly handled view
and view indexes with/without … (#704)
Jira not present with version: 4.16.0. Commit:
598b61c864354307cd5bd7b3a31c35f971e298fe PHOENIX-5708 GlobalIndexChecker
returns unverified index row cells
Jira not present with version: 4.16.0. Commit:
d524ede43fa136598da7144b10fc0b8ad2a5c67c PHOENIX-5706 IndexTool verification
reports failure when data row has no covered column values
Jira is not resolved yet? Commit:
ced73229eb8e12413d6ce9eeed110e70906af12c PHOENIX-5689: TableNotFoundException
in IndexUpgradeTool in case of v… (#692)
Jira not present with version: 4.16.0. Commit:
5eedfbcc4917d61f141bde824e3f7a0d5bbfbed6 PHOENIX-5618: Addendum patch for NPE
on sourceValue=null
Jira not present with version: 4.16.0. Commit:
f587fee5d6957f7981b1af88e8e1fe1727078158 PHOENIX-5694 Add MR job counters for
IndexTool inline verification (addendum)
Jira not present with version: 4.16.0. Commit:
0f742eef3813110e3ab768b621fa0ffde9fa2626 PHOENIX-5694 Add MR job counters for
IndexTool inline verification
Jira not present with version: 4.16.0. Commit:
fdf54d6e5b767d172c73d99efad4c75b4939f2df PHOENIX-5671 Add tests for ViewUtil
Jira is not resolved yet? Commit:
1ac4aa999007802385f54e0d60b9784d28ac5eda PHOENIX-5675 addendum
Jira is not resolved yet? Commit:
6fcf2f451f8636c70105a7189b80d76a05b32a61 PHOENIX-5675: IndexUpgradeTool should
allow verify options for IndexTool run
Jira is not resolved yet? Commit:
2aa5616e460fca477e8a213ebc0e5025077230f5 PHOENIX-5644 and PHOENIX-5651 addendum
patch
Jira not present with version: 4.16.0. Commit:
0f123bbf8e8b0237cbbc5d975460ab5d495d23f1 PHOENIX-5666 IndexRegionObserver
incorrectly updates PostIndexUpdateFailure metric
Jira not present with version: 4.16.0. Commit:
9dde22d57ae047dec0109451d4a10ce83ef28fb1 PHOENIX-5658 IndexTool to verify index
rows inline (addendum - removed unused the only-verify option)
Jira is not resolved yet? Commit:
3784d2c5e76ddbdae37642a9911b2a9b8f36a4f2 PHOENIX-5651: IndexScrutiny does not
handle TTL/row-expiry
Jira not present with version: 4.16.0. Commit:
c47a14531699f9a113687f6836a92d9a73357d2f PHOENIX-5658 IndexTool to verify index
rows inline
Jira not present with version: 4.16.0. Commit:
ef82f6ca558a2ac6a955041439a8af4ad272e454 PHOENIX-5668: Add Full table name to
the error message for constraint violation exceptions
WARN: Jira not found. Commit:
ba6441a4ce901b61fe8e5313b7114af272eee2f6 PHOENIX: 5630
MAX_MUTATION_SIZE_EXCEEDED and MAX_MUTATION_SIZE_BYTES_EXCEEDED SQLExceptions
should print existing size
Jira is not resolved yet? Commit:
4d19e6b482813c38614fde8445cf612be1d88d23 PHOENIX-5644: IndexUpgradeTool should
sleep only once if there is at least one immutable table provided
Commit seems reverted. Commit:
02d5935cbbd75ad2491413042e5010bb76ed57c8 Revert "PHOENIX-5616 Speed up
ParameterizedIndexUpgradeToolIT."
WARN: Jira not found. Commit:
7febd534cbb667416bdd92bf967453d9dfeadb59 Prepare for 4.16.0 development
iteration
Found first commit hash after which git history is redundant. commit:
a2adf5e572c5a4bcccee7f8ac43bad6b84293ec6
Exiting successfully
Jira/Git commit message diff completed:
##############################################
{code}
> Utility to identify git commit / Jira fixVersion discrepancies for RC
> preparation
> ---------------------------------------------------------------------------------
>
> Key: PHOENIX-6314
> URL: https://issues.apache.org/jira/browse/PHOENIX-6314
> Project: Phoenix
> Issue Type: Task
> Affects Versions: 5.0.0, 4.15.0
> Reporter: Viraj Jasani
> Assignee: Viraj Jasani
> Priority: Major
> Fix For: 5.1.0, 4.16.0
>
>
> As part of RC preparation, we need to identify all git commits that landed
> on release branch, however their corresponding Jira is either not resolved
> yet or does not contain expected fixVersions. Only when we have git commits
> and corresponding Jiras with expected fixVersion resolved, we get all such
> Jiras included in auto-generated CHANGES.md as per Yetus changelog generator.
> Proposal of this Jira is to provide such script that can be useful for all
> upcoming RC preparations and list down all Jiras where we need manual
> intervention. This utility script should use Jira API to retrieve individual
> fields and use git log to loop through commit history.
> The script should identify these issues:
> # commit is reverted as per commit message
> # commit does not contain Jira number format PHOENIX-XXXX in message
> # Jira does not have expected fixVersion
> # Jira has expected fixVersion, but it is not yet resolved
> It can take inputs as:
> # First commit hash to start excluding commits from history
> # Fix Version
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
