[
https://issues.apache.org/jira/browse/GOBBLIN-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kip Kohn updated GOBBLIN-1977:
------------------------------
Description:
Despite not changing our job's properties, we found it failing to connect to
the DB:
{code}
2023-12-07 11:21:41 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
2023-12-07 11:21:42 PST ERROR [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.pool.HikariPool -
HikariPool-1-MysqlStateStore-redacted_db_name - Exception during pool
initialization.
java.sql.SQLException: Access denied for user 'redacted_db_name'@'10.1.2.3'
(using password: YES)
at
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
at
com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
...
{code}
on previously successful runs, logging showed:
{code}
2023-12-07 15:24:55 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
2023-12-07 15:24:56 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Start completed.
...
{code}
throughout we supplied our DB password as:
{code}
state.store.db.password=ENC(rEdActeD=)
...
encrypt.key.loc=/path/to/master/key
...
{code}
the issue wound up being that the master key path was removed from the FS.
this would have been significantly easier to diagnose if the `PasswordManager`
had logged this discovery upon detection, rather than silently skipping the
configured path, upon finding the file not to exist.
was:
Despite not changing our job's properties, we found it failing to connect to
the DB:
{code}
2023-12-07 11:21:41 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
2023-12-07 11:21:42 PST ERROR [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.pool.HikariPool -
HikariPool-1-MysqlStateStore-redacted_db_name - Exception during pool
initialization.
java.sql.SQLException: Access denied for user 'redacted_db_name'@'10.1.2.3'
(using password: YES)
at
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
at
com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
...
{code}
on previously successful runs, logging showed:
{code}
2023-12-07 15:24:55 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
2023-12-07 15:24:56 PST INFO [TaskStateModelFactory-task_thread-0]
com.zaxxer.hikari.HikariDataSource -
HikariPool-1-MysqlStateStore-redacted_db_name - Start completed.
...
{code}
throughout we were supplied our DB password as:
{code}
state.store.db.password=ENC(rEdActeD=)
...
encrypt.key.loc=/path/to/master/key
...
{code}
the issue wound up being that the master password path was removed from the FS.
this would have been significantly easier to diagnose if the `PasswordManager`
had logged this discovery upon detection, rather than silently skipping the
configured path, after finding the file not to exist.
> `PasswordManager` should log when configured master password file does not
> exist
> --------------------------------------------------------------------------------
>
> Key: GOBBLIN-1977
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1977
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-core
> Reporter: Kip Kohn
> Assignee: Abhishek Tiwari
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Despite not changing our job's properties, we found it failing to connect to
> the DB:
> {code}
> 2023-12-07 11:21:41 PST INFO [TaskStateModelFactory-task_thread-0]
> com.zaxxer.hikari.HikariDataSource -
> HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
> 2023-12-07 11:21:42 PST ERROR [TaskStateModelFactory-task_thread-0]
> com.zaxxer.hikari.pool.HikariPool -
> HikariPool-1-MysqlStateStore-redacted_db_name - Exception during pool
> initialization.
> java.sql.SQLException: Access denied for user 'redacted_db_name'@'10.1.2.3'
> (using password: YES)
> at
> com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
> at
> com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
> ...
> {code}
> on previously successful runs, logging showed:
> {code}
> 2023-12-07 15:24:55 PST INFO [TaskStateModelFactory-task_thread-0]
> com.zaxxer.hikari.HikariDataSource -
> HikariPool-1-MysqlStateStore-redacted_db_name - Starting...
> 2023-12-07 15:24:56 PST INFO [TaskStateModelFactory-task_thread-0]
> com.zaxxer.hikari.HikariDataSource -
> HikariPool-1-MysqlStateStore-redacted_db_name - Start completed.
> ...
> {code}
> throughout we supplied our DB password as:
> {code}
> state.store.db.password=ENC(rEdActeD=)
> ...
> encrypt.key.loc=/path/to/master/key
> ...
> {code}
> the issue wound up being that the master key path was removed from the FS.
> this would have been significantly easier to diagnose if the
> `PasswordManager` had logged this discovery upon detection, rather than
> silently skipping the configured path, upon finding the file not to exist.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)