[jira] [Comment Edited] (YARN-5123) SQL based RM state store
[ https://issues.apache.org/jira/browse/YARN-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295155#comment-15295155 ] Lavkesh Lahngir edited comment on YARN-5123 at 5/22/16 11:28 AM: - Few comments: 1. We applied this in hdp2.2.4 which is essentially hadoop-2.6.0 or similar. 2. Before applying this to higher versions, we need to check, if there are any API changes. 3. For this patch to work, Postgres jar should be present in the RM classpath. 4. See YarnConfiguration for the new configurations. 5. Make sure that the javac version is 1.7 or higher. was (Author: lavkesh): Few comments: 1. We applied this in hdp2.2.4 which is essentially hadoop-2.6.0 or similar. 2. Before applying this to higher versions, we need to check, if there are any API changes. 3. For this patch to work, postgres jar should be present in the RM classpath. 4. See YarnConfiguration for new configurations. > SQL based RM state store > > > Key: YARN-5123 > URL: https://issues.apache.org/jira/browse/YARN-5123 > Project: Hadoop YARN > Issue Type: New Feature >Affects Versions: 2.6.0 >Reporter: Lavkesh Lahngir > Attachments: sqlstatestore.patch > > > In our setup, zookeeper based RM state store didn't work. We ended up > implementing our own SQL based state store. Here is a patch, if anybody else > wants to use it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-5123) SQL based RM state store
[ https://issues.apache.org/jira/browse/YARN-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295166#comment-15295166 ] Lavkesh Lahngir edited comment on YARN-5123 at 5/21/16 6:02 PM: Config definitions. RM_DB_TYPE -> it's the name of jdbc driver, in our case it would be "postgresql". RM_DB_HOST -> DB host name. RM_DB_DBNAME -> Database name. RM_DB_USERNAME -> Database user. RM_DB_PASSWORD -> Database password. RM_DB_PASSWORD_FILE -> Password file from which the state store will read the password. In our setup we have password file with special permission. If the password file is not provided, the value of RM_DB_PASSWORD will be used. RM_DB_RETRIES -> number of retries before any DB operation is given up. If these retries are exhausted RM will go on stand by. DEFAULT_RM_DB_RETRIES -> Default retries RM_DB_RETRIES_INTERVAL -> Fixed interval between retries DEFAULT_RM_DB_RETRIES_INTERVAL -> Default interval for retries in seconds. RM_DB_VERIFICATION_TIMEOUT -> A timeout interval in milliseconds for the verification thread which keeps checking the status of active RM. DEFAULT_RM_DB_VERIFICATION_TIMEOUT -> Default verification timeout was (Author: lavkesh): RM_DB_TYPE -> it's the name of jdbc driver, in our case it would be "postgresql". RM_DB_HOST -> DB host name. RM_DB_DBNAME -> Database name. RM_DB_USERNAME -> Database user. RM_DB_PASSWORD -> Database password. RM_DB_PASSWORD_FILE -> Password file from which the state store will read the password. In our setup we have password file with special permission. If the password file is not provided, the value of RM_DB_PASSWORD will be used. RM_DB_RETRIES -> number of retries before any DB operation is given up. If these retries are exhausted RM will go on stand by. DEFAULT_RM_DB_RETRIES -> Default retries RM_DB_RETRIES_INTERVAL -> Fixed interval between retries DEFAULT_RM_DB_RETRIES_INTERVAL -> Default interval for retries in seconds. RM_DB_VERIFICATION_TIMEOUT -> A timeout interval in milliseconds for the verification thread which keeps checking the status of active RM. DEFAULT_RM_DB_VERIFICATION_TIMEOUT -> Default verification timeout > SQL based RM state store > > > Key: YARN-5123 > URL: https://issues.apache.org/jira/browse/YARN-5123 > Project: Hadoop YARN > Issue Type: New Feature >Affects Versions: 2.6.0 >Reporter: Lavkesh Lahngir > Attachments: sqlstatestore.patch > > > In our setup, zookeeper based RM state store didn't work. We ended up > implementing our own SQL based state store. Here is a patch, if anybody else > wants to use it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
