Change in asterixdb[master]: Remove static cc application context instance
Jenkins has posted comments on this change. Change subject: Remove static cc application context instance .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/88/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1606 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia2e250405967ec880e7af6387aa981f39b3392c0 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Remove static cc application context instance
Jenkins has posted comments on this change. Change subject: Remove static cc application context instance .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4766/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1606 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia2e250405967ec880e7af6387aa981f39b3392c0 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Remove static cc application context instance
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1606 Change subject: Remove static cc application context instance .. Remove static cc application context instance Change-Id: Ia2e250405967ec880e7af6387aa981f39b3392c0 --- M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveJobNotificationHandler.java M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveLifecycleListener.java M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/ActiveSourceOperatorNodePushable.java M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActiveManagerMessage.java M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActivePartitionMessage.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/InvertedIndexPOperator.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/jobgen/QueryLogicalExpressionJobGen.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/AbstractLangTranslator.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/IStatementExecutorFactory.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/APIFramework.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AppRuntimeContextProviderForRecovery.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/AbstractQueryApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ClusterApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ConnectorApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/DdlApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/DiagnosticsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/FullApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryResultApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryServiceServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryStatusApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/QueryWebInterfaceServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/RestApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ResultUtil.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/UpdateApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/VersionApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/java/AsterixJavaClient.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/cc/ResourceIdManager.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/BindMetadataNodeTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/CheckpointTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/ExternalLibrarySetupTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/LocalRecoveryTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/MetadataBootstrapTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/RemoteRecoveryTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/StartFailbackTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/StartLifecycleComponentsTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/task/StartReplicationServiceTask.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/AutoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/FaultToleranceStrategyFactory.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/MetadataNodeFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/NoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/CompleteFailbackRequestMessage.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/CompleteFailbackResponseMessage.java M
Change in asterixdb[master]: Remove Extraneous Quotes in Start Sample Batchfile
Jenkins has posted comments on this change. Change subject: Remove Extraneous Quotes in Start Sample Batchfile .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/87/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1605 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I24581eb36e193628b93cb5be52903beb206c603d Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Remove Extraneous Quotes in Start Sample Batchfile
Jenkins has posted comments on this change. Change subject: Remove Extraneous Quotes in Start Sample Batchfile .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4765/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1605 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I24581eb36e193628b93cb5be52903beb206c603d Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Remove Extraneous Quotes in Start Sample Batchfile
Michael Blow has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1605 Change subject: Remove Extraneous Quotes in Start Sample Batchfile .. Remove Extraneous Quotes in Start Sample Batchfile e.g. "--" "Mon 03/20/2017 19:31:01.81" "--" Change-Id: I24581eb36e193628b93cb5be52903beb206c603d --- M asterixdb/asterix-server/src/main/opt/local/bin/start-sample-cluster.bat 1 file changed, 3 insertions(+), 3 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/05/1605/1 diff --git a/asterixdb/asterix-server/src/main/opt/local/bin/start-sample-cluster.bat b/asterixdb/asterix-server/src/main/opt/local/bin/start-sample-cluster.bat index fce27a9..60f5cb5 100644 --- a/asterixdb/asterix-server/src/main/opt/local/bin/start-sample-cluster.bat +++ b/asterixdb/asterix-server/src/main/opt/local/bin/start-sample-cluster.bat @@ -102,9 +102,9 @@ goto :post_timestamp :timestamp -echo "--" >> %1 -echo "%date% %time%" >> %1 -echo "--" >> %1 +echo -- >> %1 +echo %date% %time% >> %1 +echo -- >> %1 exit /B 0 :post_timestamp -- To view, visit https://asterix-gerrit.ics.uci.edu/1605 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I24581eb36e193628b93cb5be52903beb206c603d Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael Blow
Change in asterixdb[master]: Log Message When Applying Logging Level
Michael Blow has submitted this change and it was merged. Change subject: Log Message When Applying Logging Level .. Log Message When Applying Logging Level Log a message when resetting the log level, to indicate when the loggers are being configured and with what level Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Reviewed-on: https://asterix-gerrit.ics.uci.edu/1604 Sonar-Qube: JenkinsTested-by: Jenkins BAD: Jenkins Reviewed-by: Till Westmann Integration-Tests: Jenkins --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/BaseCCApplication.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/BaseNCApplication.java 6 files changed, 33 insertions(+), 6 deletions(-) Approvals: Till Westmann: Looks good to me, approved Jenkins: Verified; No violations found; No violations found; Verified diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java index 183a0ed..a0b4a2a 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java @@ -165,9 +165,6 @@ @Override public void initialize(boolean initialRun) throws IOException, ACIDException { - Logger.getLogger("org.apache.asterix").setLevel(externalProperties.getLogLevel()); - Logger.getLogger("org.apache.hyracks").setLevel(externalProperties.getLogLevel()); - ioManager = ncServiceContext.getIoManager(); threadExecutor = new ThreadExecutor(ncServiceContext.getThreadFactory()); fileMapManager = new FileMapManager(ioManager); diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java index fcc6f1f..55de9c7 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java @@ -106,6 +106,8 @@ ICCMessageBroker messageBroker = new CCMessageBroker(controllerService); this.ccServiceCtx = (ICCServiceContext) serviceCtx; + configureLoggingLevel(ccServiceCtx.getAppConfig().getLoggingLevel(ExternalProperties.Option.LOG_LEVEL)); + if (LOGGER.isLoggable(Level.INFO)) { LOGGER.info("Starting Asterix cluster controller"); } @@ -148,6 +150,13 @@ jobCapacityController = new JobCapacityController(controllerService.getResourceManager()); } +@Override +protected void configureLoggingLevel(Level level) { +super.configureLoggingLevel(level); +LOGGER.info("Setting Asterix log level to " + level); +Logger.getLogger("org.apache.asterix").setLevel(level); +} + protected List getExtensions() { return AppContextInfo.INSTANCE.getExtensionProperties().getExtensions(); } diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java index aac7bc3..aaf3d7a 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java @@ -31,6 +31,7 @@ import org.apache.asterix.common.api.IAppRuntimeContext; import org.apache.asterix.common.config.AsterixExtension; import org.apache.asterix.common.config.ClusterProperties; +import org.apache.asterix.common.config.ExternalProperties; import org.apache.asterix.common.config.IPropertiesProvider; import org.apache.asterix.common.config.MessagingProperties; import org.apache.asterix.common.config.MetadataProperties; @@ -83,6 +84,7 @@ if (LOGGER.isLoggable(Level.INFO)) { LOGGER.info("Starting Asterix node controller: " + nodeId); } + configureLoggingLevel(ncServiceCtx.getAppConfig().getLoggingLevel(ExternalProperties.Option.LOG_LEVEL)); final NodeControllerService
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2260/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Till Westmann has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 3: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2259/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/853/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2261/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2258/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2257/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 3: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/852/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/853/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2260/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
[jira] [Created] (ASTERIXDB-1851) Intermittent Dataset KeyVerse.KVStore is currently being fed into by the following active entities failure
Michael Blow created ASTERIXDB-1851: --- Summary: Intermittent Dataset KeyVerse.KVStore is currently being fed into by the following active entities failure Key: ASTERIXDB-1851 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1851 Project: Apache AsterixDB Issue Type: Bug Components: Feeds Reporter: Michael Blow See https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/org.apache.asterix$asterix-app/85/testReport/junit/org.apache.asterix.test.runtime/AqlExecutionTest/test_AqlExecutionTest_13__feeds__change_feed_with_meta_pk_in_meta_index_with_missing_after_ingest_/ STACKTRACE: org.apache.asterix.common.exceptions.CompilationException: Dataset KeyVerse.KVStore is currently being fed into by the following active entities. KeyVerse.KVChangeStream(Feed) at org.apache.asterix.app.translator.QueryTranslator.validateIfResourceIsActiveInFeed(QueryTranslator.java:698) at org.apache.asterix.app.translator.QueryTranslator.handleCreateIndexStatement(QueryTranslator.java:889) at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:284) at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:241) at org.apache.asterix.api.http.server.RestApiServlet.doHandle(RestApiServlet.java:202) at org.apache.asterix.api.http.server.RestApiServlet.getOrPost(RestApiServlet.java:173) at org.apache.asterix.api.http.server.RestApiServlet.post(RestApiServlet.java:162) at org.apache.hyracks.http.server.AbstractServlet.handle(AbstractServlet.java:76) at org.apache.hyracks.http.server.HttpRequestHandler.handle(HttpRequestHandler.java:70) at org.apache.hyracks.http.server.HttpRequestHandler.call(HttpRequestHandler.java:55) at org.apache.hyracks.http.server.HttpRequestHandler.call(HttpRequestHandler.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/86/ (3/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 3: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/852/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 3: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2259/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1841: Fix Inverted Index Drop Operator
Till Westmann has posted comments on this change. Change subject: ASTERIXDB-1841: Fix Inverted Index Drop Operator .. Patch Set 1: (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/1600/1/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/IndexUtil.java File asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/IndexUtil.java: PS1, Line 102: Lists.newArrayList(index) Would it work to use Java's Collections.singletonList here? -- To view, visit https://asterix-gerrit.ics.uci.edu/1600 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: Yes
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4764/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/85/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Jenkins has posted comments on this change. Change subject: Log Message When Applying Logging Level .. Patch Set 1: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1604 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Log Message When Applying Logging Level
Michael Blow has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1604 Change subject: Log Message When Applying Logging Level .. Log Message When Applying Logging Level Log a message when resetting the log level, to indicate when the loggers are being configured and with what level Change-Id: I38d939a464cc4ea0e5ec9cca88838f083677cf5e --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/AppContextInfo.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/BaseCCApplication.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/BaseNCApplication.java 6 files changed, 33 insertions(+), 6 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/04/1604/1 diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java index 183a0ed..a0b4a2a 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java @@ -165,9 +165,6 @@ @Override public void initialize(boolean initialRun) throws IOException, ACIDException { - Logger.getLogger("org.apache.asterix").setLevel(externalProperties.getLogLevel()); - Logger.getLogger("org.apache.hyracks").setLevel(externalProperties.getLogLevel()); - ioManager = ncServiceContext.getIoManager(); threadExecutor = new ThreadExecutor(ncServiceContext.getThreadFactory()); fileMapManager = new FileMapManager(ioManager); diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java index fcc6f1f..55de9c7 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java @@ -106,6 +106,8 @@ ICCMessageBroker messageBroker = new CCMessageBroker(controllerService); this.ccServiceCtx = (ICCServiceContext) serviceCtx; + configureLoggingLevel(ccServiceCtx.getAppConfig().getLoggingLevel(ExternalProperties.Option.LOG_LEVEL)); + if (LOGGER.isLoggable(Level.INFO)) { LOGGER.info("Starting Asterix cluster controller"); } @@ -148,6 +150,13 @@ jobCapacityController = new JobCapacityController(controllerService.getResourceManager()); } +@Override +protected void configureLoggingLevel(Level level) { +super.configureLoggingLevel(level); +LOGGER.info("Setting Asterix log level to " + level); +Logger.getLogger("org.apache.asterix").setLevel(level); +} + protected List getExtensions() { return AppContextInfo.INSTANCE.getExtensionProperties().getExtensions(); } diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java index aac7bc3..aaf3d7a 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplication.java @@ -31,6 +31,7 @@ import org.apache.asterix.common.api.IAppRuntimeContext; import org.apache.asterix.common.config.AsterixExtension; import org.apache.asterix.common.config.ClusterProperties; +import org.apache.asterix.common.config.ExternalProperties; import org.apache.asterix.common.config.IPropertiesProvider; import org.apache.asterix.common.config.MessagingProperties; import org.apache.asterix.common.config.MetadataProperties; @@ -83,6 +84,7 @@ if (LOGGER.isLoggable(Level.INFO)) { LOGGER.info("Starting Asterix node controller: " + nodeId); } + configureLoggingLevel(ncServiceCtx.getAppConfig().getLoggingLevel(ExternalProperties.Option.LOG_LEVEL)); final NodeControllerService controllerService = (NodeControllerService) ncServiceCtx.getControllerService(); @@ -124,6 +126,12 @@ performLocalCleanUp(); } +@Override +protected void configureLoggingLevel(Level level) { +super.configureLoggingLevel(level); +Logger.getLogger("org.apache.asterix").setLevel(level); +} + protected
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/84/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1603 to look at the new patch set (#3). Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Make aws scripts work with all latest instance types that are equiped with instance-stores. Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 --- M asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml A asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/mount.yml 8 files changed, 114 insertions(+), 49 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/03/1603/3 -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2258/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2256/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2257/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4762/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Yingyi Bu has uploaded a new patch set (#2). Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Make aws scripts work with all latest instance types that are equiped with instance-stores. Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 --- M asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml A asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/mount.yml 8 files changed, 114 insertions(+), 49 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/03/1603/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Till Westmann has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: (1 comment) Add a test case? https://asterix-gerrit.ics.uci.edu/#/c/1602/1/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java File hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java: PS1, Line 88: DefaultHttpResponse badRequest = : new DefaultHttpResponse(request.protocolVersion(), HttpResponseStatus.BAD_REQUEST); : ctx.write(badRequest).addListener(ChannelFutureListener.CLOSE); Should we have a single method (e.g. respondWithStatus) that takes a status code and does the rest? -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: Yes
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/82/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Yingyi Bu has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1603 Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Make aws scripts work with all latest instance types that are equiped with instance-stores. Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 --- M asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml A asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/mount.yml 8 files changed, 110 insertions(+), 49 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/03/1603/1 diff --git a/asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml b/asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml index 13de7cd..e1d005d 100644 --- a/asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml +++ b/asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml @@ -19,7 +19,7 @@ - hosts: [localhost,] vars: - temp_dir: "/tmp/asterixdb" + temp_dir: "../conf/instance" inventory: "{{ temp_dir }}/inventory" ccconf: "{{ temp_dir }}/cc.conf" tasks: diff --git a/asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml b/asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml index 9d371d2..66fd79c 100644 --- a/asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml +++ b/asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml @@ -19,7 +19,7 @@ - name: Copy cluster config to CC synchronize: -src: /tmp/asterixdb/cc.conf +src: ../conf/instance/cc.conf dest: "{{ binarydir }}/cc.conf" - name: Update cluster config diff --git a/asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh b/asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh new file mode 100755 index 000..dd22394 --- /dev/null +++ b/asterixdb/asterix-server/src/main/opt/aws/bin/gen_volumes.sh @@ -0,0 +1,37 @@ +#!/bin/bash +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# + + +count=$1 +dest=$2 + +if [ $count -le 0 ] +then +printf "vols: []\n" >$dest +exit 0 +fi + +printf "vols:\n" >$dest + +for i in $(seq 1 $count) +do + printf ' - { device_name: /dev/xvd%c, ephemeral: ephemeral%d }\n' `printf "\x$(printf %x \`expr 97 + $i\`)"` \ +$(($i-1)) >> $dest +done diff --git a/asterixdb/asterix-server/src/main/opt/aws/bin/start.sh b/asterixdb/asterix-server/src/main/opt/aws/bin/start.sh index a836b4e..8bffaa4 100755 --- a/asterixdb/asterix-server/src/main/opt/aws/bin/start.sh +++ b/asterixdb/asterix-server/src/main/opt/aws/bin/start.sh @@ -30,7 +30,7 @@ ansible-playbook -i "localhost," $AWS_PATH/yaml/aws_start.yml # Generates an Ansible inventory file and an AsterixDB configuration file. -temp=/tmp/asterixdb +temp=$AWS_PATH/conf/instance inventory=$temp/inventory # Installs asterixdb on all AWS instances. diff --git a/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml b/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml index e0a060e..72b3d63 100644 --- a/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml +++ b/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml @@ -1,37 +1,50 @@ -one_ephemeral: - - { device_name: /dev/xvdb, ephemeral: ephemeral0 } -two_ephemeral: - - { device_name: /dev/xvdb, ephemeral: ephemeral0 } - - { device_name: /dev/xvdc, ephemeral: ephemeral1 } -three_ephemeral: - - { device_name: /dev/xvdb, ephemeral: ephemeral0 } - - { device_name: /dev/xvdc, ephemeral: ephemeral1 } - - { device_name: /dev/xvdd, ephemeral: ephemeral2 } -four_ephemeral: - - { device_name: /dev/xvdb,
Change in asterixdb[master]: Make aws scripts work with all latest instance types that ar...
Jenkins has posted comments on this change. Change subject: Make aws scripts work with all latest instance types that are equiped with instance-stores. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4761/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1603 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2255/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/850/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/851/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2256/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Expose TwitterFirehose Stream to Users
Jenkins has posted comments on this change. Change subject: Expose TwitterFirehose Stream to Users .. Patch Set 4: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2254/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1590 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
[jira] [Created] (ASTERIXDB-1850) Unknown license for asterix-external-data/src/test/resources/record.json
Michael Blow created ASTERIXDB-1850: --- Summary: Unknown license for asterix-external-data/src/test/resources/record.json Key: ASTERIXDB-1850 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1850 Project: Apache AsterixDB Issue Type: Bug Reporter: Michael Blow It is unclear what the license is for the twitter data here: asterixdb/asterix-external-data/src/test/resources/record.json It should be determined whether or not it is OK to include in the source assembly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/81/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
Jenkins has posted comments on this change. Change subject: Send Bad-request response on failure of decoding query string .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4760/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1602 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 3: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/80/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1597 to look at the new patch set (#3). Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Index-Only Plan Patch Set 4: modifies SearchOpCallBack - Modifies the SearchOperationCallBack classes to support the canceling of the proceed() function since there are some cases that the effect of proceed() need to be canceled. (e.g., antimatter tuple found). - Modifies the LSM Index Searcher classes to reflect the above change. Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b --- M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/LockThenSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/PrimaryIndexInstantSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/PrimaryIndexSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/SecondaryIndexSearchOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-btree/src/main/java/org/apache/hyracks/storage/am/btree/impls/BTreeRangeSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ISearchOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/impls/NoOpOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreePointSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreeRangeSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/LSMIndexSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndexSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-rtree/src/main/java/org/apache/hyracks/storage/am/lsm/rtree/impls/LSMRTreeWithAntiMatterTuplesSearchCursor.java M hyracks-fullstack/hyracks/hyracks-test-support/src/main/java/org/apache/hyracks/storage/am/btree/AbstractSearchOperationCallbackTest.java M hyracks-fullstack/hyracks/hyracks-test-support/src/main/java/org/apache/hyracks/storage/am/common/TestOperationCallback.java M hyracks-fullstack/hyracks/hyracks-tests/hyracks-storage-am-lsm-btree-test/src/test/java/org/apache/hyracks/storage/am/lsm/btree/LSMBTreeSearchOperationCallbackTest.java 15 files changed, 286 insertions(+), 126 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/97/1597/3 -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4759/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Send Bad-request response on failure of decoding query string
abdullah alamoudi has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1602 Change subject: Send Bad-request response on failure of decoding query string .. Send Bad-request response on failure of decoding query string Change-Id: I7aa000e469392a5e4b079b331472edd0dc4f65a4 --- M hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/BaseRequest.java M hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java 2 files changed, 26 insertions(+), 7 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/02/1602/1 diff --git a/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/BaseRequest.java b/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/BaseRequest.java index d271177..5b354af 100644 --- a/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/BaseRequest.java +++ b/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/BaseRequest.java @@ -22,18 +22,20 @@ import java.util.List; import java.util.Map; -import io.netty.handler.codec.http.QueryStringDecoder; import org.apache.hyracks.http.api.IServletRequest; import org.apache.hyracks.http.server.utils.HttpUtil; import io.netty.handler.codec.http.FullHttpRequest; +import io.netty.handler.codec.http.QueryStringDecoder; public class BaseRequest implements IServletRequest { protected final FullHttpRequest request; protected final Mapparameters; public static IServletRequest create(FullHttpRequest request) throws IOException { -return new BaseRequest(request, new QueryStringDecoder(request.uri()).parameters()); +QueryStringDecoder decoder = new QueryStringDecoder(request.uri()); +Map param = decoder.parameters(); +return new BaseRequest(request, param); } protected BaseRequest(FullHttpRequest request, Map parameters) { diff --git a/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java b/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java index 743800e..364b597 100644 --- a/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java +++ b/hyracks-fullstack/hyracks/hyracks-http/src/main/java/org/apache/hyracks/http/server/HttpServerHandler.java @@ -24,6 +24,7 @@ import java.util.logging.Logger; import org.apache.hyracks.http.api.IServlet; +import org.apache.hyracks.http.api.IServletRequest; import org.apache.hyracks.http.server.utils.HttpUtil; import io.netty.channel.ChannelFutureListener; @@ -60,23 +61,39 @@ @Override protected void channelRead0(ChannelHandlerContext ctx, Object msg) { +FullHttpRequest request = (FullHttpRequest) msg; try { -FullHttpRequest request = (FullHttpRequest) msg; IServlet servlet = server.getServlet(request); if (servlet == null) { DefaultHttpResponse notFound = new DefaultHttpResponse(request.protocolVersion(), HttpResponseStatus.NOT_FOUND); ctx.write(notFound).addListener(ChannelFutureListener.CLOSE); } else { -handler = new HttpRequestHandler(ctx, servlet, HttpUtil.toServletRequest(request), chunkSize); -submit(); +submit(ctx, servlet, request); } } catch (Exception e) { -LOGGER.log(Level.SEVERE, "Failure handling HTTP Request", e); -ctx.close(); +LOGGER.log(Level.SEVERE, "Failure Submitting HTTP Request", e); +DefaultHttpResponse serverError = +new DefaultHttpResponse(request.protocolVersion(), HttpResponseStatus.INTERNAL_SERVER_ERROR); +ctx.write(serverError).addListener(ChannelFutureListener.CLOSE); } } +private void submit(ChannelHandlerContext ctx, IServlet servlet, FullHttpRequest request) throws IOException { +IServletRequest servletRequest; +try { +servletRequest = HttpUtil.toServletRequest(request); +} catch (IllegalArgumentException e) { +LOGGER.log(Level.WARNING, "Failure Decoding Request", e); +DefaultHttpResponse badRequest = +new DefaultHttpResponse(request.protocolVersion(), HttpResponseStatus.BAD_REQUEST); +ctx.write(badRequest).addListener(ChannelFutureListener.CLOSE); +return; +} +handler = new HttpRequestHandler(ctx, servlet, servletRequest, chunkSize); +submit(); +} + private void submit() throws IOException { try {
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/850/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Feed Policy Refactoring
Xikui Wang has posted comments on this change. Change subject: Feed Policy Refactoring .. Patch Set 3: (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/1591/3/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/FeedRuntimeInputHandler.java File asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/dataflow/FeedRuntimeInputHandler.java: Line 23: import java.util.concurrent.atomic.AtomicBoolean; Will remove this in next patch. -- To view, visit https://asterix-gerrit.ics.uci.edu/1591 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ibc10139925cfedee66d1263990ba80b94675f182 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: Yes
Change in asterixdb[master]: Update the Feed Tutorial
Xikui Wang has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 2: Should we have the policy patch merged first and add that as part of the tutorial? -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Carey Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
Steven Jacobs has posted comments on this change. Change subject: ASTERIXDB-1310 Autogenerated uuid .. Patch Set 1: I think the negative test we discussed will be helpful here. -- To view, visit https://asterix-gerrit.ics.uci.edu/1601 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Expose TwitterFirehose Stream to Users
Jenkins has posted comments on this change. Change subject: Expose TwitterFirehose Stream to Users .. Patch Set 4: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/849/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1590 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4758/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 5: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/79/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Hello Till Westmann, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1596 to look at the new patch set (#5). Change subject: Add Active Partition Event Message .. Add Active Partition Event Message Enable active runtimes to send messages to the listener. In addition this change introduces extension locks to metadata lock manager. Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 --- M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActivePartitionMessage.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/entities/Dataset.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/MetadataLockManager.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/service/IControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/Joblet.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerIPCI.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/CleanupJobletWork.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/StartTasksWork.java 12 files changed, 119 insertions(+), 261 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/96/1596/5 -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi
Change in asterixdb[master]: Update the Feed Tutorial
abdullah alamoudi has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 2: can we fix this. we should get it in easily -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Carey Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
abdullah alamoudi has posted comments on this change. Change subject: ASTERIXDB-1310 Autogenerated uuid .. Patch Set 1: (2 comments) https://asterix-gerrit.ics.uci.edu/#/c/1601/1//COMMIT_MSG Commit Message: PS1, Line 11: consisten consistent https://asterix-gerrit.ics.uci.edu/#/c/1601/1/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/parser/ADMDataParser.java File asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/parser/ADMDataParser.java: PS1, Line 580: : : : : : : where do we check that non closed fields are all set? -- To view, visit https://asterix-gerrit.ics.uci.edu/1601 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: Yes
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 4: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/78/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Jenkins has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4757/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Hello Till Westmann, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1596 to look at the new patch set (#4). Change subject: Add Active Partition Event Message .. Add Active Partition Event Message Enable active runtimes to send messages to the listener. In addition this change introduces extension locks to metadata lock manager. Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 --- M asterixdb/asterix-active/src/main/java/org/apache/asterix/active/message/ActivePartitionMessage.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplication.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/entities/Dataset.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/MetadataLockManager.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/service/IControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/Joblet.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerIPCI.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerService.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/CleanupJobletWork.java M hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/StartTasksWork.java 12 files changed, 118 insertions(+), 261 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/96/1596/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi
Change in asterixdb[master]: Expose TwitterFirehose Stream to Users
Jenkins has posted comments on this change. Change subject: Expose TwitterFirehose Stream to Users .. Patch Set 4: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/849/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1590 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Yingyi Bu has submitted this change and it was merged. Change subject: Minor fix for the aws_start script. .. Minor fix for the aws_start script. Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1599 Sonar-Qube: JenkinsTested-by: Jenkins BAD: Jenkins Integration-Tests: Jenkins Reviewed-by: Ian Maxon --- M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml 1 file changed, 5 insertions(+), 3 deletions(-) Approvals: Ian Maxon: Looks good to me, approved Jenkins: Verified; No violations found; No violations found; Verified diff --git a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml index 5287e34..344bfd5 100644 --- a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml +++ b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml @@ -29,8 +29,10 @@ tasks: - include_vars: ../conf/aws_settings.yml - include_vars: ../conf/aws_types.yml -- debug: -msg: "{{ vols }}" + +- name: Clean the temporary directory + shell: rm -rf "{{ temp_dir }}" + - name: Launch all instances ec2: key_name: "{{ keypair }}" @@ -110,7 +112,7 @@ - name: Populate multiple iodevices shell: printf " - /data{{ vol.0 + 1 }}/iodevice\n" >> "{{ temp_dir }}/devices" - with_indexed_items: vols + with_indexed_items: "{{ vols }}" loop_control: loop_var: vol when: vols|length > 0 -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: merged Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi Bu Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: Minor fix for the aws_start script.
Ian Maxon has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Expose TwitterFirehose Stream to Users
Jenkins has posted comments on this change. Change subject: Expose TwitterFirehose Stream to Users .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4756/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1590 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Expose TwitterFirehose Stream to Users
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1590 to look at the new patch set (#4). Change subject: Expose TwitterFirehose Stream to Users .. Expose TwitterFirehose Stream to Users 1. Moved TwitterFirehoseStream from Test to external-data which enables users to access it from interface. 2. Related test cases fix. 3. Code style fix in DataGenerator, TweetGenerator, etc. Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab --- M asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/feeds_07/feeds_07.1.ddl.aql M asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/feeds_08/feeds_08.1.ddl.aql M asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/feeds_09/feeds_09.1.ddl.aql M asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/feeds/feeds_07/feeds_07.1.ddl.sqlpp M asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/feeds/feeds_08/feeds_08.1.ddl.sqlpp M asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/feeds/feeds_09/feeds_09.1.ddl.sqlpp R asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/generator/DataGenerator.java R asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/generator/TweetGenerator.java R asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/TwitterFirehoseInputStream.java R asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/stream/factory/TwitterFirehoseStreamFactory.java M asterixdb/asterix-tools/pom.xml M asterixdb/asterix-tools/src/test/java/org/apache/asterix/tools/external/data/DataGeneratorForSpatialIndexEvaluation.java 12 files changed, 89 insertions(+), 510 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/90/1590/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/1590 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I8f899fde0d9a9dbd7891957be2f1241d5acfc4ab Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
Xikui Wang has posted comments on this change. Change subject: ASTERIXDB-1310 Autogenerated uuid .. Patch Set 1: (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/1601/1/asterixdb/asterix-app/src/test/resources/runtimets/only.xml File asterixdb/asterix-app/src/test/resources/runtimets/only.xml: Line 22: Will remove this after next submit... -- To view, visit https://asterix-gerrit.ics.uci.edu/1601 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Steven Jacobs Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: Yes
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2253/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1310 Autogenerated uuid .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/76/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1601 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1310 Autogenerated uuid .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4755/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1601 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1310 Autogenerated uuid
Xikui Wang has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1601 Change subject: ASTERIXDB-1310 Autogenerated uuid .. ASTERIXDB-1310 Autogenerated uuid 1. Remove ADM optional fields check. 2. Added test case for how to use autogenerated uuid with feed properly. 3. Slight tweaked feed datasource to make the interface consisten with others. Change-Id: Ief4fba8a7227a40c5d22293758cbdf4575b14401 --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java M asterixdb/asterix-app/src/test/resources/runtimets/only.xml A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.1.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.2.update.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.3.server.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.4.sleep.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.5.update.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.6.query.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.7.server.aql A asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.8.ddl.aql A asterixdb/asterix-app/src/test/resources/runtimets/results/feeds/push-socket-with-auuid/push-socket-with-auuid.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/parser/ADMDataParser.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/declared/FeedDataSource.java 14 files changed, 307 insertions(+), 14 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/01/1601/1 diff --git a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java index 46b421b..2ea7c86 100644 --- a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java +++ b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java @@ -261,7 +261,7 @@ keyAccessExpression = null; keyAccessScalarFunctionCallExpression = null; } -FeedDataSource feedDataSource = new FeedDataSource(sourceFeed, aqlId, targetDataset, feedOutputType, metaType, +FeedDataSource feedDataSource = new FeedDataSource(sourceFeed, aqlId, dataset, feedOutputType, metaType, pkTypes, partitioningKeys, keyAccessScalarFunctionCallExpression, sourceFeed.getFeedId(), FeedRuntimeType.valueOf(subscriptionLocation), locations.split(","), context.getComputationNodeDomain(), feedConnection); diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/only.xml b/asterixdb/asterix-app/src/test/resources/runtimets/only.xml index 12b0d83..dd2a635 100644 --- a/asterixdb/asterix-app/src/test/resources/runtimets/only.xml +++ b/asterixdb/asterix-app/src/test/resources/runtimets/only.xml @@ -19,5 +19,10 @@ !--> + + +push-socket-with-auuid + + diff --git a/asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.1.ddl.aql b/asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.1.ddl.aql new file mode 100644 index 000..d234ecf --- /dev/null +++ b/asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/push-socket-with-auuid/push-socket-with-auuid.1.ddl.aql @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +/* + *
Change in asterixdb[master]: ASTERIXDB-1841: Fix Inverted Index Drop Operator
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1841: Fix Inverted Index Drop Operator .. Patch Set 1: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1600 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1841: Fix Inverted Index Drop Operator
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1841: Fix Inverted Index Drop Operator .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/75/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1600 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1841: Fix Inverted Index Drop Operator
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1841: Fix Inverted Index Drop Operator .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4754/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1600 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1841: Fix Inverted Index Drop Operator
Murtadha Hubail has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1600 Change subject: ASTERIXDB-1841: Fix Inverted Index Drop Operator .. ASTERIXDB-1841: Fix Inverted Index Drop Operator Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java A asterixdb/asterix-installer/src/test/resources/transactionts/queries/dml_after_restart/multiple_secondary_indices/multiple_secondary_indices.1.script.aql A asterixdb/asterix-installer/src/test/resources/transactionts/queries/dml_after_restart/multiple_secondary_indices/multiple_secondary_indices.2.ddl.aql A asterixdb/asterix-installer/src/test/resources/transactionts/queries/dml_after_restart/multiple_secondary_indices/multiple_secondary_indices.3.script.aql A asterixdb/asterix-installer/src/test/resources/transactionts/queries/dml_after_restart/multiple_secondary_indices/multiple_secondary_indices.4.ddl.aql A asterixdb/asterix-installer/src/test/resources/transactionts/queries/dml_after_restart/multiple_secondary_indices/multiple_secondary_indices.5.script.aql M asterixdb/asterix-installer/src/test/resources/transactionts/testsuite.xml M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/entities/Dataset.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/IndexUtil.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SecondaryBTreeOperationsHelper.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SecondaryIndexOperationsHelper.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SecondaryInvertedIndexOperationsHelper.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SecondaryRTreeOperationsHelper.java A asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SecondaryTreeIndexOperationsHelper.java A hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/dataflow/LSMInvertedIndexDropOperatorDescriptor.java 15 files changed, 313 insertions(+), 107 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/00/1600/1 diff --git a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java index e64cf14..c4868fc 100644 --- a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java +++ b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java @@ -1052,7 +1052,7 @@ bActiveTxn = true; metadataProvider.setMetadataTxnContext(mdTxnCtx); try { -JobSpecification jobSpec = IndexUtil.buildDropSecondaryIndexJobSpec(index, metadataProvider, ds); +JobSpecification jobSpec = IndexUtil.buildDropIndexJobSpec(index, metadataProvider, ds); MetadataManager.INSTANCE.commitTransaction(mdTxnCtx); bActiveTxn = false; JobUtils.runJob(hcc, jobSpec, true); @@ -1201,7 +1201,7 @@ MetadataManager.INSTANCE.getDatasetIndexes(mdTxnCtx, dataverseName, datasetName); for (int k = 0; k < indexes.size(); k++) { if (indexes.get(k).isSecondaryIndex()) { - jobsToExecute.add(IndexUtil.buildDropSecondaryIndexJobSpec(indexes.get(k), + jobsToExecute.add(IndexUtil.buildDropIndexJobSpec(indexes.get(k), metadataProvider, datasets.get(j))); } } @@ -1217,7 +1217,7 @@ jobsToExecute.add(ExternalIndexingOperations.buildDropFilesIndexJobSpec(metadataProvider, datasets.get(j))); } else { - jobsToExecute.add(IndexUtil.buildDropSecondaryIndexJobSpec(indexes.get(k), + jobsToExecute.add(IndexUtil.buildDropIndexJobSpec(indexes.get(k), metadataProvider, datasets.get(j))); } } @@ -1390,7 +1390,7 @@ MetadataManager.INSTANCE.getDatasetIndexes(mdTxnCtx.getValue(), dataverseName, datasetName); for (int j = 0; j < indexes.size(); j++) { if (indexes.get(j).isSecondaryIndex()) { - jobsToExecute.add(IndexUtil.buildDropSecondaryIndexJobSpec(indexes.get(j), metadataProvider, ds)); + jobsToExecute.add(IndexUtil.buildDropIndexJobSpec(indexes.get(j), metadataProvider, ds));
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/848/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/848/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2253/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4753/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Jenkins has posted comments on this change. Change subject: Minor fix for the aws_start script. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/74/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Minor fix for the aws_start script.
Yingyi Bu has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1599 Change subject: Minor fix for the aws_start script. .. Minor fix for the aws_start script. Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 --- M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml 1 file changed, 5 insertions(+), 3 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/99/1599/1 diff --git a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml index 5287e34..344bfd5 100644 --- a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml +++ b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml @@ -29,8 +29,10 @@ tasks: - include_vars: ../conf/aws_settings.yml - include_vars: ../conf/aws_types.yml -- debug: -msg: "{{ vols }}" + +- name: Clean the temporary directory + shell: rm -rf "{{ temp_dir }}" + - name: Launch all instances ec2: key_name: "{{ keypair }}" @@ -110,7 +112,7 @@ - name: Populate multiple iodevices shell: printf " - /data{{ vol.0 + 1 }}/iodevice\n" >> "{{ temp_dir }}/devices" - with_indexed_items: vols + with_indexed_items: "{{ vols }}" loop_control: loop_var: vol when: vols|length > 0 -- To view, visit https://asterix-gerrit.ics.uci.edu/1599 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi Bu
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Yingyi Bu has submitted this change and it was merged. Change subject: Auto-config SSDs for the AWS installtion. .. Auto-config SSDs for the AWS installtion. Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1598 Sonar-Qube: JenkinsTested-by: Jenkins BAD: Jenkins Reviewed-by: Ian Maxon Integration-Tests: Jenkins --- A asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml A asterixdb/asterix-server/src/main/opt/aws/yaml/mount.yml 4 files changed, 97 insertions(+), 0 deletions(-) Approvals: Ian Maxon: Looks good to me, approved Jenkins: Verified; No violations found; No violations found; Verified diff --git a/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml b/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml new file mode 100644 index 000..e0a060e --- /dev/null +++ b/asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml @@ -0,0 +1,37 @@ +one_ephemeral: + - { device_name: /dev/xvdb, ephemeral: ephemeral0 } +two_ephemeral: + - { device_name: /dev/xvdb, ephemeral: ephemeral0 } + - { device_name: /dev/xvdc, ephemeral: ephemeral1 } +three_ephemeral: + - { device_name: /dev/xvdb, ephemeral: ephemeral0 } + - { device_name: /dev/xvdc, ephemeral: ephemeral1 } + - { device_name: /dev/xvdd, ephemeral: ephemeral2 } +four_ephemeral: + - { device_name: /dev/xvdb, ephemeral: ephemeral0 } + - { device_name: /dev/xvdc, ephemeral: ephemeral1 } + - { device_name: /dev/xvdd, ephemeral: ephemeral2 } + - { device_name: /dev/xvde, ephemeral: ephemeral3 } + +ephemeral_volumes: + c1.medium: "{{ one_ephemeral }}" + c1.xlarge: "{{ four_ephemeral }}" + c3.large: "{{ two_ephemeral }}" + c3.xlarge: "{{ two_ephemeral }}" + c3.2xlarge: "{{ two_ephemeral }}" + c3.4xlarge: "{{ two_ephemeral }}" + c3.8xlarge: "{{ two_ephemeral }}" + i2.xlarge: "{{ one_ephemeral }}" + i2.2xlarge: "{{ two_ephemeral }}" + i2.4xlarge: "{{ four_ephemeral }}" + m1.small: "{{ one_ephemeral }}" + m1.medium: "{{ one_ephemeral }}" + m1.large: "{{ two_ephemeral }}" + m1.xlarge: "{{ four_ephemeral }}" + m2.xlarge: "{{ one_ephemeral }}" + m2.2xlarge: "{{ one_ephemeral }}" + m2.4xlarge: "{{ two_ephemeral }}" + m3.medium: "{{ one_ephemeral }}" + m3.large: "{{ one_ephemeral }}" + m3.xlarge: "{{ two_ephemeral }}" + m3.2xlarge: "{{ two_ephemeral }}" diff --git a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml index 802abcd..5287e34 100644 --- a/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml +++ b/asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml @@ -25,8 +25,12 @@ inventory: "{{ temp_dir }}/inventory" ccconf: "{{ temp_dir }}/cc.conf" home_dir: "/home/{{ user }}" + vols: "{{ ephemeral_volumes[instance_type]|default([]) }}" tasks: - include_vars: ../conf/aws_settings.yml +- include_vars: ../conf/aws_types.yml +- debug: +msg: "{{ vols }}" - name: Launch all instances ec2: key_name: "{{ keypair }}" @@ -40,6 +44,7 @@ count: "{{ count }}" instance_tags: Name: "{{ tag }}" +volumes: "{{ vols }}" register: ec2 - name: Create local temporary directory @@ -97,6 +102,25 @@ - name: Populate NC iodevices to the cluster configuration file {{ ccconf }} shell: printf "iodevices={{ home_dir }}/iodevice\n" >> "{{ ccconf }}" + when: vols|length == 0 + +- name: Generates multiple iodevice paths + shell: printf "devices:\n" >> "{{ temp_dir }}/devices" + when: vols|length > 0 + +- name: Populate multiple iodevices + shell: printf " - /data{{ vol.0 + 1 }}/iodevice\n" >> "{{ temp_dir }}/devices" + with_indexed_items: vols + loop_control: +loop_var: vol + when: vols|length > 0 + +- include_vars: "{{ temp_dir }}/devices" + when: vols|length > 0 + +- name: Populate multiple NC iodevices to the cluster configuration file {{ ccconf }} + shell: printf "iodevices={{ devices| join(',') }}\n" >> "{{ ccconf }}" + when: vols|length > 0 - name: Populate the NC command to the cluster configuration file {{ ccconf }} shell: printf "command=asterixnc\n" >> "{{ ccconf }}" diff --git a/asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml b/asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml index 7a5a840..cf09b69 100644 --- a/asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml +++ b/asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml @@ -24,6
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2252/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
[jira] [Assigned] (ASTERIXDB-1841) Dropping a large inverted index generates an exception
[ https://issues.apache.org/jira/browse/ASTERIXDB-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Murtadha Hubail reassigned ASTERIXDB-1841: -- Assignee: Murtadha Hubail (was: Abdullah Alamoudi) > Dropping a large inverted index generates an exception > -- > > Key: ASTERIXDB-1841 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1841 > Project: Apache AsterixDB > Issue Type: Bug >Reporter: Taewoo Kim >Assignee: Murtadha Hubail > > There are four NCs and each NC has 6GB of allocated memory. > The size of the dataset itself is about 60GB. The index size is about 37GB. > When I just tried to delete this index by using the following AQL, an > exception occurred. > {code} > use dataverse exp; > drop index AmazonReviewNoDup. AmazonReviewNoDup_reviewText_kw_idx; > {code} > {code} > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > [ClassCastException] > {code} > Detailed Exception from the log: > {code} > org.apache.hyracks.api.exceptions.HyracksDataException: > java.lang.ClassCastException: > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) > at org.apache.hyracks.control.nc.Task.run(Task.java:273) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.util.concurrent.ExecutionException: > java.lang.ClassCastException: > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222) > ... 5 more > Caused by: java.lang.ClassCastException: > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > at > org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79) > at > org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140) > at > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > ... 3 more > org.apache.hyracks.api.exceptions.HyracksDataException: > java.lang.ClassCastException: > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) > at org.apache.hyracks.control.nc.Task.run(Task.java:273) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.util.concurrent.ExecutionException: > java.lang.ClassCastException: > org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor > cannot be cast to > org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > at
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2252/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Add Active Partition Event Message
Till Westmann has posted comments on this change. Change subject: Add Active Partition Event Message .. Patch Set 3: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1596 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I7b4629752e912614927b816d4ce3422ac89c5426 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: abdullah alamoudiGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Ian Maxon has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2251/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: BAD+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/847/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2251/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/73/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 2: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Jenkins has posted comments on this change. Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4752/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Index-Only Plan Patch Set 4: modifies SearchOpCallBack
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1597 to look at the new patch set (#2). Change subject: Index-Only Plan Patch Set 4: modifies SearchOpCallBack .. Index-Only Plan Patch Set 4: modifies SearchOpCallBack - Modifies the SearchOperationCallBack classes to support the canceling of the proceed() function. When executing an index-only plan, there may be a case that we need to cancel the effect of proceed() function. Current implementation only has cancelReconcile(). Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b --- M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/LockThenSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/PrimaryIndexInstantSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/PrimaryIndexSearchOperationCallback.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/opcallbacks/SecondaryIndexSearchOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-btree/src/main/java/org/apache/hyracks/storage/am/btree/impls/BTreeRangeSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ISearchOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/impls/NoOpOperationCallback.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreePointSearchCursor.java M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreeRangeSearchCursor.java M hyracks-fullstack/hyracks/hyracks-test-support/src/main/java/org/apache/hyracks/storage/am/btree/AbstractSearchOperationCallbackTest.java M hyracks-fullstack/hyracks/hyracks-test-support/src/main/java/org/apache/hyracks/storage/am/common/TestOperationCallback.java M hyracks-fullstack/hyracks/hyracks-tests/hyracks-storage-am-lsm-btree-test/src/test/java/org/apache/hyracks/storage/am/lsm/btree/LSMBTreeSearchOperationCallbackTest.java 12 files changed, 83 insertions(+), 19 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/97/1597/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1597 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I16992b3bdc1bfc739417d11366d6bafc59294a0b Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/72/ (2/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Auto-config SSDs for the AWS installtion.
Jenkins has posted comments on this change. Change subject: Auto-config SSDs for the AWS installtion. .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4751/ (1/3) -- To view, visit https://asterix-gerrit.ics.uci.edu/1598 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Jenkins Gerrit-HasComments: No