Change in asterixdb[master]: Ansible scripts for local cluster installation.
Jenkins has posted comments on this change. Change subject: Ansible scripts for local cluster installation. .. Patch Set 11: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/647/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Ansible scripts for local cluster installation.
Jenkins has posted comments on this change. Change subject: Ansible scripts for local cluster installation. .. Patch Set 11: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/647/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Ansible scripts for local cluster installation.
Jenkins has posted comments on this change. Change subject: Ansible scripts for local cluster installation. .. Patch Set 11: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2017/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 60: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 60 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 60: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4464/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 60 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1076 to look at the new patch set (#60). Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. - Enable the fuzzyjoin rule. - Introduce eight existing rules in FuzzyJoinRuleCollections after applied the fuzzyjoin rule. - Add ExtractCommonExpressionRule to extract the common expressions in the star-like multiple fuzzyjoin substitutions. - Add InlineSubplanInputForNestedTupleSourceRule to translate the generated subplan from the similarity function-derived substitution into join in case of nested schemas. - Add RemoveAssign/Variables/AggRules to iteratively remove unused assign/vars once FuzzyJoinRule is applied in each round. - Add three new optimization Cases for multi-fuzzyjoin. - link-like multiway fuzzyjoins - star-like multiway fuzzyjoins - hybrid multiway fuzzyjoin with the both forms of fuzzyjoins. - Add a running Case where another fuzzyjoin is regarded as select over an existing prefix-based fuzzyjoin. - Change the inverted-index-based fuzzyjoin onto the prefix-based join due to efficiency considerations. - Increase the ManagixExecutionIT and nc memory configuration so as to enable multi-way fuzzy join to pass the capacity check. Change-Id: I8736f104905eeda763d39709e002c2b9629278cc --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/compiler/provider/DefaultRuleSetFactory.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/FuzzyUtils.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FuzzyJoinRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java A asterixdb/asterix-app/data/dblp-small/csx-small-multi-id.txt A asterixdb/asterix-app/data/dblp-small/dblp-small-multi-id.txt A asterixdb/asterix-app/data/pub-small/csx-small-multi-id.txt A asterixdb/asterix-app/data/pub-small/dblp-small-multi-id.txt A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-hybrid.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-selflink.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-simple.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-star.aql A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-hybrid.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-selflink.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-simple.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-star.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join-noeqjoin/ngram-jaccard-inline.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join-noeqjoin/word-jaccard-inline.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/leftouterjoin-probe-pidx-with-join-jaccard-check-idx_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_04.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_04.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/word-fuzzyeq-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/word-fuzzyeq-jaccard_02.plan M
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2016/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Ansible scripts for local cluster installation.
Yingyi Bu has posted comments on this change. Change subject: Ansible scripts for local cluster installation. .. Patch Set 11: (3 comments) https://asterix-gerrit.ics.uci.edu/#/c/1525/10//COMMIT_MSG Commit Message: PS10, Line 7: installatio > s/installtion/installation/ Done https://asterix-gerrit.ics.uci.edu/#/c/1525/10/asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh File asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh: PS10, Line 30: TODO > file an issue instead of shipping this TODO? Done. Created ASTERIXDB-1814. https://asterix-gerrit.ics.uci.edu/#/c/1525/10/asterixdb/asterix-server/src/main/opt/ansible/bin/stop.sh File asterixdb/asterix-server/src/main/opt/ansible/bin/stop.sh: Line 21: # Gets the absolute path so that the script can work no matter where it is invoked. > Only one empty line? Removed the empty line. Sure. Opened ASTERIXDB-1815 for that. -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: Yes
Change in asterixdb[master]: Ansible scripts for local cluster installation.
Jenkins has posted comments on this change. Change subject: Ansible scripts for local cluster installation. .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4463/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Ansible scripts for local cluster installation.
Hello Till Westmann, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1525 to look at the new patch set (#11). Change subject: Ansible scripts for local cluster installation. .. Ansible scripts for local cluster installation. This change includes the following parts: - Refactored aws scripts and share the common part with non-aws cluster installation; - Fixed aws_start.yml and aws_stop.yml to count based on the user-provided tag. Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab --- M asterixdb/asterix-server/src/main/assembly/binary-assembly.xml A asterixdb/asterix-server/src/main/opt/ansible/README C asterixdb/asterix-server/src/main/opt/ansible/bin/deploy.sh C asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh C asterixdb/asterix-server/src/main/opt/ansible/bin/start.sh C asterixdb/asterix-server/src/main/opt/ansible/bin/stop.sh A asterixdb/asterix-server/src/main/opt/ansible/conf/cc.conf R asterixdb/asterix-server/src/main/opt/ansible/conf/instance_settings.yml A asterixdb/asterix-server/src/main/opt/ansible/conf/inventory C asterixdb/asterix-server/src/main/opt/ansible/yaml/deploy.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/deploy_all.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/erase.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/erase_all.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/gen_conf.yml A asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_start.yml A asterixdb/asterix-server/src/main/opt/ansible/yaml/instance_stop.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/start_cc.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/start_ncservice.yml C asterixdb/asterix-server/src/main/opt/ansible/yaml/wait_ssh.yml M asterixdb/asterix-server/src/main/opt/aws/README D asterixdb/asterix-server/src/main/opt/aws/ansible/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/bin/stop.sh R asterixdb/asterix-server/src/main/opt/aws/yaml/aws_start.yml R asterixdb/asterix-server/src/main/opt/aws/yaml/aws_stop.yml C asterixdb/asterix-server/src/main/opt/aws/yaml/install_jdk.yml C asterixdb/asterix-server/src/main/opt/aws/yaml/instance_start.yml 27 files changed, 389 insertions(+), 320 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/25/1525/11 -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu
[jira] [Created] (ASTERIXDB-1815) Factor out shared part in cluster installation script
Yingyi Bu created ASTERIXDB-1815: Summary: Factor out shared part in cluster installation script Key: ASTERIXDB-1815 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1815 Project: Apache AsterixDB Issue Type: Improvement Components: AsterixDB Reporter: Yingyi Bu Assignee: Yingyi Bu Each script under opt/aws and opt/ansible has the ability to be run from anywhere and then resolve its absolute path. It would be nice to have a script that only does the absolute path resolution and be shared by different scripts such start.sh, stop.sh, erase.sh, deploy.sh. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ASTERIXDB-1814) Add the ability to erase all data/txnlog/log generated by an instance
Yingyi Bu created ASTERIXDB-1814: Summary: Add the ability to erase all data/txnlog/log generated by an instance Key: ASTERIXDB-1814 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1814 Project: Apache AsterixDB Issue Type: Improvement Components: AsterixDB Reporter: Yingyi Bu Assignee: Yingyi Bu Currently, the ansible cluster script opt/ansible/bin/erase.sh only erases the installation binary of an instance, but does not erase all data/txnlog/log generated by an instance. It would be nice to add this capability into erase.sh. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2015/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/646/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2015/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/646/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2014/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Handle error conditions in the /query/result API
Jenkins has posted comments on this change. Change subject: Handle error conditions in the /query/result API .. Patch Set 5: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4462/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1532 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Ansible scripts for local cluster installtion.
Till Westmann has posted comments on this change. Change subject: Ansible scripts for local cluster installtion. .. Patch Set 10: Code-Review+2 (3 comments) Change looks good, only cosmetic comments. Tried the local install using ansible, but shied away from running erase.sh on my box ... https://asterix-gerrit.ics.uci.edu/#/c/1525/10//COMMIT_MSG Commit Message: PS10, Line 7: installtion s/installtion/installation/ https://asterix-gerrit.ics.uci.edu/#/c/1525/10/asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh File asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh: PS10, Line 30: TODO file an issue instead of shipping this TODO? https://asterix-gerrit.ics.uci.edu/#/c/1525/10/asterixdb/asterix-server/src/main/opt/ansible/bin/stop.sh File asterixdb/asterix-server/src/main/opt/ansible/bin/stop.sh: Line 21: Only one empty line? Looking at the similarity of the scripts, I wonder if we should try to factor some lines out. But possibly that just makes the script more complicated. Maybe we can discuss this later. -- To view, visit https://asterix-gerrit.ics.uci.edu/1525 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi BuGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: Yes
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/645/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/645/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2014/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Till Westmann has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: (32 comments) Submitting (incomplete) comments for patch set 30. https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java File asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java: PS30, Line 126: getCCConfig Does the ICCApplicationEntryPoint know about the config manager? https://asterix-gerrit.ics.uci.edu/#/c/1487/5/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/AsterixNCConfig.java File asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/AsterixNCConfig.java: PS5, Line 25: Do we still have an app section? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/ClusterStateDefaultParameterTest.java File asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/ClusterStateDefaultParameterTest.java: PS30, Line 68: /node/asterix_nc1/config How did the HTTP API change here? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm File asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm: PS30, Line 7: config Where do we find the missing info? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CompilerProperties.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CompilerProperties.java: PS30, Line 21: .*; Resolve '*' includes? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ExternalProperties.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ExternalProperties.java: PS30, Line 63: CC Is this correct? https://asterix-gerrit.ics.uci.edu/#/c/1487/5/asterixdb/asterix-doc/src/site/markdown/ncservice.md File asterixdb/asterix-doc/src/site/markdown/ncservice.md: PS5, Line 141: storage.subdir=storage I'm confused. I thought we wanted to put those in the nc-section. https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-events/src/main/resources/events/node_join/nc_join.sh File asterixdb/asterix-events/src/main/resources/events/node_join/nc_join.sh: PS30, Line 24: fix WS? PS30, Line 25: fix WS? PS30, Line 31: TODO(mblow) file an issue? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/asterixdb/asterix-events/src/main/resources/events/node_restart/nc_restart.sh File asterixdb/asterix-events/src/main/resources/events/node_restart/nc_restart.sh: PS30, Line 26: fix WS? https://asterix-gerrit.ics.uci.edu/#/c/1487/30/hyracks-fullstack/algebricks/algebricks-tests/src/test/java/org/apache/hyracks/algebricks/tests/util/AlgebricksHyracksIntegrationUtil.java File hyracks-fullstack/algebricks/algebricks-tests/src/test/java/org/apache/hyracks/algebricks/tests/util/AlgebricksHyracksIntegrationUtil.java: PS30, Line 66: data line too long? PS30, Line 78: data line too long? https://asterix-gerrit.ics.uci.edu/#/c/1487/5/hyracks-fullstack/hyracks/hyracks-api/pom.xml File hyracks-fullstack/hyracks/hyracks-api/pom.xml: PS5, Line 104: Not a big fan of the args4j dependency in hyracks-api. https://asterix-gerrit.ics.uci.edu/#/c/1487/30/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/config/IOption.java File hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/config/IOption.java: PS30, Line 24: IOption I think that we need some javadoc here - especially on "hidden" and "virtual". PS30, Line 52: defaultValue Not a big fan of default implementations - especially if they get complicated. I think that the goal of default methods is to enable interface additions without modifying all implementations and not to put a lot of code into the interface. I prefer if interface files are rarely touched and putting a lot of code into them seems to make that more unlikely. PS30, Line 67: usage Not a big fan of default implementations - especially if they get complicated. https://asterix-gerrit.ics.uci.edu/#/c/1487/30/hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/context/ICCContext.java File hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/context/ICCContext.java: PS30, Line 37: getConfigManager Do we need to get the config manager from the ICCContext? It seems that the only use of this is to get the AppConfig which might be easily (and cleanly) achievable without modifying this interface.
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 31: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4461/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 31 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1487 to look at the new patch set (#31). Change subject: Configuration Revamp .. Configuration Revamp - Ini section of node / cc details now returns ini param names instead of managix option names - Normalized command line -vs- ini file configuration parameter names - Eliminated unused parameters - Ini validation - Migrate *DB parameters out of [app] and into nc / cc sections as appropriate - Eliminate [app] section. Cluster-wide configuration lives in [common] - Sort properties alphabetically when returned by HTTP api Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 --- M asterixdb/asterix-app/pom.xml M asterixdb/asterix-app/scripts/asterix/startnc.sh M asterixdb/asterix-app/scripts/idefix/startnc1.sh M asterixdb/asterix-app/scripts/idefix/startnc2.sh M asterixdb/asterix-app/scripts/rainbow/startnc.sh M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/APIFramework.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ClusterApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/ClusterControllerDetailsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/DiagnosticsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/NodeControllerDetailsApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/server/VersionApiServlet.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ServletConstants.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/AutoFaultToleranceStrategy.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/ClusterLifecycleListener.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/FaultToleranceUtil.java M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml M asterixdb/asterix-app/src/test/java/org/apache/asterix/app/bootstrap/TestNodeController.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestExecutor.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/common/TestHelper.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/logging/CheckpointingTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/ClusterStateDefaultParameterTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/OptimizerParserTest.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/ParserTestUtil.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/sqlpp/SmokeParserTest.java M asterixdb/asterix-app/src/test/resources/runtimets/api.xml A asterixdb/asterix-app/src/test/resources/runtimets/queries/api/APIQueries.xml D asterixdb/asterix-app/src/test/resources/runtimets/queries/api/replication/replication.1.get.http M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_full/cluster_state_1_full.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_less/cluster_state_1_less.1.adm D asterixdb/asterix-app/src/test/resources/runtimets/results/api/replication/replication.1.adm M asterixdb/asterix-client-helper/pom.xml M asterixdb/asterix-common/pom.xml M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AbstractProperties.java C asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixCCConfig.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixNCConfig.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/BuildProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CompilerProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/ExternalProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/FeedProperties.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/MessagingProperties.java M
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: Integration-Tests-1 Integration Tests Timed Out https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2012/ : ABORTED -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/644/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 30 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/644/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 30 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2013/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 30 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Xikui Wang has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: (1 comment) I think the IT failure is a false alarm... Will have it test again in next revision. https://asterix-gerrit.ics.uci.edu/#/c/1533/1/asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md File asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md: Line 34: architectural component, called a data feed, that makes a Big Data system the caretaker for functionality that Do we need to limit 120 characters in md file? If so, I will fix this in next version. -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Carey Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Xikui Wang Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: Yes
Change in asterixdb[master]: Feed Exception Revise
Jenkins has posted comments on this change. Change subject: Feed Exception Revise .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4460/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1534 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Feed Exception Revise
Xikui Wang has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1534 Change subject: Feed Exception Revise .. Feed Exception Revise 1. Add compliation exception for missing Twitter4J library. Try to expose this exception when create feed. 2. Removed 'invalid feed parameter exception'. Expose detailed exception information to front end. Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e --- M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java M asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java M asterixdb/asterix-lang-aql/src/main/java/org/apache/asterix/lang/aql/statement/SubscribeFeedStatement.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/MetadataException.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/feeds/FeedMetadataUtil.java 6 files changed, 21 insertions(+), 12 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/34/1534/1 diff --git a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java index 83ff3a2..b03ed0f 100644 --- a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java +++ b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/exceptions/ErrorCode.java @@ -87,9 +87,9 @@ public static final int OPERATORS_FEED_INTAKE_OPERATOR_DESCRIPTOR_CLASSLOADER_NOT_CONFIGURED = 3004; public static final int PARSER_DELIMITED_NONOPTIONAL_NULL = 3005; public static final int PARSER_DELIMITED_ILLEGAL_FIELD = 3006; -public static final int FEED_MANAGEMENT_ACTIVE_LIFE_CYCLE_EVENT_SUBSCRIBER_ACTIVE_JOB_FAILURE = 3007; +public static final int ADAPTOR_TWITTER_TWITTER4J_LIB_NOT_FOUND = 3007; public static final int OPERATORS_FEED_INTAKE_OPERATOR_NODE_PUSHABLE_FAIL_AT_INGESTION = 3008; -public static final int OPERATORS_FEED_MSG_OPERATOR_NODE_PUSHABLE_INVALID_SUBSCRIBABLE_RUNTIME = 3009; +public static final int FEED_CREATE_FEED_DATATYPE_ERROR = 3009; public static final int PARSER_HIVE_NON_PRIMITIVE_LIST_NOT_SUPPORT = 3010; public static final int PARSER_HIVE_FIELD_TYPE = 3011; public static final int PARSER_HIVE_GET_COLUMNS = 3012; diff --git a/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties b/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties index 3e96972..9373a0f 100644 --- a/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties +++ b/asterixdb/asterix-common/src/main/resources/asx_errormsg/en.properties @@ -72,9 +72,9 @@ 3004 = Unable to create adapter as class loader not configured for library %1$s in dataverse %2$s 3005 = At record: %1$s - Field %2$s is not privatean optional type so it cannot accept null value. 3006 = Illegal field %1$s in closed type %2$s -3007 = Failure in active job. +3007 = Twitter4J library not found! 3008 = Unable to ingest data -3009 = Invalid subscribable runtime type %1$s +3009 = Exception in get record type %1$s for feed 3010 = Doesn't support Hive data with list of non-primitive types 3011 = Can't get hive type for field of type %1$s 3012 = Failed to get columns of record diff --git a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java index 1428863..88d6898 100644 --- a/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java +++ b/asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/provider/DatasourceFactoryProvider.java @@ -38,6 +38,7 @@ import org.apache.asterix.external.util.ExternalDataUtils; import org.apache.hyracks.algebricks.common.exceptions.AlgebricksException; import org.apache.hyracks.api.exceptions.HyracksDataException; +import twitter4j.conf.ConfigurationBuilder; public class DatasourceFactoryProvider { @@ -108,6 +109,11 @@ case ExternalDataConstants.READER_PUSH_TWITTER: case ExternalDataConstants.READER_PULL_TWITTER: case ExternalDataConstants.READER_USER_STREAM_TWITTER: +try { +ConfigurationBuilder cb = new ConfigurationBuilder(); +} catch (NoClassDefFoundError e) { +throw new RuntimeDataException(ErrorCode.ADAPTOR_TWITTER_TWITTER4J_LIB_NOT_FOUND); +} return new TwitterRecordReaderFactory(); case ExternalDataConstants.ALIAS_SOCKET_ADAPTER: case
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 30 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Configuration Revamp
Jenkins has posted comments on this change. Change subject: Configuration Revamp .. Patch Set 30: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4459/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1487 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754 Gerrit-PatchSet: 30 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Michael BlowGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/643/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/643/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2012/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 59: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4458/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 59 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1076 to look at the new patch set (#59). Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. - Enable the fuzzyjoin rule. - Introduce eight existing rules in FuzzyJoinRuleCollections after applied the fuzzyjoin rule. - Add ExtractCommonExpressionRule to extract the common expressions in the star-like multiple fuzzyjoin substitutions. - Add InlineSubplanInputForNestedTupleSourceRule to translate the generated subplan from the similarity function-derived substitution into join in case of nested schemas. - Add RemoveAssign/Variables/AggRules to iteratively remove unused assign/vars once FuzzyJoinRule is applied in each round. - Add three new optimization Cases for multi-fuzzyjoin. - link-like multiway fuzzyjoins - star-like multiway fuzzyjoins - hybrid multiway fuzzyjoin with the both forms of fuzzyjoins. - Add a running Case where another fuzzyjoin is regarded as select over an existing prefix-based fuzzyjoin. - Change the inverted-index-based fuzzyjoin onto the prefix-based join due to efficiency considerations. - Increase the ManagixExecutionIT nc memory configuration so as to enable multi-way fuzzy join to pass the capacity check. Change-Id: I8736f104905eeda763d39709e002c2b9629278cc --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/compiler/provider/DefaultRuleSetFactory.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/FuzzyUtils.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FuzzyJoinRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java A asterixdb/asterix-app/data/dblp-small/csx-small-multi-id.txt A asterixdb/asterix-app/data/dblp-small/dblp-small-multi-id.txt A asterixdb/asterix-app/data/pub-small/csx-small-multi-id.txt A asterixdb/asterix-app/data/pub-small/dblp-small-multi-id.txt A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-hybrid.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-selflink.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-simple.aql A asterixdb/asterix-app/src/test/resources/optimizerts/queries/fj-dblp-csx-star.aql A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-hybrid.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-selflink.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-simple.plan A asterixdb/asterix-app/src/test/resources/optimizerts/results/fj-dblp-csx-star.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join-noeqjoin/ngram-jaccard-inline.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join-noeqjoin/word-jaccard-inline.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/leftouterjoin-probe-pidx-with-join-jaccard-check-idx_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-fuzzyeq-jaccard_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard-check_04.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_02.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_03.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/ngram-jaccard_04.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/word-fuzzyeq-jaccard_01.plan M asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/word-fuzzyeq-jaccard_02.plan M
Change in asterixdb[master]: Add links to node details to node summaries
abdullah alamoudi has posted comments on this change. Change subject: Add links to node details to node summaries .. Patch Set 3: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1530 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I012acbf10eb6f11a625a2a5e51eed1421d8fd046 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Jenkins has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: Integration-Tests-1 Integration Tests Timed Out https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2011/ : ABORTED -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 58: Integration-Tests-1 Integration Tests Timed Out https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2010/ : ABORTED -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 58 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Add links to node details to node summaries
Jenkins has posted comments on this change. Change subject: Add links to node details to node summaries .. Patch Set 3: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2009/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1530 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I012acbf10eb6f11a625a2a5e51eed1421d8fd046 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Jenkins has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/642/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Jenkins has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/642/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Jenkins has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2011/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 58: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/641/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 58 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 58: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/641/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 58 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...
Jenkins has posted comments on this change. Change subject: Applied the multiway fuzzyjoin based on the prefix-based join and the selectFuzzyJoin testCases. .. Patch Set 58: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2010/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1076 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc Gerrit-PatchSet: 58 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Wenhai LiGerrit-Reviewer: Chen Li Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Wenhai Li Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Jenkins has posted comments on this change. Change subject: Update the Feed Tutorial .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/4457/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1533 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui WangGerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Add links to node details to node summaries
Jenkins has posted comments on this change. Change subject: Add links to node details to node summaries .. Patch Set 3: BAD-1 BAD Compatibility Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/640/ : FAILURE -- To view, visit https://asterix-gerrit.ics.uci.edu/1530 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I012acbf10eb6f11a625a2a5e51eed1421d8fd046 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Update the Feed Tutorial
Xikui Wang has uploaded a new change for review. https://asterix-gerrit.ics.uci.edu/1533 Change subject: Update the Feed Tutorial .. Update the Feed Tutorial 1. Updated the Twitter and RSS part to work with the current new feed connection model. 2. Added one section about the Socket feed. 3. Commented the policy section. Change-Id: Ia18d0b2e3f483332058d9739350643e7f8773433 --- M asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md 1 file changed, 139 insertions(+), 38 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/33/1533/1 diff --git a/asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md b/asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md index 948c7aa..9e53a68 100644 --- a/asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md +++ b/asterixdb/asterix-doc/src/site/markdown/feeds/tutorial.md @@ -23,12 +23,15 @@ * [Introduction](#Introduction) * [Feed Adaptors](#FeedAdaptors) -* [Feed Policies](#FeedPolicies) + ## Introduction ## In this document, we describe the support for data ingestion in -AsterixDB. Data feeds are a new mechanism for having continuous data arrive into a BDMS from external sources and incrementally populate a persisted dataset and associated indexes. We add a new BDMS architectural component, called a data feed, that makes a Big Data system the caretaker for functionality that +AsterixDB. Data feeds are a new mechanism for having continuous +data arrive into a BDMS from external sources and incrementally +populate a persisted dataset and associated indexes. We add a new BDMS +architectural component, called a data feed, that makes a Big Data system the caretaker for functionality that used to live outside, and we show how it improves users' lives and system performance. ## Feed Adaptors ## @@ -52,25 +55,28 @@ to ingest data that is directed at a prescribed socket. -In this tutorial, we shall describe building two example data ingestion pipelines that cover the popular scenario of ingesting data from (a) Twitter and (b) RSS Feed source. +In this tutorial, we shall describe building two example data ingestion pipelines +that cover the popular scenarios of ingesting data from (a) Twitter (b) RSS (c) Socket Feed source. Ingesting Twitter Stream We shall use the built-in push-based Twitter adaptor. -As a pre-requisite, we must define a Tweet using the AsterixDB Data Model (ADM) and the AsterixDB Query Language (AQL). Given below are the type definition in AQL that create a Tweet datatype which is representative of a real tweet as obtained from Twitter. +As a pre-requisite, we must define a Tweet using the AsterixDB Data Model (ADM) +and the AsterixDB Query Language (AQL). Given below are the type definition in AQL +that create a Tweet datatype which is representative of a real tweet as obtained from Twitter. create dataverse feeds; use dataverse feeds; create type TwitterUser as closed { -screen_name: string, -lang: string, -friends_count: int32, -statuses_count: int32 +screen_name: string, +lang: string, +friends_count: int32, +statuses_count: int32 }; create type Tweet as open { - id: int64, - user: TwitterUser +id: int64, +user: TwitterUser } create dataset Tweets (Tweet) @@ -81,7 +87,9 @@ #Using the "push_twitter" feed adapter# The "push_twitter" adaptor requires setting up an application account with Twitter. To retrieve -tweets, Twitter requires registering an application with Twitter. Registration involves providing a name and a brief description for the application. Each application has an associated OAuth authentication credential that includes OAuth keys and tokens. Accessing the +tweets, Twitter requires registering an application with Twitter. Registration involves providing +a name and a brief description for the application. Each application has an associated OAuth +authentication credential that includes OAuth keys and tokens. Accessing the Twitter API requires providing the following. 1. Consumer Key (API Key) 2. Consumer Secret (API Secret) @@ -89,7 +97,9 @@ 4. Access Token Secret The "push_twitter" adaptor takes as configuration the above mentioned -parameters. End users are required to obtain the above authentication credentials prior to using the "push_twitter" adaptor. For further information on obtaining OAuth keys and tokens and registering an application with Twitter, please visit http://apps.twitter.com +parameters. End users are required to obtain the above authentication credentials prior to +using the "push_twitter" adaptor. For further information on obtaining OAuth keys and tokens and +registering an application with Twitter,
Change in asterixdb[master]: Add links to node details to node summaries
Jenkins has posted comments on this change. Change subject: Add links to node details to node summaries .. Patch Set 3: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/640/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1530 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I012acbf10eb6f11a625a2a5e51eed1421d8fd046 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Add links to node details to node summaries
Jenkins has posted comments on this change. Change subject: Add links to node details to node summaries .. Patch Set 3: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/2009/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1530 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I012acbf10eb6f11a625a2a5e51eed1421d8fd046 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No