Re: [DISCUSS] Test Coverage

2016-05-23 Thread Till Westmann
I completely agree that having this code coverage tools is a great step forward and that we should aim for 80% or more coverage. However, I also agree with Ted that it’s not always effective or efficient to strive for a fixed number. I think that we should start with reporting the numbers and makin

Cross project changes

2016-05-23 Thread Till Westmann
Hi, to increase the chances that Hyracks stays generic enough for other projects to build upon, I think that it’d be good if we alerted committers and reviewers of cross project changes. Could we e.g. automatically flag changes that change AsterixDB and Hyracks with a comment on the Gerrit review

Re: IDE plugins for source code quality

2016-05-23 Thread Till Westmann
Just installed SonarLint in IDEA and it’s really nice. Thanks! Till On 23 May 2016, at 11:29, abdullah alamoudi wrote: > Hi Everyone, > As we're focusing more and more on code quality, I thought I'd share the > following two plugins that I have started using and liked recently. > > 1. EclEmma:

latest docs

2016-05-23 Thread Till Westmann
Hi, out "latest" docs [1] seem to be outdated. How should this be generated? (And what can we do to re-trigger this?) Thanks, Till [1] https://ci.apache.org/projects/asterixdb/index.html

Re: latest docs

2016-05-23 Thread Till Westmann
Ok, it seems that the last one failed [2] and now we’re offline. Does anybody know how to change that? Thanks, Till [2] https://ci.apache.org/builders/asterixdb-master-docs On 23 May 2016, at 11:58, Till Westmann wrote: Hi, out "latest" docs [1] seem to be outdated. How shou

Re: latest docs

2016-05-23 Thread Till Westmann
Ok, thanks! Till On 23 May 2016, at 12:10, Ian Maxon wrote: > It's suppose to be run every day automatically. I pinged infra again as to > why it has gone stale: https://issues.apache.org/jira/browse/INFRA-11961 > > On Mon, May 23, 2016 at 11:58 AM, Till Westmann wrote: &

Re: latest docs

2016-05-23 Thread Till Westmann
Cool. Thanks! > On May 23, 2016, at 16:59, Ian Maxon wrote: > > It's fixed now, thanks to Gavin from Infra. The build slave was offline, > and also the POM had moved due to the asterixdb/hyracks merge. > >> On Mon, May 23, 2016 at 1:10 PM, Till Westmann wrote: >

Re: Cross project changes

2016-05-27 Thread Till Westmann
Any thoughts on this? Would it be difficult to add such notifications to the Gerrit review? Cheers, Till On 23 May 2016, at 9:51, Till Westmann wrote: Hi, to increase the chances that Hyracks stays generic enough for other projects to build upon, I think that it’d be good if we alerted

Re: Cross project changes

2016-05-27 Thread Till Westmann
? Something more custom in the UI? Thanks, -MDB On Fri, May 27, 2016 at 1:32 PM Till Westmann wrote: Any thoughts on this? Would it be difficult to add such notifications to the Gerrit review? Cheers, Till On 23 May 2016, at 9:51, Till Westmann wrote: Hi, to increase the chances that

Re: Cross project changes

2016-05-27 Thread Till Westmann
-level module? Many of my changes/fixes span algebricks and asterixdb. Today we have: -- asterixdb -- hyracks-fullstack I think we should have the following structure at top level: -- asterixdb -- algbericks -- hyracks Best, Yingyi On Fri, May 27, 2016 at 10:32 AM, Till Westmann wrote: Any

Re: Cross project changes

2016-05-31 Thread Till Westmann
be a problem:-) Best, Yingyi On Fri, May 27, 2016 at 1:33 PM, Till Westmann wrote: This is only about notifications, there should be no limitations on being able to do anything. Do you think that the notifications would be problematic for the reviewers of your changes? Cheers, Till On 27 May

Re: Datetime to Unix Timestamp

2016-06-07 Thread Till Westmann
I think that it’s fine to add a function for this. However, AFAIK the UNIX timestamp is in seconds [1], so it seems that we don’t need functions for different time units. Is there a reason why we should support different time units? Cheers, Till [1] https://en.wikipedia.org/wiki/Unix_time On 6

Re: Trouble adding a Servlet to the Cluster

2016-06-07 Thread Till Westmann
Hi Kaveen, I think that the current APIServlet already serves static content, so that could be a good example. If that’s not helping, maybe you could post a link to a patch to the list? Then anybody could take a look at that diff to see what’s happening/not working in more detail. Cheers, Ti

Re: Trouble adding a Servlet to the Cluster

2016-06-07 Thread Till Westmann
oller Entry Point and the configuration xml and a couple of more modifications. This is the branch which I'm working : https://github.com/KaveenR/incubator-asterixdb/commits/asterixdb-1375-static-servlet Still no luck, the logs don't show any errors cheers, Kaveen On 7 June 2016

[DRAFT][REPORT] Apache AsterixDB June 2016

2016-06-07 Thread Till Westmann
Hi, here’s a proposal for this month’s board report. Thoughts/additions/concerns? Thanks, Till — Description: Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query capabilities for large collections of semi-structured data. Activity: -

Re: [DRAFT] [REPORT] Apache AsterixDB June 2016

2016-06-07 Thread Till Westmann
ng student for AsterixDB summer of code. Melaka is working on the VXQuery project. The Asterix student is Kaveen Rodrigo Steven On Tue, Jun 7, 2016 at 2:25 PM, Till Westmann wrote: Hi, here’s a proposal for this month’s board report. Thoughts/additions/concerns? Thanks, Till — D

Re: new AsterixDB web interface demo up and running

2016-06-17 Thread Till Westmann
Results for multiple queries are not that easy for the new HTTP API design [1] that we’re trying to finish right now. For that design we’re planning to have many statements, but to only return the result of the last statement. The challenge with multiple results is that the newer API also return

Re: AsterixDB build now requires Maven 3.3.9

2016-06-18 Thread Till Westmann
I think that the "problem" was that the toolchain change was noticed only after the commit to master as both the dev machine and the jenkins boxes were running a version of mvn that worked. Maybe we should run with the minimal documented maven (and JDK) version on the jenkins boxes to make sur

Re: Cluster XML files

2016-06-29 Thread Till Westmann
Is there a conceptual or lifecycle reason to put a parameter in one or the other file? I really would like to understand why we have 2 files and what the difference is. I think that one hint might be what Ian just mentioned, that the parameters in asterix-configuration.xml can be modified (with a r

Re: Cluster XML files

2016-06-29 Thread Till Westmann
are running. > > separation of concerns and avoiding repetition of properties (when defining > multiple instances over the same hardware) were the main reasons for > having two separate files. > > Regards, > Raman > On Jun 29, 2016 8:36 AM, "Till Westmann" wrote:

Integration tests ...

2016-06-29 Thread Till Westmann
… are working again: https://asterix-jenkins.ics.uci.edu/job/asterix-integration-tests/88/ Cheers, Till

Re: Errors after importing hyracks and asterixdb into eclipse

2016-07-03 Thread Till Westmann
Hi Vignesh, the attachment was apparently stripped by the list. Maybe you could create a JIRA issue [1] and upload the screenshot there? Cheers, Till [1] https://issues.apache.org/jira/browse/ASTERIXDB On 3 Jul 2016, at 23:21, Vignesh Raghunathan wrote: > Hi, > > I tried to import the codebase

Re: External function dependency problem

2016-07-03 Thread Till Westmann
Sounds good to me! Cheers, Till On 3 Jul 2016, at 23:34, Michael Blow wrote: I think a better solution might be to invert the normal class loader resolution order with an extension of URLClassLoader that overrides loadClass(), which tries resolving classes internally before delegating to the

Re: External function dependency problem

2016-07-04 Thread Till Westmann
: I've submitted a patchset to Gerrit with a proposed fix for this: https://asterix-gerrit.ics.uci.edu/#/c/973/ Thanks, -MDB On Mon, Jul 4, 2016 at 2:37 AM Till Westmann wrote: Sounds good to me! Cheers, Till On 3 Jul 2016, at 23:34, Michael Blow wrote: I think a better solution might

Re: Debugging source code

2016-07-06 Thread Till Westmann
The easiest way to look at stuff in the debugger is to start the AsterixHyracksIntegrationUtil in the debugger. The AsterixHyracksIntegrationUtil will start a mini-cluster in a single JVM and you can break and watch everything. Just start the main method of the AsterixHyracksIntegrationUtil, connec

[DRAFT][REPORT] Apache AsterixDB July 2016

2016-07-07 Thread Till Westmann
Hi, here’s a proposal for this month’s board report. Thoughts/additions/concerns? Thanks, Till — Description: Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query capabilities for large collections of semi-structured data. Activity: -

[DRAFT][REPORT] Apache VXQuery July 2016

2016-07-07 Thread Till Westmann
Hi, here’s a proposal for this month’s board report. Comments/Questions/Concerns? Thanks, Till === Description: Apache VXQuery implements a parallel XML Query processor. Activity: - 3 GSoC projects ongoing, Riyafa Abdul Hameed and Christina Pavlopoulou are working on different aspects of the

Re: [DRAFT] [REPORT] Apache VXQuery July 2016

2016-07-07 Thread Till Westmann
I’m sorry, wrong mailing list .. :( On 7 Jul 2016, at 15:33, Till Westmann wrote: Hi, here’s a proposal for this month’s board report. Comments/Questions/Concerns? Thanks, Till === Description: Apache VXQuery implements a parallel XML Query processor. Activity: - 3 GSoC projects ongoing

Re: [DRAFT] [REPORT] Apache AsterixDB July 2016

2016-07-07 Thread Till Westmann
l 20, 2016. The last releases were on February 26, 2016: AsterixDB 0.8.8-incubating and Hyracks 0.2.17-incubating. On 7 Jul 2016, at 15:23, Mike Carey wrote: Looks fine to me! (Invine->Irvine) On 7/7/16 3:09 PM, Till Westmann wrote: Hi, here’s a proposal for this month’s board report. Thou

Re: Gerrit build failing due to build issue in "asterix-doc"

2016-07-07 Thread Till Westmann
Hi Kaveen, that is a transient issue that we don’t fully understand right now (at least I don’t). I’ve re-started the build for your change for now (even though that’s obviously not a solution). Cheers, Till On 7 Jul 2016, at 19:17, Kaveen Rodrigo wrote: Hello all, My gerrit build is fail

Re: Building, and deploying the site automatically

2016-07-10 Thread Till Westmann
Hi Jochen, I’m not too familiar with buildbot, but this sounds really interesting. So it seems that there’s a way not to submit to an Apache git repo without a human in the loop. Is that right? If so, is that only true for the site or would that also be true for the code repository? Also, wo

Re: Errors after importing hyracks and asterixdb into eclipse

2016-07-11 Thread Till Westmann
, 2016 at 12:02 PM, Till Westmann wrote: Hi Vignesh, the attachment was apparently stripped by the list. Maybe you could create a JIRA issue [1] and upload the screenshot there? Cheers, Till [1] https://issues.apache.org/jira/browse/ASTERIXDB On 3 Jul 2016, at 23:21, Vignesh Raghunathan wrote

Re: Building, and deploying the site automatically

2016-07-11 Thread Till Westmann
, it will break, and we have to ask infra to fix it for us, even though I think in most cases it is simple things that cause it (path changes, etc). Is there a way for the team to have access to change the configs whenever something breaks? -Ian On Sun, Jul 10, 2016 at 11:06 PM, Till Westmann

Re: Starter bugs

2016-07-11 Thread Till Westmann
Did as Ian did :) On 11 Jul 2016, at 19:49, Ian Maxon wrote: I went ahead and labeled some of the issues assigned to me that seemed like good starter bugs as such (unfortunately, none are really related to functions). If everyone does the same with a few of the bugs they have in their queue t

Errors, exceptions, and error codes

2016-07-15 Thread Till Westmann
Hi, triggered by a recent bug fix that required an non-trivial error reporting/handling workflow across the Hyracks/AsterixDB boundary, I’d like to propose a change/extension to the way we manage exceptions. The change is that we’d limit the number of exception classes to a very few (HyracksD

Re: Errors, exceptions, and error codes

2016-07-15 Thread Till Westmann
ul 15, 2016 at 11:50 AM, Till Westmann wrote: Hi, triggered by a recent bug fix that required an non-trivial error reporting/handling workflow across the Hyracks/AsterixDB boundary, I’d like to propose a change/extension to the way we manage exceptions. The change is that we’d limit the numb

Working with Hadoop

2016-07-20 Thread Till Westmann
Hi everybody, recently the topic of Hadoop support came up and I realized that my understanding is quite spotty so I’m trying to understand where we are. AFAIK we support 1) HDFS for (potentially indexed) external datasets, 2) YARN as a resource manager, and 3) HDFS as a basis for internal sto

Re: Failures in Integration-Tests now block submits

2016-07-20 Thread Till Westmann
Nice :) Cheers, Till On 20 Jul 2016, at 22:42, Michael Blow wrote: > All, > > In an effort to help prevent regressions in the integration tests from > getting into master, any failures in Integration-Tests reported by Jenkins > to Gerrit will prevent submits. Integration-Tests failures are now

Re: Working with Hadoop

2016-07-21 Thread Till Westmann
g 2.6.0, it doesn't cause any more issues for me than 2.2.0. I believe 1) used to support Hadoop 0.20.0 and other 1.x versions but I'm not sure if that works anymore. On Wed, Jul 20, 2016 at 7:14 PM, Till Westmann wrote: Hi everybody, recently the topic of Hadoop support ca

Re: Working with Hadoop

2016-07-21 Thread Till Westmann
:) Cheers, Till On 21 Jul 2016, at 13:45, Mike Carey wrote: IMO: Yes to all... :-) On 7/21/16 12:57 PM, Till Westmann wrote: Ok, so would it make sense (and work) to update all of out dependencies to that lastest 2.6 release? Longer term - if we want to continue to support HDFS - it

Re: Dead links

2016-07-29 Thread Till Westmann
Hi, a review for the fix of the download URLs is here: https://asterix-gerrit.ics.uci.edu/1034 Cheers, Till On 29 Jul 2016, at 9:31, Yingyi Bu wrote: > Hi Vignesh, > > We're still working on finalizing the SQL++ doc for AsterixDB. Here is > a draft that you can take a look: > https://g

Re: Dead links

2016-07-29 Thread Till Westmann
It’s fixed now. Cheers, Till On 29 Jul 2016, at 9:41, Till Westmann wrote: Hi, a review for the fix of the download URLs is here: https://asterix-gerrit.ics.uci.edu/1034 Cheers, Till On 29 Jul 2016, at 9:31, Yingyi Bu wrote: Hi Vignesh, We're still working on finalizing th

index-only plans

2016-08-11 Thread Till Westmann
Hi, we still have the big change on index-only plans outstanding. I think that it would be good to have that feature. However, at it’s current size (+45K lines, -15K lines) it is very (!) difficult to review. So I think that one approach to get there would be to break it down into smaller more ach

Re: index-only plans

2016-08-12 Thread Till Westmann
ewoo On Thu, Aug 11, 2016 at 2:43 PM, Till Westmann wrote: Hi, we still have the big change on index-only plans outstanding. I think that it would be good to have that feature. However, at it’s current size (+45K lines, -15K lines) it is very (!) difficult to review. So I think that one a

RecoveryIT failing ...

2016-08-13 Thread Till Westmann
Hi, it seems that I have RecoveryIT consistently succeeding on my box and consistently failing on Jenkins [1][2]. Any hints what to look for from somebody who was in a similar state before? Thanks, Till [1] https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/309/ [2] h

Re: RecoveryIT failing ...

2016-08-14 Thread Till Westmann
). Cheers, Till On Sat, Aug 13, 2016 at 9:06 PM, Till Westmann wrote: Hi, it seems that I have RecoveryIT consistently succeeding on my box and consistently failing on Jenkins [1][2]. Any hints what to look for from somebody who was in a similar state before? Thanks, Till [1] https

Jenkins integration tests

2016-08-14 Thread Till Westmann
Out of the last 30 integration tests [1] 15 timed out (and 5 had test failures). That seems like a high number and I’m wondering if there could be a common cause. If anybody has some insight into one of the hangs, please share here, so that we can hopefully identify commonalities (if they exi

Re: Jenkins integration tests

2016-08-14 Thread Till Westmann
slf4j.org/codes.html#multiple_bindings for an explanation. 02:02:43.819 executing script 'Capture Thread Dumps' On 14 Aug 2016, at 12:05, Till Westmann wrote: Out of the last 30 integration tests [1] 15 timed out (and 5 had test failures). That seems like a high number and I’m wo

SonarQube

2016-08-14 Thread Till Westmann
Is SonarQube still alive? It seems that it didn’t run on https://asterix-gerrit.ics.uci.edu/#/c/1017 … Cheers, Till

Re: [jira] [Commented] (ASTERIXDB-1587) upsert runtime assumes that the datatype comes from the same dataverse as the dataset

2016-08-17 Thread Till Westmann
Indeed, I don’t think that not having a test is a good idea. I think that we’ve managed to break everything that wasn’t tested so far (and a few things that we had thought we had tested :) ) Cheers, Till On 17 Aug 2016, at 18:33, Yingyi Bu wrote: But in this case it seemed like the test was u

Open Issues

2016-08-17 Thread Till Westmann
Hi, we went through the open issues today and tagged a few, updated a few, and resolved a few. Doing that it seemed that all of our lives would be a little better, if we spent a little more time every week on following up on our issues. A number of things seems to have been noticed more than once

Re: Open Issues

2016-08-19 Thread Till Westmann
r. Cheers, Till [3] https://issues.apache.org/jira/issues/?filter=12338262 On 17 Aug 2016, at 18:44, Till Westmann wrote: Hi, we went through the open issues today and tagged a few, updated a few, and resolved a few. Doing that it seemed that all of our lives would be a little better, if

Re: Minor code style change proposal

2016-08-25 Thread Till Westmann
+1 On 25 Aug 2016, at 13:02, Yingyi Bu wrote: Hi committers, The current code style (http://asterixdb.apache.org/dev-setup.html) that we use clears line breaks for javadocs. I'm proposing a one line minor change in the code style: Attached is the updated code style file. Pl

Open issues 2015-08-26

2016-08-26 Thread Till Westmann
Hello, While the original pie chart is still here [1], I’ve also created one for the "soon" to be resolved issues [2] which has some more manageable numbers. Further, there’s now a filter that should subset the "soon" issues [3] to only your issues [4] (if you are logged into JIRA). Please t

Open issues 2015-09-02

2016-09-02 Thread Till Westmann
ot;soon" issues - we’re moving in the right direction! Thanks! Till [2] https://s.apache.org/adb-soon [3] https://issues.apache.org/jira/issues/?filter=12338375 [4] https://issues.apache.org/jira/issues/?filter=12338376 On 26 Aug 2016, at 9:53, Till Westmann wrote: Hello, While the origina

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Till Westmann
Hi, I think that our challenge here is, that XQuery is very liberal in the introduction of new keywords, as the grammar is keyword free. However, they often use combinations of words "contain" "text" to disambiguate. AQL on the other had is not keyword free and so each time we introduce a new

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Till Westmann
Best, Taewoo On Thu, Sep 15, 2016 at 3:11 PM, Till Westmann wrote: Hi, I think that our challenge here is, that XQuery is very liberal in the introduction of new keywords, as the grammar is keyword free. However, they often use combinations of words "contain" "text" t

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Till Westmann
ne indicates whether we do disjunctive/conjunctive search. The fourth one tells us which stop list we use). So, if we have three parameters, how to specify/omit these becomes a challenge. Best, Taewoo On Thu, Sep 15, 2016 at 4:12 PM, Till Westmann wrote: Makes sense to me (especially as

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Till Westmann
And as it turns out, we already have some infrastructure to translate a constant record constructor expression into a record in LangRecordParseUtil. So supporting that wouldn’t be too painful. Cheers, Till On 15 Sep 2016, at 17:41, Till Westmann wrote: One option to express those parameters

Re: Function name change: contains() -> string-contains()

2016-09-16 Thread Till Westmann
. Chen On Thu, Sep 15, 2016 at 5:58 PM, Taewoo Kim wrote: @Till: I see. Thanks for the suggestion. It's more clearer now. Best, Taewoo On Thu, Sep 15, 2016 at 5:58 PM, Till Westmann wrote: And as it turns out, we already have some infrastructure to translate a constant record constr

Re: Physical Operator Tag Change (SPLIT -> REPLICATE)

2016-09-27 Thread Till Westmann
Looks good, ready to merge. Cheers, Till On 27 Sep 2016, at 17:11, Taewoo Kim wrote: > @Yingyi: Thanks for the suggestion. Actually, I have crated a separate > patch for this change only: https://asterix-gerrit.ics.uci.edu/#/c/1219/. > Once this is merged, the review for the second step would be

Location of test results

2016-10-01 Thread Till Westmann
Hi, in a recent change [1] the test result location changed from "a directory in the module folder" to "a directory in the target folder". So now a) the test results will get removed with every "mvn clean" and b) we don’t need to exclude the test result directories in .gitignore anymore. Bot

Re: What's the best way to execute only a single test in ExecutionTest

2016-10-13 Thread Till Westmann
Who knows what "get daversename" does and why we need to run it anyway? Cheers, Till On 13 Oct 2016, at 14:14, Taewoo Kim wrote: > In the past, usually I modified executeTest() of TestExecutor class to > bypass another test cases by checking cUnit.getName() method and execute > only one test cas

Re: Function name and format change in the codebase

2016-10-14 Thread Till Westmann
I think that the answer to both questions is "yes". My 2c, Till On 14 Oct 2016, at 18:04, Taewoo Kim wrote: > Hi All, > > I would like to talk about 1) Function name convention and Format change in > the codebase. > > 1) Function name > When we invent a new function name, would it be better if w

Re: Eclipse - Plugin execution not covered by lifecycle configuration error

2016-10-19 Thread Till Westmann
Hi, I haven’t seen this (as I don’t use eclipse), but I can tell you where it’s coming from. We’ve added the maven-dependency-plugin to validate that the dependencies that are declared in the POM actually match what it being used by the module. The build will fail if dependencies are missing or if

Re: Line limit (120) is not enforced for an assignment statement.

2016-10-25 Thread Till Westmann
+1 On 25 Oct 2016, at 13:29, Taewoo Kim wrote: There is a formatter issue regarding an assignment statement whose length is over 120. An example is as follows: private final IBinaryComparator strLowerCaseTokenCmp = AqlBinaryComparatorFactoryProvider.UTF8STRING_LOWERCASE_TOKEN_POINTABLE_INS

Re: Question about the execution test issue.

2016-11-01 Thread Till Westmann
Hi Wenhai, these are relatively simple tests to validate the result of some HTTP APIs that provide information on the status of the cluster. AFAIK They seem to be working reliably in the regression tests. Not sure why that would change in your branch .. Did you get those errors locally or on J

Re: Load HDFS data to AsterixDB

2016-11-15 Thread Till Westmann
Hi Mingda, It would be good to have an issue with the different scenarios and the different exceptions that you received. I think that the aim of the issue should be to report useful errors that indicate the different error conditions (version mismatch, missing parameter, something else?). Could

Re: Dev notes about storage file/folder layouts

2016-11-29 Thread Till Westmann
There’s a change that would change one aspect of this: https://asterix-gerrit.ics.uci.edu/#/c/1367/ Thoughts welcome. Cheers, Till On 29 Nov 2016, at 15:53, Ian Maxon wrote: > A good thought, much appreciated. I've added the two missing suffixes to > the document. > > On Tue, Nov 29, 2016 at 3:

Re: One of NC node is not stopping for a hash join.

2016-12-01 Thread Till Westmann
Hi Taewoo, is this behavior reproducible? Cheers, Till On 1 Dec 2016, at 22:14, Taewoo Kim wrote: PS: It took 2 more hours to finish the job on one NC. I wonder why this happens. Dec 01, 2016 7:19:35 PM org.apache.hyracks.control.common.work.WorkQueue$WorkerThread run INFO: Executing: Notif

Re: [AsterixDB] execution time metric in the HTTP API

2016-12-02 Thread Till Westmann
Hi, an alternative to using the client that Pouria suggested would be to add "mode=asynchronous-deferred" as an HTTP parameter when talking to the API. In that case the query should be evaluated completely and an HTTP response should come back - however without the result. Instead the response

Re: [AsterixDB] execution time metric in the HTTP API

2016-12-04 Thread Till Westmann
node as the CC :) Best regards Thor Martin Abrahamsen Student @ NTNU Tlf. +47 470 78 713 2. des. 2016 kl. 20.45 skrev Till Westmann mailto:ti...@apache.org>>: Hi, an alternative to using the client that Pouria suggested would be to add "mode=asynchronous-deferred" as an HTT

Re: [AsterixDB] execution time metric in the HTTP API

2016-12-05 Thread Till Westmann
c with handle) - right? The idea would be to not hear back until the work was done, but to not measure that final overhead of returning and swallowing the results themselves. On 12/4/16 9:20 PM, Till Westmann wrote: I think that the best solution for your use-case would be to add deferre

[DISCUSS] Improving reviews

2016-12-05 Thread Till Westmann
Hi, today a few of us had a discussion about how we could make the reviewing process moving along a little smoother. The goal is to increase the likeliness that the reviews and review comments get addressed reasonably quickly. To do that, the proposal is to a) try to keep ourselves to some tim

Re: [DISCUSS] Improving reviews

2016-12-06 Thread Till Westmann
s the rest of the system. I believe that that wouldn't work if we want to build a coherent system (which is my goal ... not sure if we all agree on this). So "moving on" seems to be "giving up" on my goal and I'd rather not do that ... Cheers, Till On Mon, Dec 5, 2016 a

Re: [DISCUSS] Improving reviews

2016-12-06 Thread Till Westmann
ent is always about tradeoffs and compromise, risk versus goals. Any time taken to shift focus towards spreading code knowledge will by necessity pull from other parts of the development process, and the upshot may well not be an overall improvement in functionality or quality. Ceej aka Chris Hille

Re: [DISCUSS] Improving reviews

2016-12-06 Thread Till Westmann
ays about tradeoffs and compromise, risk versus goals. Any time taken to shift focus towards spreading code knowledge will by necessity pull from other parts of the development process, and the upshot may well not be an overall improvement in functionality or quality. Ceej aka Chris Hillery O

Re: [DISCUSS] Improving reviews

2016-12-06 Thread Till Westmann
f value judgment here - software development is always about tradeoffs and compromise, risk versus goals. Any time taken to shift focus towards spreading code knowledge will by necessity pull from other parts of the development process, and the upshot may well not be an overall improvement in funct

Re: [DISCUSS] Improving reviews

2016-12-06 Thread Till Westmann
not fighting against the things they don't excel at. I'm also not trying to make any kind of value judgment here - software development is always about tradeoffs and compromise, risk versus goals. Any time taken to shift focus towards spreading code knowledge will by necessity pull fro

Re: One of NC node is not stopping for a hash join.

2016-12-07 Thread Till Westmann
ee what happens this time. Best, Taewoo On Thu, Dec 1, 2016 at 10:41 PM, Till Westmann wrote: Hi Taewoo, is this behavior reproducible? Cheers, Till On 1 Dec 2016, at 22:14, Taewoo Kim wrote: PS: It took 2 more hours to finish the job on one NC. I wonder why this happens. Dec 01,

Couchbase Analytics

2016-12-13 Thread Till Westmann
Hi, In early November Couchbase released a developer preview of an extension to the Couchbase data platform [1]. This extension adds the capability to evaluate SQL++ queries on data stored in Couchbase server using a parallel query processor. I thought that it would be interesting for the co

Re: Exception refactoring proposal

2017-01-06 Thread Till Westmann
Hi, I like the proposal and I’d like to propose on more change: Let’s not start the names of ErrorCodes with "ERROR_". In the code they are usually used as ErrorCode.ERROR_THIS_IS_THE_PROBLEM and it seems that ErrorCode.THIS_IS_THE_PROBLEM would work just as well. Thoughts? Cheers,

Re: Exception refactoring proposal

2017-01-06 Thread Till Westmann
; > On Fri, Jan 6, 2017 at 3:27 PM, Till Westmann wrote: > >> Hi, >> >> I like the proposal and I’d like to propose on more change: >> Let’s not start the names of ErrorCodes with "ERROR_". >> In the code they are usually

Choosing defaults for AsterixDB

2017-01-09 Thread Till Westmann
Hi, as you know AsterixDB supports 2 query languages (AQL and SQL++) and many output formats (ADM, clean JSON, lossless JSON, CSV). Our current defaults for these options (at least on the web interface) are AQL and ADM. I’d like to propose to change those defaults to be SQL++ and (clean) JSON. Th

Re: Choosing defaults for AsterixDB

2017-01-10 Thread Till Westmann
clean JSON. Cheers, Murtadha On Jan 10, 2017, at 9:46 AM, Till Westmann wrote: Hi, as you know AsterixDB supports 2 query languages (AQL and SQL++) and many output formats (ADM, clean JSON, lossless JSON, CSV). Our current defaults for these options (at least on the web interface) are AQL and

[DRAFT][REPORT] Apache AsterixDB Jan 2017

2017-01-15 Thread Till Westmann
Hi, Here’s a first proposal for a board report - we hope that it will change based on ongoing release activities. Other thoughts/additions/concerns? Thanks, Till -- Description: Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query capabi

Re: [DRAFT] [REPORT] Apache AsterixDB Jan 2017

2017-01-16 Thread Till Westmann
0.8.8-incubating and Hyracks 0.2.17-incubating. On 15 Jan 2017, at 18:03, Till Westmann wrote: > Hi, > > Here’s a first proposal for a board report - we hope that it will change > based on ongoing release activities. > Other thoughts/additions/concerns? > > Thanks, > Till >

Re: [DRAFT] [REPORT] Apache AsterixDB Jan 2017

2017-01-16 Thread Till Westmann
Now I even create off-by-one errors in text … Thanks for catching it! Till On 16 Jan 2017, at 8:51, Mike Carey wrote: Looks good! (AsterixCB -> AsterixDB in one spot.) On 1/15/17 6:03 PM, Till Westmann wrote: Hi, Here’s a first proposal for a board report - we hope that it will cha

Re: problem with managix download

2017-01-16 Thread Till Westmann
As Ian just sent out the VOTE for the new release, I think that we should get that out and make sure that the instructions work with it. Wrt the broken links I found something on the manager docs that points to http://asterixdb.ics.uci.edu/download.html . Maybe that’s the one? If so, could we

Re: problem with managix download

2017-01-16 Thread Till Westmann
mentation, there's a spot. http://asterixdb.apache.org/docs/0.8.8-incubating/install.html#Configuring_Managix Best, Taewoo On Mon, Jan 16, 2017 at 5:41 PM, Till Westmann wrote: As Ian just sent out the VOTE for the new release, I think that we should get that out and make sure that the i

Re: [VOTE] Release Apache AsterixDB 0.8.9 and Hyracks 0.2.18 (RC0)

2017-01-17 Thread Till Westmann
-1 on this RC. There are some differences between the apache-asterixdb-0.8.9 tag and the source archive that need to be addressed. Cheers, Till On 16 Jan 2017, at 16:56, Ian Maxon wrote: Hi everyone, Please verify and vote on the first non-incubating Apache AsterixDB Release! This release

Re: Force LSM component flush & NC-CC messaging ACK

2017-01-21 Thread Till Westmann
Hi Ildar, On 19 Jan 2017, at 4:02, Ildar Absalyamov wrote: Since I was out for quite a while and a lot of things happened in a meantime in a codebase I wanted to clarify couple of things. I was wondering if there is any legitimate way to force the data of in-memory components to be flushed,

Re: [VOTE] Release Apache AsterixDB 0.9.0 and Hyracks 0.3.0 (RC2)

2017-01-21 Thread Till Westmann
+1 - signature and hashes of all 5 archives ok - source archives agree with commit ids - LICENSE + NOTICE look good for all archives - source files have headers - no unexpected binaries - compilation works Till On 19 Jan 2017, at 4:50, Ian Maxon wrote: Hi again everyone, Please verify and vo

Re: add

2017-01-24 Thread Till Westmann
Hi Willy, to subscribe, please send mail to dev-subscr...@asterixdb.apache.org [1]. Till [1] http://apache.org/foundation/mailinglists.html On 24 Jan 2017, at 16:54, Willy Aguirre wrote: > -- > Willy Aguirre | @willrre > Blog: http://osgux.tumblr.com/

Re: Choosing defaults for AsterixDB

2017-02-03 Thread Till Westmann
It currently doesn’t, but it also requires some more work. If we want to use it for AQL, we should simply be able to create a second instance of it with the AQL compilation provider. Cheers, Till On 3 Feb 2017, at 18:57, Taewoo Kim wrote: Regarding this, I have a question. Does the new rev

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Till Westmann
NoSuchMethodError certainly sounds like something is not right with the classes on the classpath. Since we’re not playing too much with the classpath at runtime, it seems that a change of binaries or an error reading the jars are not unlikely. But maybe the same message was there before as well. Do

HTTP API design

2017-03-11 Thread Till Westmann
Hi, I’ve just updated our wiki page for the HTTP API [1] while working on a patch to modify the APIs in a corresponding way. One modification is to the path to the endpoints. The paths are now: /query/service (was "/query" on the wiki and "/query/service" in the code) /query/service/status

Re: Jenkins build is back to stable : asterix-integration-tests 1fb232d9

2017-03-31 Thread Till Westmann
Yay! On 30 Mar 2017, at 23:13, Asterix build server wrote: See

Re: Having problem with Gerrit and Jenkins

2017-04-01 Thread Till Westmann
Hi Xikui, If you look at the failures, you’ll see that the error is java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:433) at sun.nio.ch.Net.bind(Net.java:425) at sun.nio.ch.ServerSocketChannelImpl.bind

Re: What is the new path to check Hyracks jobs status in AsterixDB?

2017-04-07 Thread Till Westmann
Since the endpoints return JSON, using a JSON formatter plugin for the browser seems easier. Otherwise I think that we’ll need to create a page around it (which is clearly feasible as well). On 7 Apr 2017, at 16:21, Mike Carey wrote: Could we use the same library that Xikui used for JSON (form

  1   2   3   >