Re: [APE] Unlimited Storage: Local disk caching in cloud deployment

+1 for this subproject! On Wed, Apr 3, 2024 at 9:44 AM Wail Alkowaileet wrote: > In the current cloud deployment, users are limited by the disk space of the > cluster's nodes. However, the blob storage services provided by cloud > providers (e.g., S3) can virtually store an "unlimited" amount

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.8.3 (RC0)

+1 to release Created the schemaless version of the Don C database example. Created a 1NF set of interconnected tabular views on top of it. Connected to it with dbvisualizer. Verified that it could read the catalogs including the PK/FK graph. Successfully ran a query (after realizing that I

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.8.3 (RC0)

PS - It would be nice for the downloads page to offer the latest official release plus the latest current build (so users don't have to hunt for that and use it at their own risk in the developer page). On 4/1/24 2:10 PM, Mike Carey wrote: I would like to, but it's not working for me

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.8.3 (RC0)

I would like to, but it's not working for me. Hopefully those who have voted actually took it for a test drive (!!!) and it's just me for whom it doesn't work. Currently the asterixdb website appears not to have the latest asterixdb release's build available for download.  I would like to try

Re: [DISCUSS] Programmatic Enforcement of APE/Documentation

+1 for addressing those issues in that way! On 3/22/24 4:57 PM, Ian Maxon wrote: Hi everyone, As brought up in some meetings some of you might have attended, there are some issues right now with the SQL++ grammar being out of sync with the documentation and railroad diagrams. A similar

Re: [VOTE] Release Apache AsterixDB 0.9.9 and Apache Hyracks 0.3.9 (RC0)

+1 Grabbed the NCService Installer version Test drove it with the 19006 UI Basis was Don Chamberlin sample data Included tabular views in the testing I did On 12/12/23 8:36 AM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB. The change that

Re: [VOTE][APE] Query Plan Cache

+1 We really need this! On 12/7/23 2:21 PM, Glenn Justo Galvizo wrote: Every time a query is issued to AsterixDB, the query must undergo compilation. If the same query is run repeatedly, this query must be recompiled each and every time. A query plan cache can help AsterixDB achieve a lower

Re: [VOTE][APE] Compute-Storage Separation (Cloud Mode Deployment)

+1 from me too. This will provide a nice hybrid between the current shared nothing architecture and shared disk like data accessibility. On Sat, Dec 2, 2023 at 12:24 PM Wail Alkowaileet wrote: > +1 > > On Sat, Dec 2, 2023 at 11:25 Till Westmann wrote: > > > +1 > > > > > On Dec 2, 2023, at

Re: [APE] Support COPY TO

nd out of object storage. > > > > > On Oct 25, 2023, at 10:04 PM, Mike Carey wrote: > > > > > > +1 -- Now maybe users will stop trying to retrieve huge results and > > wondering why the UI is choking! :-) This capability is actually long > > overdue. > > >

Re: [VOTE] Changing COPY FROM syntax

PS - I assume the semantics will be UPSERT-based? (Vs. one-time or INSERT-based?) On 10/24/23 10:16 AM, Wail Alkowaileet wrote: Hi all, I'm proposing to change the current syntax for COPY FROM. The current syntax looks as follows: COPY Customers USING localfs (

Re: [APE] Support COPY TO

+1  -- Now maybe users will stop trying to retrieve huge results and wondering why the UI is choking! :-) This capability is actually long overdue. On 10/24/23 9:53 AM, Wail Alkowaileet wrote: Currently, AsterixDB does not have a clean way to extract query results or dump a dataset to a

Re: [VOTE] Changing COPY FROM syntax

+1 for this change!  It will provide a superior user experience for sure... On 10/24/23 11:12 AM, Ian Maxon wrote: +1, looks more consistent with other statements to me. On Oct 24, 2023 at 10:16:48, Wail Alkowaileet wrote: Hi all, I'm proposing to change the current syntax for COPY

Re: Question about adding a central dataset for coordinate reference systems

It might be helpful to turn this into an APE proposal that folks can read and comment on, with the next level of detail.  My take is that I'd recommend trying regular collections for these at first - see if that's fast enough?  It would be nice if so.  This doesn't really feel like something

Re: Update of minimum Java version to 17

Sounds like a good plan! On Tue, Oct 3, 2023 at 9:33 AM Michael Blow wrote: > All, > > I'd like to propose updating the minimum Java version for *DB/Hyracks from > the current level of 11 to 17. As Java 11 premier support ended on 30-Sep, > and Java 17 has been out for over two years, it seems

Re: [DISCUSS] Altering storage write rate limiting, and adding read rate limiting

I've been meaning to reply to this - it's time!  I suspect that #1 is just historical, and happened because the limiter's initial focus was on keeping LSM activity (in particular big merges) from overrunning the other activities in the system.  It seems like this is the right move, IMO.  I

Re: [VOTE] Release Apache AsterixDB 0.9.8.1 and Hyracks 0.3.8.1

+1 to release. Tested the AsterixDB NCService Installer path. Downloaded the bits, started the engine, loaded up some Don C. test data (schemaless), created some tabular views, and queries both the collections and the views.  Worked like a charm.  (And gave me cool warnings when I asked for

Re: [VOTE] Accept Apache Iceberg support APE

+1 for APE1 (!) On 4/12/23 2:17 PM, Ian Maxon wrote: Based on the discussion in https://lists.apache.org/thread/w3o0xrth73ml7rxq71c7nytgmt8m2f4y, it seems like there is a positive sentiment towards our first APE proposal. Therefore I think it is time to vote. The vote is the usual procedure,

Re: [DISCUSS] Read support for Apache Iceberg tables

Agreed on that - it will be very cool to have Iceberg supported at this (query) level. On 3/30/23 11:42 AM, Ian Maxon wrote: This will be great to support and the changes required are not invasive or radical in any way, so it's a win on both fronts. Really looking forward to this being

Re: Broken link in the documentation for spatial join

In addition to this, I need to do an update (or two) on the primer documentation.  It's out of date and I should/can fix it... On 3/10/23 9:56 AM, Tin Vu wrote: Hi Ian, Could you please take a look at this? I believe that the markdown pages for spatial join was merged:

Re: [VOTE] AsterixDB Proposed Enhancements (APEs)

+1 On 3/10/23 10:54 AM, Till Westmann wrote: Hi, There seems to be a positive sentiment towards the APE proposal [1]. Let’s move on to a VOTE. Please vote [ ] +1 adopt the APE proposal [ ]  0 modify the proposal because ... [ ] -1 do not adopt the proposal because ... This procedural

Re: [DISCUSS] AsterixDB Proposed Enhancements (APEs)

I’d say a)! I think it can help a lot with info sharing across subprojects involving different components of the project. On Sun, Mar 5, 2023 at 7:36 PM Till Westmann wrote: > Hi, > > there were no comments on this proposal so far and I’m wondering why > that is. > > Do you think that the

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.8 (RC0)

+1 Tested the JDBC driver in DbVisualizer. Cheers, Mike On 5/18/22 5:08 PM, Dmitry Lychagin wrote: +1. Tested the JDBC driver in DbVisualizer and DBeaver. Thanks, -- Dmitry On 5/17/22, 4:47 PM, "Ian Maxon" wrote: EXTERNAL EMAIL: Use caution when opening attachments or

Re: [VOTE] Release Apache AsterixDB 0.9.8 and Apache Hyracks 0.3.8 (RC1)

+1  Kicked tires of NCService Installer SQL++ and tabular views - latest release still WFM!  :-) On 5/3/22 12:36 AM, Ian Maxon wrote: [X] +1 release these packages as Apache AsterixDB 0.9.8 and Apache Hyracks 0.3.8

Re: [VOTE] Release Apache AsterixDB 0.9.8 and Apache Hyracks 0.3.8 (RC0)

[X] +1 release these packages as Apache AsterixDB 0.9.8 and Apache Hyracks 0.3.8 [ ] 0 No strong feeling either way [ ] -1 do not release one or both packages because ... Installed via the NCService Installer Loaded a schemaless version of the manual's commerce data Ran a few SQL++ queries Made

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.7.1 (RC1)

+1 Downloaded driver and set it up in dbvisualizer and ran a SQL join query against DonCData-based views. On 2/25/22 2:52 AM, Ian Maxon wrote: Hi everyone, Please verify and vote on the first release of the AsterixDB JDBC connector. This release candidate fixes some issues with license

Re: [VOTE] Release Apache AsterixDB JDBC Connector 0.9.7.1 (RC1)

Will do by Monday! On Thu, Feb 24, 2022 at 11:52 PM Ian Maxon wrote: > Hi everyone, > > Please verify and vote on the first release of the AsterixDB JDBC > connector. > > This release candidate fixes some issues with license files that were > present > in RC0 as well as simplifying the list of

Fwd: [VOTE] Release Apache AsterixDB 0.9.7.1 and Hyracks 0.9.7.1 (RC0)

I failed to reply to the list, on Saturday, it seems  :-( A late-arriving vote Forwarded Message Subject: Re: [VOTE] Release Apache AsterixDB 0.9.7.1 and Hyracks 0.9.7.1 (RC0) Date: Sat, 11 Dec 2021 21:26:30 -0800 From: Mike Carey To: Ian Maxon +1 Used

Re: [VOTE] Accept donation of AsterixDB JDBC Driver

+1  (!!) On 8/22/21 11:51 PM, Till Westmann wrote: Hi, Couchbase would like to donate a JDBC driver for AsterixDB to the Apache Software foundation. [X] +1 accept the donation and add the driver to the AsterixDB code base [ ] +0 no opinion [ ] -1 do not accept the donation because... The

Re: [VOTE] Release Apache AsterixDB 0.9.7 and Hyracks 0.3.7 (RC1)

+1 Spot re-verified on the SQL++ TinySocial primer - also tried data export and re-verified the new plan viewer. On 6/15/21 11:58 AM, Wail Alkowaileet wrote: +1 - Signatures and hashes ok (verified with Ian as the older KEYS were *expired*) - Source compilation works. - Deployed cluster

Re: [VOTE] Release Apache AsterixDB 0.9.7 and Hyracks 0.3.7 (RC0)

[X ] +1 release these packages as Apache AsterixDB 0.9.7 and Apache Hyracks 0.3.7 I downloaded the Installer and test-drove it.  I ran all the SQL++ Primer statements against it using the new (19006) console. In the process I also tried different result display formats and tried the query

Re: [VOTE] Release Apache AsterixDB 0.9.6 and Hyracks 0.3.6 (RC0)

REMINDER:  Folks should please verify and vote! (That way our Fearless Leader can perhaps include the outcome in the report that's due in 2 days. :-)) On 10/4/20 11:51 PM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB The change that produced

Re: [VOTE] Release Apache AsterixDB 0.9.6 and Hyracks 0.3.6 (RC0)

+1 Verified that the binary version works as advertised using the SQL++ primer - all queries work, all hints have the intended effect on the plans. On 10/4/20 11:51 PM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB The change that produced

Re: Serious Hash Collisions in Hash Join/Groupby

I vaguely remember a similar performance bug years ago -- maybe that was w.r.t. the hash function(s) used in the series of levels when joining really big data.  There I think we ended up moving through a family/series of hash functions.  Does this fix do the same...?  (Just wondering if

Re: Substitute SQL++ sub-query

Tin, 1. There is no support for SQL++ in templates. Just AQL.  And AQL is now deprecated, in a mode where it is only supported to keep that one fuzzy join rule alive via AQL+.  The most recent public release of AsterixDB is the last one where AQL+ will work - and then AQL will completely

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC4)

JUST A REMINDER TO VOTE!  :-) On 7/6/20 3:51 PM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB The change that produced this release is up for review on Gerrit: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/7124 The release artifacts are

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC4)

[ X] +1 release these packages as Apache AsterixDB 0.9.5 and Apache Hyracks 0.3.5 I downloaded and exercised the local installer and verified that it works for the SQL++ Primer and also ran my external data sets CS122a stuff against it.  Everything seemed good!

Re: UDF Lifecycle

@Ian: This is a very interesting use/test case for the work you are doing at UCI on the new more dynamic deployment model, and on how the underlying UDF infrastructure can best support ML-model-based UDFs...! On 11/17/19 4:56 PM, Xikui Wang wrote: I wonder what would the

Re: Checkpoint file not forced to disk

Got it - but this does mean log reclamation has to be dependent on knowing that a successful checkpoint flush has occurred. On 10/28/19 5:22 AM, Murtadha Hubail wrote: @Mike Carey, For this specific system checkpoint file, we have a test that ensures even if the file is corrupted, the node

Re: Checkpoint file not forced to disk

Sounds right ... Explicit call needed! Better crash testing also needed; this one should not be impossible to test for. Do we have any crash testing that we can extend? On Sun, Oct 27, 2019, 7:15 PM Chen Luo wrote: > HI Murtadha, > > I don't think closing a file will automatically force it to

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC3)

+1 - Successfully did NCService install and ran through the SQL++ 101 exercises On 9/12/19 3:47 PM, Wail Alkowaileet wrote: +1 - Signatures and hashes ok. - NCService binary works. - Source compilation works. - Executed the sample cluster. Ingested tweets and run few queries. On Tue, Sep 3,

Re: Hyracks apriori algorithm

Igor, Not 100% sure what you mean by "filter" in this case - but - it sounds like you need to think about how to express Apriori as a sequence of operations that explicitly includes counted aggregation followed by normal filtering on the count field?  At least to get something working? 

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC1) -- REMINDER

Please check and vote if you haven't yet!  (On the latest re-spin of the release.) On 7/2/19 12:25 AM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB The change that produced this release and the change to advance the version are up for review

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC1)

+1  - Downloaded the binary  - Ran it through the SQL++ tutorial successfully On 7/3/19 9:02 AM, Taewoo Kim wrote: [V] +1 release these packages as Apache AsterixDB 0.9.5 and Apache Hyracks 0.3.5 - Checked the SHA256 of the zip files. - Builds were successful without any error. - Smoke test

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC0)

I ran the system through its SQL++ tutorial paces: +1 release these packages as Apache AsterixDB 0.9.5 and Apache Hyracks 0.3.5 On 6/25/19 6:19 PM, Ian Maxon wrote: [ ] +1 release these packages as Apache AsterixDB 0.9.5 and Apache Hyracks 0.3.5

Re: Move MergePolicy property validation to policy

This sounds like a good evolutionary change to me - others' thoughts? On 6/18/19 10:09 AM, Merlin Mao wrote: Currently all MergePolicy property names and types are defined in DatasetDeclParametersUtil for validation. It would be better to move them back to the MergePolicy or MergePolicyFactory

Re: Code review steps

+1 ! On 6/6/19 6:07 PM, Till Westmann wrote: Hi, I've proposed an addition to our code review steps on https://cwiki.apache.org/confluence/display/ASTERIXDB/Code+Reviews The only change from the steps we've been doing so far is the use of a "+1" code review by the author of a change to

Re: Firewall Blocked Local Host Site

Sounds like info we should also add for Windows users on the main Apache site? On 5/31/19 9:16 AM, Taewoo Kim wrote: In addition to Chen Luo's comment: If we decide to open ports: Open firewall ports in Windows 10

Re: GSoC 2019

Cool!  I would be happy to be looped in occasionally as well - so I will watch this space for the public progress updates.  In addition to adding the algorithm, we'll need to add an optimizer rule (actually update an existing rule) so that it gets picked when appropriate - and also a hint so

Re: Mailing list is down for UCI?

Weird! On 4/25/19 10:54 PM, Ian Maxon wrote: Yeah I observed this too. Messages reach the list from UCI addresses but messages from the list won’t reach them. I guess we need to talk to OIT to see what is going on, I thought it was only me. On Thu, Apr 25, 2019 at 18:18 Till Westmann wrote:

Re: Add record as argument to Java UDF

I will let someone else chime in on what the compilation error might be about, but approach 1 has the problem that you rightly tried to correct in approach 2 (because SELECT always returns an array of results).  But - could you say a bit more - up 5000 feet - about the use case you are trying

Re: [DRAFT][REPORT] Apache AsterixDB April 2019

+1 On Wed, Apr 10, 2019, 9:31 AM Till Westmann wrote: > Hi, > > Here's the report that I submitted to the board. > If there are corrections/additions please let me know, they can still be > incorporated in the next few days. > > Cheers, > Till > > -- > > Description: > > Apache AsterixDB is a

Re: Google Summer of Code 2019

Stephen, That sounds like a good project to me!  (The stretch goal may be tough, for the summer, but could be a good follow-on independent study project w/Preston - but worth aiming at!) Cheers, Mike On 3/31/19 10:01 PM, Stephen Ermshar wrote: Hi Till and AsterixDB Devs, I’m a junior CS

Re: [VOTE] Release Apache AsterixDB 0.9.4.1 and Hyracks 0.3.4.1 (RC2)

[X] +1 release these packages as Apache AsterixDB 0.9.4.1 and Apache Hyracks 0.3.4.1 (I downloaded and verified the NCService puzzle piece and it worked like a charm.) On 2/15/19 12:03 PM, Ian Maxon wrote: Hi everyone, Please verify and vote on the latest release of Apache AsterixDB The

Re: [DISCUSS] Migration of git repositories to gitbox.apache.org

Agreement! On 1/4/19 11:32 AM, Till Westmann wrote: Hi, I think that we should opt for a coordinated move of our repositories from git-wip-us to gitbox. To give us some time to prepare I suggest that we aim for a move on Monday, Jan 14. At the same time I would also like to request the removal

Re: [DRAFT][REPORT] Apache AsterixDB January 2019

Looks good to me:  +1 On 1/4/19 12:04 PM, Till Westmann wrote: Hi, Here’s a proposal for a board report. Thoughts/additions for the report? Cheers, Till — Description: Apache AsterixDB is a scalable big data management system (BDMS) that provides storage, management, and query

Re: We have to fix our downloads and configurations

(Wow, rereading this, it sounds a bit too much like the tone of a Trump tweet...  Ugh. :-)) On 12/16/18 12:57 PM, Michael J. Carey wrote: Naive users are routinely ending up with multiple node demo clusters and not realizing what they are doing or getting. Then they performance test and judge

Re: We have to fix our downloads and configurations

If you look at https://asterixdb.apache.org/docs/0.9.4/ncservice.html, which is prominently linked-to from the docs, what new users get is information about "Starting a small single-machine cluster using the NCService".  This is of course a bad idea for any real usage - it is only useful as a

Re: Install UDF library (NCService option)

(We need to update the documentation!) On 10/15/18 10:58 AM, Xikui Wang wrote: Hi Sandra, The UDF template repo that you used was outdated for some time. There has been some UDF refactorization in AsterixDB since that. I've just updated the template repo to the latest AsterixDB build. Please

Re: [VOTE] Release AsterixDB 0.9.4 and Hyracks 0.3.4 (RC2)

+1 (conditional on a doc fix issue that I just filed :-))  --  I tried the Mac binary and ran thru the SQL++ Primer almost successfully. On 9/28/18 10:17 AM, Xikui Wang wrote: +1 Verify that the Twitter feed works. On Mon, Sep 24, 2018 at 2:57 PM Ian Maxon wrote: Sorry, my mv got a bit

Re: Help required for AsterixDB Use case

n with AsterixDB. Does anyone have any clue if there is any link/article available, which shows how to set up an application with AsterixDB? Best Regards, Shobhit Chourasiya On Wed, Jun 13, 2018 at 10:13 AM, Mike Carey wrote: (+ dev) Yes, for reasons we don't understand, HBase is a lit

Re: Help required for AsterixDB Use case

(+ dev) Yes, for reasons we don't understand, HBase is a little more popular and better known than AsterixDB.  :-) More seriously, http://asterix.ics.uci.edu/publications.html has most/all of the AsterixDB publications, which may help.  They are VERY different systems - AsterixDB is

Re: Rename COLL_* aggregate functions into STRICT_*

+1 for the quick approach.  I doubt that we have a big legacy in this part of the SQL++ space...  :-) On 6/8/18 9:15 PM, Till Westmann wrote: Hi, There are 2 kinds of aggregation functions in SQL++ right now: 1) those with the prefix ARRAY_ (which share SQL's behavior or ignoring NULL) and

Re: Source locations

COOL!!! On 5/30/18 2:55 PM, Dmitry Lychagin wrote: All, The change that adds source locations has been merged. https://asterix-gerrit.ics.uci.edu/#/c/2659/ Source locations (org.apache.hyracks.api.exceptions.SourceLocation) are obtained from parser tokens (line and column) and propagated

Re: About null values in secondary index

Indeed. On Sun, May 27, 2018, 11:40 AM abdullah alamoudi wrote: > I think that this would be a bug if that was the case. I am pretty sure at > some point, we had a filter for nulls. > > Cheers, > Abdullah. > > > On May 26, 2018, at 5:25 AM, Chen Luo wrote: >

Re: Stability Q

Let me know what it turns out to be! On 5/1/18 12:31 AM, Murtadha Hubail wrote: This is most likely caused by missing heartbeat from the NC to the CC. Some macOS versions had issues with reestablishing connected sockets after waking up from sleep. But it could also be some unexpected

Re: Stability Q

in there. It might be easier to just compress the logs directory and attach it to a JIRA issue. On 05/01/2018, 11:02 AM, "Mike Carey" <dtab...@gmail.com> wrote: Yes, I used to see this on my Mac - but it had gone away for a year or more. It seems to be back. We asked the UWash stu

Re: Stability Q

become unresponsive for a few seconds and the CC marks them as dead because the defaults are too low. On Tue, May 1, 2018 at 1:23 AM, Murtadha Hubail <hubail...@gmail.com> wrote: Indeed :-) On 05/01/2018, 11:03 AM, "Mike Carey" <dtab...@gmail.com> wrote: (And several sl

Re: Optimizer Tests for SQLPP

Question:  Aren't there similarity join tests as well, though?  (I.e., is it not sufficient to let it defend itself, rather than also testing its component parts?) On 4/14/18 10:42 AM, Taewoo Kim wrote: For now, please do not remove AQL optimizer test cases since AQL+ functionality that is

Re: Is there an easier way to wrap/unwrap the entire tuple as a ByteBuffer?

cribes the binary format of the frame/tuple/fields? I was able to find out some information myself by digging into the code but if there is a document or page that describes this it can be of a great help. On Tue, Apr 10, 2018 at 12:01 PM, Mike Carey <dtab...@gmail.com> wrote: Naive (me as a stu

Re: Great LSM Ingestion news!

Nice!!! On 4/4/18 10:32 AM, Steven Jacobs wrote: Just wanted to share for anyone who wanted positive news today. Two of Chen's recent changes: https://asterix-gerrit.ics.uci.edu/#/c/2560/ https://asterix-gerrit.ics.uci.edu/#/c/2553/ will have a huge impact on write performance. I have a query

Re: "Erroneous" Sync Write Mode in ResultState

+1 for the proposed relaxation... On 4/2/18 10:55 AM, Chen Luo wrote: This is introduced by a recent fix [1]. It seems forcing writes when ResultState is being closed should give same semantics (but with much higher throughput)? [1] https://asterix-gerrit.ics.uci.edu/#/c/2319/ On Mon, Apr

Re: Specification of "Expression" in SQLPP

> Xikui > > On Thu, Mar 15, 2018 at 10:45 AM, Dmitry Lychagin < > dmitry.lycha...@couchbase.com> wrote: > > > Xikui, > > > > "(" SelectExpression ")" is permitted by the Subquery() production, > and > > Subquery() i

Re: Specification of "Expression" in SQLPP

Not sure, but I don't think this is (nearly) sufficient context/info to see what's going on.  With the current factoring of things, any other place that includes Expression is not going to allow a SelectExpression to appear directly as an Expression.  Your change would - which might be a major

Re: How to combine two Maps into one?

Ah - you guys are way too self-energetic - you need to cheat sometimes!  If you were to create a dataset in AsterixDB and run exactly that query on it, you can view the optimized query plan and the Hyracks job (and its location constraints).  That way you can (for future reference) see what

Re: AsterixDB Performance Tuning

what's the appropriate join algorithms to use and specify this in their query (i.e /*indexnl*/) (Basically they end-up doing the cost-based optimizer job :) ). Thanks, --Rana On Fri, Jan 26, 2018 at 2:15 PM, Mike Carey <dtab...@gmail.com> wrote: Rana, We need the physical hints because we hav

Re: Hyracks Job Requirement Configuration

+ dev On 1/28/18 3:37 PM, Rana Alotaibi wrote: Hi all, I would like to make AsterixDB utilizes all available CPU cores (39) that I have for the following query: USE mimiciii; SET `compiler.parallelism` "39"; SET `compiler.sortmemory` "128MB"; SET `compiler.joinmemory` "265MB"; SELECT

Re: Result Deletion Parameter

+1 On 1/16/18 3:55 PM, abdullah alamoudi wrote: I like the idea.. We need to be careful to only count successful complete reads. Side Note: We have an existing issue that the results are swept if the TTL passed even if the query is still running. On Jan 16, 2018, at 3:50 PM, Murtadha

Re: Comparison semantics for complex types

29, 2017 at 8:59 AM, Heri Ramampiaro <heri...@gmail.com> > > > wrote: > > > > > > > Is this similar to the “deep_equal” function I implemented a while > ago? > > > > > > > > -heri > > > > > > > > Sent f

Re: Comparison semantics for complex types

29, 2017 at 8:59 AM, Heri Ramampiaro <heri...@gmail.com> > > > wrote: > > > > > > > Is this similar to the “deep_equal” function I implemented a while > ago? > > > > > > > > -heri > > > > > > > > Sent f

Re: Comparison semantics for complex types

Indeed - we need it someday!  (Sooner rather than later would be nice.)  It basically needs to work like it does in languages like Python, I think.  (Cardinality and element by element equality for arrays, cardinality and order-independent equality for bags, field by field equality for

Re: [VOTE] Release Apache AsterixDB 0.9.3 and Hyracks 0.3.3 (RC0)

+1 Downloaded and ran the local version - walked through the tutorial docs (the SQL++ primer) - found and filed one issue in those that we should go ahead and (finally :-)) fix. On 11/20/17 5:07 PM, Ian Maxon wrote: Hi everyone, Please verify and vote on the 4th release of Apache

Re: Do changes for SQLPP still need to be duplicated in AQL?

Agreed...  We should formally deprecate AQL, perhaps in our next release? On 12/11/17 4:12 PM, abdullah alamoudi wrote: On Dec 11, 2017, at 11:49 AM, Steven Jacobs wrote: Hi all, I am looking at a change where corresponding AQL and SQLPP compilations are working

Re: Metadata.Dataset vs asterix.Dataset

(And we should be phasing out AQL) On 12/7/17 2:38 PM, Dmitry Lychagin wrote: Steven, I recently merged a change that fixes namespaces for all function signatures that SQLPP compiler generates to match namespaces defined in BuiltinFunctions and AlgebricksBuiltinFunctions (so ‘asterix’ /

Re: Polygon validation

@Ahmed?  Since you're the new defacto CGO (Chief Geo Officer) in AsterixDB - do you happen to know?  (I know you are on the GeoJSON side - but - not sure if you looked at the old polygon support/code at first?) On 11/30/17 12:57 AM, Sattam Alsubaiee wrote: Both convex and concave polygons

Re: About the system behavior when the checkpoint is corrupted

IMO missing checkpoints should not be taken as the indicator of first-time bootstrap - the invocation path for a node should be explicit about that.  I.e., a node should be started explicitly either in first-time mode or not, and should thus only delete data if it was told explicitly that it's

Re: About the system behavior when the checkpoint is corrupted

+1 for not proceeding and simply removing the data in this (ideally unreachable) state On 11/29/17 2:15 PM, Ian Maxon wrote: I too have seen this issue, but I couldn't reproduce or surmise how it might happen from just inspecting the code. How'd it appear for you? I would disagree that a

Re: SPARSOBJECT type tag

That would be fine; we can always re-introduce them later if appropriate.  The one below I don't remember (so I actually wouldn't have answered "future thought" for that one - e.g., as opposed to enumerations, which I remember thinking we might want someday). On 11/29/17 8:29 AM, Till

Re: algebricks-examples

+1 since to be useful it would need to be improved/updated/owned, and aside from VXQuery we don't seem to have any serious algebricks-level users of the software stack. On 11/27/17 6:06 PM, abdullah alamoudi wrote: +1 On Nov 27, 2017, at 5:50 PM, Till Westmann wrote:

Re: Change in merge policy syntax

+1 Could you share the resulting full proposed BNF rule for the CREATE DATASET statement? On 11/27/17 7:24 PM, abdullah alamoudi wrote: Dear devs, We would like to get your input on changing the syntax of the merge policy definition. Current syntax: prefix_merge

Re: Temporary Datasets

It's only TEMPORARY...  :-) On 11/20/17 12:41 PM, Ian Maxon wrote: Are we going to preserve the keyword? On Mon, Nov 20, 2017 at 12:06 PM, Michael Blow wrote: removing temporary datasets? +1 On Mon, Nov 20, 2017 at 1:52 PM Murtadha Hubail

Re: Unused types in ATypeTag

They were future thoughts.  On Nov 17, 2017 5:15 PM, "Wail Alkowaileet" wrote: > Hi all, > > There are few types that never been used (e.g ENUM, TYPE, unsigned > integers). Are they still there for legacy reason/back compatibility ? > > -- > > *Regards,* > Wail Alkowaileet

Re: MultiTransactionJobletEventListenerFactory

It's not clear to me why we can't do what's said below, BTW.  (@Murtadah, doesn't this sometimes happen in the land of metadata transactions now?) On 11/16/17 3:10 PM, abdullah alamoudi wrote: We can't use the same transaction id to feed multiple datasets.

Re: Changes to exception handling

+1 On 11/7/17 8:56 AM, Till Westmann wrote: Hi, I’d like to propose some changes to our guidelines for exception handling. The main motivation is to separate a) internal errors that are not useful to users and can’t be addressed by them (aka bugs) from b) external errors that inform the

Re: Java version issue?

n Fri, Nov 3, 2017 at 9:49 AM, Till Westmann <ti...@apache.org> wrote: I think that it’s not a macOS issue. AFAIK Apple stopped shipping the JRE with OS X 10.7, so the JRE/JDK installation should be done by the user. It seems to be more of a documentation issue (at least until Java 8 is EOL). C

Re: Adapting TimSort into AsterixDB/Hyracks

On Sat, Oct 28, 2017 at 12:05 PM, Mike Carey <dtab...@gmail.com> wrote: So the word on the web seems maybe to be that Quicksort is generally superior and cache-friendly (cache oblivious). Wondering if we should just get our Quicksort code under control? On 10/28/17 11:36 AM, Chen Luo wro

Re: Adapting TimSort into AsterixDB/Hyracks

on partially ordered dataset. Best regards, Chen Luo On Sat, Oct 28, 2017 at 10:58 AM, Mike Carey <dtab...@gmail.com> wrote: How is it on cache-friendliness? On 10/27/17 11:38 PM, abdullah alamoudi wrote: While I have no answer to the question of legality, this sounds great. ~Abdullah. On

Re: Adapting TimSort into AsterixDB/Hyracks

How is it on cache-friendliness? On 10/27/17 11:38 PM, abdullah alamoudi wrote: While I have no answer to the question of legality, this sounds great. ~Abdullah. On Oct 27, 2017, at 9:20 PM, Chen Luo wrote: Hi devs, I have adapted the TimSort algorithm used in JDK

Re: Support for user-defined-function on feeds

Presumably we should document its limitations, e.g., the SQL++ function bodies (like the AQL ones before) used on feeds should not involve joins or time-varying functions like current date/time, etc. On 10/21/17 9:36 AM, Xikui Wang wrote: Hi Devs, With the merge of the patch in [1], we no

Re: inserting into an autogenerated key dataset from a query result

Note that this works on the release from a couple of weeks ago, so this is a regression that got missed by our tests (surprise!) it seems. On 9/19/17 10:08 AM, Steven Jacobs wrote: Hi all, I'm seeing a strange issue when inserting into a dataset with an autogenerated key the result of a

Re: Time to deprecate AQL?

Or possibly how to retire it and then re-do similarity joins using the join infrastructure ideas discussed a year or so ago, perhaps.  (We should think about whether or not the time it would take to do SQL+++ might be better used to not use that approach anymore - it was an interesting

  1   2   >