CSV support for results?

[Michael Carey]

Once upon a time AsterixDB had support for returning its query results 
in various formats - including CSV/TSV - but I tried the other day and 
it seems like it's kind of half-there but pretty broken.  Does anyone 
know the status of it for real?  Thanks!  It would be nice to have that 
support (or have it back).

Re: Generate an iteration counter

[Michael Carey]

See if the new window function support (see the OVER clause in the SQL++ 
Language documentation and the Window Functions section of the Built-in 
Functions documentation for more info) meets your needs?  The rank or 
dense_rank functionality might do the trick  (Eventually SQL++ will 
have positional variable support, but right now it does not; that's in 
progress, as it's slightly tricky in a shared-nothing parallel setting.)


On 8/16/19 2:53 AM, f...@legsem.com wrote:

Hello everyone, apologies if this is a trivial question.

I am trying to do something like this:


DROP DATAVERSE test IF EXISTS;
CREATE DATAVERSE test;
USE test;

CREATE TYPE B AS {
    B1: string,
    B2: string
};

CREATE TYPE RooTType As{
    id:uuid,
    A: string,
    B:[B]
};

CREATE DATASET  root (RooTType) PRIMARY KEY id AUTOGENERATED;

INSERT INTO root([
    {
    "A": "a1",
    "B": [{
    "B1": "b111",
    "B2": "b112"
    },
    {
    "B1": "b121",
    "B2": "b122"
    }]
    },
    {
    "A": "a2",
    "B": [{
    "B1": "b211",
    "B2": "b212"
    },
    {
    "B1": "b221",
    "B2": "b222"
    }]
    },
    {
    "A": "a3",
    "B": [{
    "B1": "b311",
    "B2": "b312"
    },
    {
    "B1": "b321",
    "B2": "b322"
    }]
    }
]);

FROM root, root.B as B
SELECT root.A, (
    FROM B
    LET I = I + 1
    SELECT B.B1, B.B2, I
) AS B;



Basically I would like I to be an index of the occurrence of B being 
produced. Would be value 1 or 2.


Output should look like this:

[ { "A": "a1", "B": [ { "B1": "b111", "B2": "b112", "I": 1 }, { "B1": 
"b121", "B2": "b122", "I": 2 } ] }
, { "A": "a2", "B": [ { "B1": "b211", "B2": "b212", "I": 1 }, { "B1": 
"b221", "B2": "b222", "I": 2 } ] }
, { "A": "a3", "B": [ { "B1": "b311", "B2": "b312", "I": 1 }, { "B1": 
"b321", "B2": "b322", "I": 2 } ] }

 ]

Is there a way to do that?

Thank you!

Fady

Fwd: Firewall Blocked Local Host Site

[Michael Carey]

This sounds vaguely familiar - thoughts?  (Anyone?) This is one of a 
couple of hundred temporary Windows customers of AsterixDB... :-)



 Forwarded Message 
Subject:Firewall Blocked Local Host Site
Date:   Fri, 31 May 2019 15:42:03 + (UTC)
From:   CS 122A on Piazza 
Reply-To:   re...@piazza.com
To: mjca...@ics.uci.edu



*-- Reply directly to this email above this line to create a new follow 
up. Or Click here 
 
to view.--*

A new Question was posted by Jeremy Anderson.

*Firewall Blocked Local Host Site*

One of the scripts prompted a windows firewall popup and I accidentally 
skipped over it. Now, when I try to use the local host website, it gets 
blocked for me. Does someone know what exactly I have to change on my 
firewall to make it work? If not, can someone post a picture of the 
popup if they come across it?




Search or link to this question with @807. Follow it 
 to get 
notified when a response comes in.


Sign up for more classes at http://piazza.com/uci.


Tell a colleague about Piazza. It's free, after all.

Thanks,
The Piazza Team
--
Contact us at t...@piazza.com


You're receiving this email because mjca...@ics.uci.edu is enrolled in 
CS 122A at University of California, Irvine. Sign in 
 to manage your email preferences or un-enroll 
 from this class.

Email id: jtvr1nor3pg25g|jwc99uq2w2a2zc|9NThYXn2mS3

Fwd: [Dbworld] *Deadline in a week* Workshop on Big Data Open Source Systems (BOSS'19) CfP

[Michael Carey]

@All:  Do we want to propose anything this year?


 Forwarded Message 
Subject: 	[Dbworld] *Deadline in a week* Workshop on Big Data Open 
Source Systems (BOSS'19) CfP

Date:   Wed, 08 May 2019 07:07:49 -0500
From:   PINAR TOZUN 
Reply-To:   dbworld_ow...@yahoo.com
To: dbwo...@cs.wisc.edu


Following the great success of the previous BOSS workshops collocated 
with VLDB since 2015, the fifth Workshop on Big Data Open Source Systems 
(BOSS'19) will again give a deep-dive introduction into several active, 
publicly available, open-source systems. The systems will be presented 
in tutorials by experts of the presented systems. The tutorials will 
give details on installation and non-trivial examples while using the 
presented system.


The workshop will consist of tutorials, we will publish the tutorial 
proposals on the website and encourage the presenters to publish the 
tutorial resources. In the previous editions, we published slides and 
project websites. We would encourage proposers to engage participants in 
a hands-on quick jump start familiarity exercise for the system.


In order to propose a tutorial, please email a short abstract with a 
brief description of the system, an outline of the planned tutorial, the 
technology used for the hands on tutorial, a list of presenters 
involved, and a link to the website of your system to bossvld...@gmail.com


Important dates:
Proposals for tutorials are accepted until May 15, 2019.
Accepted presenters will be notified by June 15, 2019.
BOSS'19 is on August 30, 2019.

For more information, please visit http://boss.dima.tu-berlin.de/
___
Please do not post msgs that are not relevant to the database community 
at large. Go to www.cs.wisc.edu/dbworld for guidelines and posting forms.

To unsubscribe, go to https://lists.cs.wisc.edu/mailman/listinfo/dbworld

New SQL++ book!

[Michael Carey]

FYI:  There is now a free PDF download of Don Chamberlin's terrific new 
book "SQL++ for SQL Users" available to Apache AsterixDB users on the 
Apache AsterixDB web site. (It's available in the Documentation 
pulldown.)  It's also available to non-Apache AsterixDB users on 
Amazon.  :-)

Stability Q

[Michael Carey]

Q:  Do we maybe have a stability regression in recent versions (e.g., 
the one leading to the UW snapshot)?  They have occasionally seen things 
like this and I just did too.  (The system had been running for awhile 
in the background on my Mac - e.g., for a day or so.)


Error: Cluster is in UNUSABLE state.
 One or more Node Controllers have left or haven't joined yet.

AsterixDB 0.9.3 release - vet and vote! (semi-urgent!)

[Michael Carey]

Just a reminder that voting remains open on 0.9.3 - please vet it and 
vote on it.  Thanks!  It would be nice to close this out and have it 
declarable as one of the progress bullet points in our next ASF report.

Re: Storage Structure Change

[Michael Carey]

Murtadha,

When the utility is ready, could you post another note on where it lives 
and how to use it and also what the best practice advice is on how to 
back up before proceeding?  Thx!


Cheers,

Mike


On 11/27/17 3:07 PM, Murtadha Hubail wrote:


Hi all,

Recently, a feature was added to AsterixDB to allow a dataset to be 
rebalanced from a set of nodes (a node group) to another node group. 
Rebalancing a dataset will result in redistributing the dataset’s data 
to the nodes in the new node group. Since a single node may appear in 
both the old and the new node group, a new level in the storage tree 
had to be introduced to distinguish between the old and the new copies 
of the dataset. To do that without breaking backward compatibility for 
existing users who would like to upgrade binaries without having to 
reload their existing data, we added a migration utility that will run 
on the node startup and migrate the data to the new storage structure. 
*_However, it is recommended that you backup your existing data to 
avoid any permanent data loss in case of any unexpected failures 
during the migration process_*_._


Cheers,

Murtadha

Time to deprecate AQL?

[Michael Carey]

As AsterixDB evolves, and additional features are added - e.g., DISTINCT 
aggregate support, or properly implemented query-bodied functions, 
supporting two query languages is hugely expensive:  Updating two 
grammars, parsers, rules, tests, ... IMO it is time to let go of AQL as 
an externally supported interface to AsterixDB and only have SQL++ going 
forward.  I think "everyone" has migrated - and if not we should force 
that migration.  (Cloudberry is on SQL++ nowadays, BAD is on SQL++ 
nowadays, ...)  Any objections?  If not, I think we should make this 
decision officially and stop putting energy into carrying the AQL legacy 
around with us.  Thoughts?

Fwd: Releases, announcements, interviews at ApacheCon.

[Michael Carey]

Can we do a social-media-analytics focused release in time?  :-)

(I.e., brag about the new feeds model, have the how-to's (being sure 
that they work SOLIDLY) around Tweets and SNLP as 
third-party-pluggables, etc.?


Just a thought.



 Forwarded Message 
Subject:Releases, announcements, interviews at ApacheCon.
Date:   Fri, 21 Apr 2017 13:44:01 -0400
From:   Rich Bowen 
Reply-To:   rbo...@apache.org, apachecon-disc...@apache.org
Organization:   Apache Software Foundation
To: committ...@apache.org



As you know by now, ApacheCon is just a few weeks away. Committer/Member
rates are still available. (Use APCOMM17 to register!)

If your project is planning a release in the next few weeks, please
consider doing this during the week of ApacheCon, and letting us know
(email pr...@apache.org and rbo...@apache.org, please) so that we can
make a splash around your release.

If you have other news items that you wish to promote during this time
period, that counts too.

If you will be *at* ApacheCon, and want to talk about your project, your
latest release, your idea for the incubator, or generally about Apache,
open source, or your technology hobby, please email
featherc...@apache.org and let us know, so that we can schedule an
interview with you during the event.

Thanks!

--
Rich Bowen
WWW: http://apachecon.com/
Twitter: @ApacheCon

Fwd: Re: ASterixDB on Windows

[Michael Carey]

I wonder if we need to somehow steer users to one of the available 
packages - right now I'm not sure a user would know which one to pick / 
why?  (E.g., should we make the NCService one special by adding " 
(recommended)" after it?




 Forwarded Message 
Subject:Re: ASterixDB on Windows
Date:   Mon, 10 Apr 2017 10:11:56 -0700
From:   Ian Maxon 
Reply-To:   us...@asterixdb.apache.org
To: Mike Carey 
CC: us...@asterixdb.apache.org, Michael Blow 



Hi Gharib,
If you download the "asterix-server" package from the main apache site
(https://asterixdb.apache.org), and follow the Quick Start
instructions for NCService, while replacing *.sh scripts with their
*.bat equivalents, it should just work on windows at this point.

-Ian

On Mon, Apr 10, 2017 at 7:27 AM, Mike Carey  wrote:

@Ian or @MBlow:  Could one of you guys send the best pointer to Windows
directions?  Thanks!!

(@Gharib, we just had about 200 students do it successfully in a class last
term - so it is now possible - watch this space for details.)


On 4/9/17 4:49 PM, Gharibi, Gharib (UMKC-Student) wrote:

Hi,

I would like to use AsterixDB as a case study on a project that I am
currently working on (within ArchStudio). Therefore, I am wondering if there
is a way to run AsterixDB on windows. I have found a link
(https://issues.apache.org/jira/browse/ASTERIXDB-989) in which it explains
how to download AsterixDB on windows, but I could not find any repository
for that code. Is there any way I can have access to that code base? Or find
a way, without using YARN, to run AsterixDB on Windows?



Thank you so much in advance,

Gharib Gharibi

Re: problem with managix download

[Michael Carey]

I think our online instructions are indeed kind of broken - maybe we 
need to create a brand new version?  The old ones date back to the 
ancient days (2013)...  :-)  One of the UCR grad students was also 
complaining about broken links and not finding the right stuff earlier 
today...  (And I can't wait until our released version isn't this old, 
old one! :-))



On 1/16/17 4:11 PM, Ian Maxon wrote:

Hey Carina,
Which link did you notice was broken? I just tried the old released 
version and developer snapshots and both seemed to work for me.


- Ian

On Mon, Jan 16, 2017 at 4:01 PM, Yingyi Bu > wrote:


Carina,

For a single node installation, you can follow the
instructions here:
https://github.com/apache/asterixdb/blob/master/README.md


Best,
Yingyi

On Mon, Jan 16, 2017 at 10:00 AM, Carina Schaller
> wrote:

Hello together,

I have the following problem:

I followed your guide for the Single-Machine AsterixDB
installation. One step requires the download of Managix. But
the link to this download does not work.

Are there any other possibilities to download Managix or could
you please fix this problem?

Best regards,

Carina Schaller

Re: Trio: AsterixDB, Spark and Zeppelin.

[Michael Carey]

Kevin,

Thanks!  That helps a lot.  Now what we need to know (possibly above 
your pay grade :-)) is what the timetable is for UCLA (i) wanting to get 
the results of your assessment of how well what's there works and meets 
their needs and (ii) wanting to put stuff into production (and at what 
scale).  I don't anticipate the review and merging taking forever, but 
this will be Wail's first AsterixDB code contribution - last I knew he 
was addressing initial reviewing comments (and I'm not sure if all 
reviews are done yet) - but I think we next need to ask 
UCLA/Sean/Amarnath for the timetable info.


Cheers,

Mike


On 8/10/16 1:33 PM, Coakley, Kevin wrote:

Mike,

UCLA wanted a way to do use Spark’s Machine Learning packages with data stored 
in AsterixDB. We started looking at the Spark connector as way to access the 
data in AsterixDB directly instead of having to export the data from AsterixDB 
to a file and import the file in Spark. I don’t know how this is fits into 
Amarnath’s projects, I was just following up on a request from UCLA to see what 
would be involved in providing this Spark connector to others.

The current status is: I have the Spark connector working in a test environment 
with the queries provided by Wail. I was planning on loading a small amount of 
data into the test AsterixDB server with the Schema Inferencer code and running 
my own queries, but I have not had time yet. The issue with providing others 
with access to the Spark connector is the version of AsterixDB that we are 
running that contains the Twitter data does not have the Schema Inferencer code 
and therefor will not work with the Spark connector.

I don’t believe SDSC would want to update the AsterixDB servers that contain 
the Twitter data with the Schema Inferencer code until after it has been 
approved by you and merged into the master branch. However, even after the 
Schema Inferencer code has been merged into the master branch, we wouldn’t have 
it ready of people to use right away.

I offered to load a small subset of the data from our main servers into my test 
environment that has a working Spark connector for UCLA to test, but it sounds 
like they misunderstood my offer.

I would be happy to help you test the Schema Inferencer and Spark connector if 
you have specific items that you want me to check, I can also give others that 
you select access to test environment so they can run tests themselves. 
Otherwise, I will respond here if I discover any issues.

My current test environment is Zeppelin with the Spark connector on server A, 
AsterixDB with the Schema Inferencer code on server B and a Spark 1.6.0 cluster 
running on servers C, D and E.

-Kevin



On 8/10/16, 9:36 AM, "Mike Carey"  wrote:

 Kevin,
 
 Q:  Could you chime back in here - please 'cc' the user list - with a

 brief (maybe one paragraph) summary of what you are actually trying to
 do at the moment and what its current status is?  (And your timeframe,
 etc.?)
 
 My impression until yesterday was that you were slowly/leisurely

 exploring the new Spark connector to AsterixDB that Wail worked on -
 essentially as his first "beta" user - and that things were moving at
 the pace you wanted (and were setting).  As an early adopter, I was also
 under the impression that you were using his branch for your
 explorations, while he was addressing code review comments, etc.
 However, when I arrived back home in OC after a trip yesterday, I was
 the recipient of a message (via a back channel) warning me that there
 was a blocking issue at SDSC that UCI wasn't being attentive to, one
 that had AsterixDB on the brink being given up on by the UCLA folks, and
 that we'd better get on it or  (Meanwhile I had not heard any such
 thing from UCLA directly; I was not aware of any blocking Spark issues
 for SDSC nor of any transitively blocking implications for UCLA, and it
 still doesn't look from what I see below like there was one.)
 
 I think that we need to have SDSC's activities be much more visible here

 - likewise for UCLA's - so that the Apache AsterixDB community has much
 better visibility into the goals, activities, progress, and problems of
 our early adopters.  The community wants users to be successful!  It
 will be much more effective (and healthy and productive) if we all know
 what's going on and it is clear to all how each of those things are going.
 
 Thanks!
 
 Mike
 
 
 On 8/10/16 8:36 AM, Wail Alkowaileet wrote:

 > Hi Kevin,
 >
 > Cool!
 > Please let me know if you need any assistance.
 >
 > On Aug 8, 2016 1:42 PM, "Coakley, Kevin"  wrote:
 >
 >> Hi Wail,
 >>
 >> I figure out the problem, AsterixDB was configured for 127.0.0.1. The
 >> notebook at https://github.com/Nullification/asterixdb-spark-
 >>