[jira] [Commented] (USERGRID-1348) Fix ignored test in CollectionDeleteTest

2019-05-31 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852714#comment-16852714
 ] 

Keyur Karnik commented on USERGRID-1348:


On faster processing machines, this issue started popping up again. It was 
being caused by a the same time getting applied to entities that were not 
supposed to be deleted. Fixed it in :
[https://github.com/apache/usergrid/pull/626]

> Fix ignored test in CollectionDeleteTest
> 
>
> Key: USERGRID-1348
> URL: https://issues.apache.org/jira/browse/USERGRID-1348
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Minor
> Fix For: 2.2.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The CollectionDeleteTest has been ignored with a "fix later" comment. This 
> test fails sporadically and will require some debugging.
> This should not affect actual functionality as Collection Delete has been 
> tested and found working.
> Ref :
> https://github.com/apache/usergrid/blob/3c31713fe366d446c0b1bacd2b89dd3c5eed8db8/stack/core/src/test/java/org/apache/usergrid/persistence/CollectionDeleteTest.java#L46



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (USERGRID-1359) Integrate Usergrid Stack with ASF build pipeline

2019-05-26 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848540#comment-16848540
 ] 

Keyur Karnik commented on USERGRID-1359:


Fixed in [https://github.com/apache/usergrid/pull/625]

> Integrate Usergrid Stack with ASF build pipeline
> 
>
> Key: USERGRID-1359
> URL: https://issues.apache.org/jira/browse/USERGRID-1359
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> Create a Jenkins job to build Usergrid stack daily and hourly (based on SCM 
> poll changes) on builds.apache.org



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1359) Integrate Usergrid Stack with ASF build pipeline

2019-05-26 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1359:
--

 Summary: Integrate Usergrid Stack with ASF build pipeline
 Key: USERGRID-1359
 URL: https://issues.apache.org/jira/browse/USERGRID-1359
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik
 Fix For: 2.2.0


Create a Jenkins job to build Usergrid stack daily and hourly (based on SCM 
poll changes) on builds.apache.org



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Interest in taking over / helping resolve the following issues

2019-04-05 Thread Keyur Karnik
Can you give me the ticket numbers you are planning to take up?

On Fri, Apr 5, 2019, 18:38 Rahul Singh  wrote:

> It just showed the options I gave when logged In. I can only append to the
> ticket I can’t assign it to myself.
>
> rahul.xavier.si...@gmail.com
>
> http://cassandra.link
>
>  I'm speaking at #DataStaxAccelerate, the world’s premiere
> #ApacheCassandra conference, and I want to see you there! Use my code
> Singh50 for 50% off your registration. www.datastax.com/accelerate
> On Apr 5, 2019, 5:57 PM -0400, Michael Russo ,
> wrote:
> > Rahul,
> >
> > Your last email is a broken image (e.g. I think the image contents got
> > stripped).
> >
> > On Fri, Apr 5, 2019 at 2:43 PM Rahul Singh  >
> > wrote:
> >
> > > [image: image.png]
> > >
> > >
> > > rahul.xavier.si...@gmail.com
> > >
> > > http://cassandra.link
> > >
> > > I'm speaking at #DataStaxAccelerate, the world’s premiere
> #ApacheCassandra
> > > conference, and I want to see you there! Use my code Singh50 for 50%
> off
> > > your registration. www.datastax.com/accelerate
> > >
> > >
> > > On Fri, Apr 5, 2019 at 5:36 PM Michael Russo 
> > > wrote:
> > >
> > > > Rahul,
> > > >
> > > > I added you to the Contributors roles for the Usergrid project in
> JIRA.
> > > > Can
> > > > you check if you have better access now?
> > > >
> > > > -Michael
> > > >
> > > > On Fri, Apr 5, 2019 at 2:16 PM Rahul Singh <
> rahul.xavier.si...@gmail.com>
> > > > wrote:
> > > >
> > > > > Wierd. I'm logged in as me (xingh) but cannot seem to see any way
> to
> > > > assign
> > > > > it to myself. I can add comments, files ,etc.
> > > > >
> > > > >
> > > > >
> > > > > rahul.xavier.si...@gmail.com
> > > > >
> > > > > http://cassandra.link
> > > > >
> > > > > I'm speaking at #DataStaxAccelerate, the world’s premiere
> > > > #ApacheCassandra
> > > > > conference, and I want to see you there! Use my code Singh50 for
> 50% off
> > > > > your registration. www.datastax.com/accelerate
> > > > >
> > > > >
> > > > > On Fri, Apr 5, 2019 at 4:47 PM Keyur Karnik <
> keyur.kar...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Rahul, you should be able to assign them to yourself as long as
> you
> > > > > create
> > > > > > an account.
> > > > > >
> > > > > > On Fri, Apr 5, 2019, 13:10 Rahul Singh <
> rahul.xavier.si...@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Can someone assign these tickets to me if no one else is
> working on
> > > > > them?
> > > > > > > rahul.xavier.si...@gmail.com
> > > > > > >
> > > > > > > http://cassandra.link
> > > > > > >
> > > > > > > I'm speaking at #DataStaxAccelerate, the world’s premiere
> > > > > > #ApacheCassandra
> > > > > > > conference, and I want to see you there! Use my code Singh50
> for 50%
> > > > > off
> > > > > > > your registration. www.datastax.com/accelerate
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Mar 5, 2019 at 11:56 PM Rahul Singh <
> > > > > > rahul.xavier.si...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > My username is "xingh" on the ASF Jira . I noticed there are
> lots
> > > > of
> > > > > > > items
> > > > > > > > in JIRA that could be set to "Done" since they are already
> merged.
> > > > > > > >
> > > > > > > > My goal is to get the velocity of issue resolution to
> released
> > > > build
> > > > > to
> > > > > > > be
> > > > > > > > consistent even if it's 1 issue a week, hopefully better than
> > > > that.
> > > > > > > >
> > > > > > > > Here's my short list of Issues / Epics that I can work on.
> > > > > > > >
> > > > > > > > RD.Usergrid.Issues
> > > > > > > >
> > > > > > > > - EPIC
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-932
> > > > > > > > - RELEASE
> > > > > > > > -
> > > > > > >
> https://issues.apache.org/jira/projects/USERGRID/versions/12333013
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-1347
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-403
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-402
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-557
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-1249
> > > > > > > > - ISSUES
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-946
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-1262
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-134
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-497
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-167
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-951
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-56
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-369
> > > > > > > > - https://issues.apache.org/jira/browse/USERGRID-841
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>


Re: Interest in taking over / helping resolve the following issues

2019-04-05 Thread Keyur Karnik
Rahul, you should be able to assign them to yourself as long as you create
an account.

On Fri, Apr 5, 2019, 13:10 Rahul Singh  wrote:

> Can someone assign these tickets to me if no one else is working on them?
> rahul.xavier.si...@gmail.com
>
> http://cassandra.link
>
> I'm speaking at #DataStaxAccelerate, the world’s premiere #ApacheCassandra
> conference, and I want to see you there! Use my code Singh50 for 50% off
> your registration. www.datastax.com/accelerate
>
>
> On Tue, Mar 5, 2019 at 11:56 PM Rahul Singh 
> wrote:
>
> >
> > My username is "xingh" on the ASF Jira . I noticed there are lots of
> items
> > in JIRA that could be set to "Done" since they are already merged.
> >
> > My goal is to get the velocity of issue resolution to released build to
> be
> > consistent even if it's 1 issue a week, hopefully better than that.
> >
> > Here's my short list of Issues / Epics that I can work on.
> >
> > RD.Usergrid.Issues
> >
> >- EPIC
> >   - https://issues.apache.org/jira/browse/USERGRID-932
> >- RELEASE
> >   -
> https://issues.apache.org/jira/projects/USERGRID/versions/12333013
> >  - https://issues.apache.org/jira/browse/USERGRID-1347
> >  - https://issues.apache.org/jira/browse/USERGRID-403
> >  - https://issues.apache.org/jira/browse/USERGRID-402
> >  - https://issues.apache.org/jira/browse/USERGRID-557
> >  - https://issues.apache.org/jira/browse/USERGRID-1249
> >   - ISSUES
> >   - https://issues.apache.org/jira/browse/USERGRID-946
> >   - https://issues.apache.org/jira/browse/USERGRID-1262
> >   - https://issues.apache.org/jira/browse/USERGRID-134
> >   - https://issues.apache.org/jira/browse/USERGRID-497
> >   - https://issues.apache.org/jira/browse/USERGRID-167
> >   - https://issues.apache.org/jira/browse/USERGRID-951
> >   - https://issues.apache.org/jira/browse/USERGRID-56
> >   - https://issues.apache.org/jira/browse/USERGRID-369
> >   - https://issues.apache.org/jira/browse/USERGRID-841
> >
> >
>


Re: new committer: Keyur Karnik

2019-03-27 Thread Keyur Karnik
Thanks Michael and everyone else on the team.
Looking forward to some interesting work here!

Cheers,
Keyur

On Wed, Mar 27, 2019, 12:40 Michael Russo  wrote:

> The Project Management Committee (PMC) for Apache Usergrid
> has invited Keyur Karnik to become a committer and we are pleased
> to announce that he has accepted.
>
> Keyur has been actively contributing to Usergrid, helping the project get
> to a better state.
>
> Commits: https://github.com/apache/usergrid/commits?author=keyurkarnik
>   - These include new features, test stability, and bufixes.
>
> Mailing List:
> https://lists.apache.org/list.html?*@usergrid.apache.org:lte=1M:keyur
>   - Recent volunteer for setting up Jenkins CI integration for the project.
>
> Being a committer enables easier contribution to the
> project since there is no need to go via the patch
> submission process. This should enable better productivity.
> Being a PMC member enables assistance with the management
> and to guide the direction of the project.
>
>  Welcome Keyur!
>


Re: Getting Usergrid to a Better Stable State

2019-03-21 Thread Keyur Karnik
$200 is not the price. It's the amount of free credits available.

On Thu, Mar 21, 2019, 06:05 Rahul Singh 
wrote:

> We can also use open maps if needed or I’m happy to sponsor 200 if that’s
> going to be something we can’t move around.
> On Mar 20, 2019, 7:58 PM -0400, Keyur Karnik ,
> wrote:
> > So, everyone, does anyone know of a Usergrid Gmail or apps account that
> can
> > be used for such purposes. We should try to avoid creating new accounts
> if
> > possible.
> >
> > On Wed, Mar 20, 2019, 13:14 Alex Muramoto 
> wrote:
> >
> > > It looks like the error is due to the account that created the api key
> > > being deleted, so we will need to generate a new one from a different
> > > account.
> > >
> > > For maps there is a monthly $200 credit so we can just cap usage at
> that
> > > threshold. The likelihood we would ever hit the cap for the usergrid
> site
> > > is basically zero.
> > >
> > > On Wed, Mar 20, 2019 at 12:48 PM Keyur Karnik 
> > > wrote:
> > >
> > > > I was about to ask the same question. We need to have access to the
> > > account
> > > > that created the API key or create a new account for Usergrid and
> use the
> > > > new API key.
> > > >
> > > > We may also need to remove a couple of deprecated calls.
> > > >
> > > > On Wed, Mar 20, 2019, 12:46 Alex Muramoto 
> > > wrote:
> > > >
> > > > > We're going to need a Google Cloud Platform account with billing
> > > enabled
> > > > to
> > > > > generate the key to fix the map. Any idea if Apache has an account
> > > > > available we can get a key generated from? Another option is to
> switch
> > > > to a
> > > > > different map provider.
> > > > >
> > > > > On Wed, Feb 20, 2019 at 10:52 PM Alex Muramoto <
> alexmuram...@gmail.com
> > > >
> > > > > wrote:
> > > > >
> > > > > > I can volunteer to fix the map. Since I’m the dev advocate for
> maps
> > > > now,
> > > > > I
> > > > > > probably know how to do that or something ;)
> > > > > >
> > > > > > On Wed, Feb 20, 2019 at 5:03 PM Michael Russo <
> > > michaelaru...@gmail.com
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Happy New Year Everyone!
> > > > > > >
> > > > > > > There are a handful of items that make contributing to/using
> > > Usergrid
> > > > > more
> > > > > > > difficult. I'm emailing to see if we can get some volunteers
> for
> > > > > tackling
> > > > > > > each of these items.
> > > > > > >
> > > > > > > 1. We have one unsigned binary. I believe it was released back
> in
> > > > 2016.
> > > > > > > Either this binary is not needed it needs signed.
> > > > > > > https://checker.apache.org/projs/usergrid.html
> > > > > > >
> > > > > > > 2. The community website page that loads some google map is no
> > > longer
> > > > > > > working: http://usergrid.apache.org/community/. I just see an
> error
> > > > > > > message: "Oops! Something went wrong."
> > > > > > >
> > > > > > > 3. It would be good if we could leverage ASF Jenkins
> infrastructure
> > > to
> > > > > get
> > > > > > > some builds going, nightly or otherwise. Does anyone have time
> to
> > > set
> > > > > this
> > > > > > > up and see if there is an integration with Github/Gitbox for
> running
> > > > > tests
> > > > > > > upon PR creation?
> > > > > > > https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> > > > > > >
> > > > > > > 4. We should consider doing another release v2.2.0. The current
> > > master
> > > > > > > branch has many fixes on top of v2.1.0. Does anyone have
> cycles to
> > > > lead
> > > > > > > the
> > > > > > > effort of getting a new release out there?
> > > > > > >
> > > > > > > Thanks in advance. If you have some cycles to help, just mail
> back
> > > on
> > > > > this
> > > > > > > thread and confirm. I can help too, but wanted to email the
> > > community
> > > > > > > first.
> > > > > > >
> > > > > > > Thanks.
> > > > > > > Michael R.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>


Re: Getting Usergrid to a Better Stable State

2019-03-20 Thread Keyur Karnik
So, everyone, does anyone know of a Usergrid Gmail or apps account that can
be used for such purposes. We should try to avoid creating new accounts if
possible.

On Wed, Mar 20, 2019, 13:14 Alex Muramoto  wrote:

> It looks like the error is due to the account that created the api key
> being deleted, so we will need to generate a new one from a different
> account.
>
> For maps there is a monthly $200 credit so we can just cap usage at that
> threshold. The likelihood we would ever hit the cap for the usergrid site
> is basically zero.
>
> On Wed, Mar 20, 2019 at 12:48 PM Keyur Karnik 
> wrote:
>
> > I was about to ask the same question. We need to have access to the
> account
> > that created the API key or create a new account for Usergrid and use the
> > new API key.
> >
> > We may also need to remove a couple of deprecated calls.
> >
> > On Wed, Mar 20, 2019, 12:46 Alex Muramoto 
> wrote:
> >
> > > We're going to need a Google Cloud Platform account with billing
> enabled
> > to
> > > generate the key to fix the map. Any idea if Apache has an account
> > > available we can get a key generated from? Another option is to switch
> > to a
> > > different map provider.
> > >
> > > On Wed, Feb 20, 2019 at 10:52 PM Alex Muramoto  >
> > > wrote:
> > >
> > > > I can volunteer to fix the map. Since I’m the dev advocate for maps
> > now,
> > > I
> > > > probably know how to do that or something ;)
> > > >
> > > > On Wed, Feb 20, 2019 at 5:03 PM Michael Russo <
> michaelaru...@gmail.com
> > >
> > > > wrote:
> > > >
> > > >> Happy New Year Everyone!
> > > >>
> > > >> There are a handful of items that make contributing to/using
> Usergrid
> > > more
> > > >> difficult. I'm emailing to see if we can get some volunteers for
> > > tackling
> > > >> each of these items.
> > > >>
> > > >> 1. We have one unsigned binary. I believe it was released back in
> > 2016.
> > > >> Either this binary is not needed it needs signed.
> > > >> https://checker.apache.org/projs/usergrid.html
> > > >>
> > > >> 2. The community website page that loads some google map is no
> longer
> > > >> working: http://usergrid.apache.org/community/. I just see an error
> > > >> message: "Oops! Something went wrong."
> > > >>
> > > >> 3. It would be good if we could leverage ASF Jenkins infrastructure
> to
> > > get
> > > >> some builds going, nightly or otherwise. Does anyone have time to
> set
> > > this
> > > >> up and see if there is an integration with Github/Gitbox for running
> > > tests
> > > >> upon PR creation?
> > > >> https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> > > >>
> > > >> 4. We should consider doing another release v2.2.0. The current
> master
> > > >> branch has many fixes on top of v2.1.0. Does anyone have cycles to
> > lead
> > > >> the
> > > >> effort of getting a new release out there?
> > > >>
> > > >> Thanks in advance. If you have some cycles to help, just mail back
> on
> > > this
> > > >> thread and confirm. I can help too, but wanted to email the
> community
> > > >> first.
> > > >>
> > > >> Thanks.
> > > >> Michael R.
> > > >>
> > > >
> > >
> >
>


Re: Getting Usergrid to a Better Stable State

2019-03-20 Thread Keyur Karnik
I was about to ask the same question. We need to have access to the account
that created the API key or create a new account for Usergrid and use the
new API key.

We may also need to remove a couple of deprecated calls.

On Wed, Mar 20, 2019, 12:46 Alex Muramoto  wrote:

> We're going to need a Google Cloud Platform account with billing enabled to
> generate the key to fix the map. Any idea if Apache has an account
> available we can get a key generated from? Another option is to switch to a
> different map provider.
>
> On Wed, Feb 20, 2019 at 10:52 PM Alex Muramoto 
> wrote:
>
> > I can volunteer to fix the map. Since I’m the dev advocate for maps now,
> I
> > probably know how to do that or something ;)
> >
> > On Wed, Feb 20, 2019 at 5:03 PM Michael Russo 
> > wrote:
> >
> >> Happy New Year Everyone!
> >>
> >> There are a handful of items that make contributing to/using Usergrid
> more
> >> difficult. I'm emailing to see if we can get some volunteers for
> tackling
> >> each of these items.
> >>
> >> 1. We have one unsigned binary. I believe it was released back in 2016.
> >> Either this binary is not needed it needs signed.
> >> https://checker.apache.org/projs/usergrid.html
> >>
> >> 2. The community website page that loads some google map is no longer
> >> working: http://usergrid.apache.org/community/. I just see an error
> >> message: "Oops! Something went wrong."
> >>
> >> 3. It would be good if we could leverage ASF Jenkins infrastructure to
> get
> >> some builds going, nightly or otherwise. Does anyone have time to set
> this
> >> up and see if there is an integration with Github/Gitbox for running
> tests
> >> upon PR creation?
> >> https://cwiki.apache.org/confluence/display/INFRA/Jenkins
> >>
> >> 4. We should consider doing another release v2.2.0. The current master
> >> branch has many fixes on top of v2.1.0. Does anyone have cycles to lead
> >> the
> >> effort of getting a new release out there?
> >>
> >> Thanks in advance. If you have some cycles to help, just mail back on
> this
> >> thread and confirm. I can help too, but wanted to email the community
> >> first.
> >>
> >> Thanks.
> >> Michael R.
> >>
> >
>


Re: Getting Usergrid to a Better Stable State

2019-02-21 Thread Keyur Karnik
I can take up the Jenkins integration. I will need access to it though.

Thanks,
Keyur

On Wed, Feb 20, 2019 at 5:03 PM Michael Russo 
wrote:

> Happy New Year Everyone!
>
> There are a handful of items that make contributing to/using Usergrid more
> difficult. I'm emailing to see if we can get some volunteers for tackling
> each of these items.
>
> 1. We have one unsigned binary. I believe it was released back in 2016.
> Either this binary is not needed it needs signed.
> https://checker.apache.org/projs/usergrid.html
>
> 2. The community website page that loads some google map is no longer
> working: http://usergrid.apache.org/community/. I just see an error
> message: "Oops! Something went wrong."
>
> 3. It would be good if we could leverage ASF Jenkins infrastructure to get
> some builds going, nightly or otherwise. Does anyone have time to set this
> up and see if there is an integration with Github/Gitbox for running tests
> upon PR creation?
> https://cwiki.apache.org/confluence/display/INFRA/Jenkins
>
> 4. We should consider doing another release v2.2.0. The current master
> branch has many fixes on top of v2.1.0. Does anyone have cycles to lead the
> effort of getting a new release out there?
>
> Thanks in advance. If you have some cycles to help, just mail back on this
> thread and confirm. I can help too, but wanted to email the community
> first.
>
> Thanks.
> Michael R.
>


[jira] [Resolved] (USERGRID-1356) Make entity fetcher threads configurable for Export

2019-01-29 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik resolved USERGRID-1356.

   Resolution: Fixed
Fix Version/s: 2.2.0

https://github.com/apache/usergrid/pull/620

> Make entity fetcher threads configurable for Export
> ---
>
> Key: USERGRID-1356
> URL: https://issues.apache.org/jira/browse/USERGRID-1356
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Minor
> Fix For: 2.2.0
>
>
> The new export tool first fetches all Entity ids and as it fetches them, it 
> starts parallel exports in batches of 1000.
> Depending on the data in each entity and the number and size of assets and 
> members (connections etc), this process can take a long time. But as we can 
> safely process it in parallel, we can increase the number of threads to make 
> it faster (keeping resource utilization in mind).
> To do this, we need to add configs to set and tune fetcher thread counts.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (USERGRID-1356) Make entity fetcher threads configurable for Export

2019-01-29 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755517#comment-16755517
 ] 

Keyur Karnik commented on USERGRID-1356:


Fixed here :

https://github.com/apache/usergrid/pull/620

> Make entity fetcher threads configurable for Export
> ---
>
> Key: USERGRID-1356
> URL: https://issues.apache.org/jira/browse/USERGRID-1356
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Minor
>
> The new export tool first fetches all Entity ids and as it fetches them, it 
> starts parallel exports in batches of 1000.
> Depending on the data in each entity and the number and size of assets and 
> members (connections etc), this process can take a long time. But as we can 
> safely process it in parallel, we can increase the number of threads to make 
> it faster (keeping resource utilization in mind).
> To do this, we need to add configs to set and tune fetcher thread counts.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1356) Make entity fetcher threads configurable for Export

2019-01-29 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1356:
--

 Summary: Make entity fetcher threads configurable for Export
 Key: USERGRID-1356
 URL: https://issues.apache.org/jira/browse/USERGRID-1356
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik


The new export tool first fetches all Entity ids and as it fetches them, it 
starts parallel exports in batches of 1000.

Depending on the data in each entity and the number and size of assets and 
members (connections etc), this process can take a long time. But as we can 
safely process it in parallel, we can increase the number of threads to make it 
faster (keeping resource utilization in mind).

To do this, we need to add configs to set and tune fetcher thread counts.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1355) Dissociate akka based Unique Value checks across regions for a multi region distributed cluster using Qakka

2019-01-29 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1355:
--

 Summary: Dissociate akka based Unique Value checks across regions 
for a multi region distributed cluster using Qakka
 Key: USERGRID-1355
 URL: https://issues.apache.org/jira/browse/USERGRID-1355
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik
 Fix For: 2.2.0


To setup a Qakka cluster across multiple regions, we need to enable the 
following settings

usergrid.cluster.enabled

usergrid.cluster.seeds (add multiple regions and seed ips)

elasticsearch.queue_impl=DISTRIBUTED

 

Doing so sets up the Akka cluster across region but it has some side effects 

collection.uniquevalues.usecluster setting which is true by default comes into 
play, so all unique value checks start using Akka. To compound it, if Akka is 
multi region, it coordinates with all Akka remote clusters as well. This may 
not be intended and there is no way to stop this (just the remote checks)

 

To resolve this :

Set the collection.uniquevalues.usecluster to false by default

Create a new config that can restrict UniqueValue checks and Akka chatter to 
the local cluster only.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Issue Comment Deleted] (USERGRID-1354) Akka cluster does not work for more than 2 regions

2019-01-29 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik updated USERGRID-1354:
---
Comment: was deleted

(was: Fixed in PR 619

https://github.com/apache/usergrid/pull/619)

> Akka cluster does not work for more than 2 regions
> --
>
> Key: USERGRID-1354
> URL: https://issues.apache.org/jira/browse/USERGRID-1354
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> When UG is started with Akka enabled and more than 2 DCs are provided in the 
> UG seeds, the cluster startup fails with 
> Error starting Akka akka.actor.InvalidActorNameException: actor name [client] 
> is not unique! 
> Multiple regions are set by setting this config
> usergrid.cluster.seeds=dc1:ip1, dc1:ip2, dc2:ip1, dc2:ip2, dc3:ip1, dc3:ip2



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1354) Akka cluster does not work for more than 2 regions

2019-01-29 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1354:
--

 Summary: Akka cluster does not work for more than 2 regions
 Key: USERGRID-1354
 URL: https://issues.apache.org/jira/browse/USERGRID-1354
 Project: Usergrid
  Issue Type: Bug
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik


When UG is started with Akka enabled and more than 2 DCs are provided in the UG 
seeds, the cluster startup fails with 
Error starting Akka akka.actor.InvalidActorNameException: actor name [client] 
is not unique! 

Multiple regions are set by setting this config

usergrid.cluster.seeds=dc1:ip1, dc1:ip2, dc2:ip1, dc2:ip2, dc3:ip1, dc3:ip2



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (USERGRID-1353) Shiro cache tokens are not synced with Cassandra

2018-12-19 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik resolved USERGRID-1353.

   Resolution: Fixed
Fix Version/s: 2.2.0

https://github.com/apache/usergrid/pull/618

> Shiro cache tokens are not synced with Cassandra 
> -
>
> Key: USERGRID-1353
> URL: https://issues.apache.org/jira/browse/USERGRID-1353
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>    Reporter: Keyur Karnik
>Assignee: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> When there are multiple logins, cassandra tokens and shiro cache tokens get 
> out of sync.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (USERGRID-1353) Shiro cache tokens are not synced with Cassandra

2018-12-19 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik updated USERGRID-1353:
---
Issue Type: Bug  (was: Improvement)

> Shiro cache tokens are not synced with Cassandra 
> -
>
> Key: USERGRID-1353
> URL: https://issues.apache.org/jira/browse/USERGRID-1353
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>    Reporter: Keyur Karnik
>Assignee: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> When there are multiple logins, cassandra tokens and shiro cache tokens get 
> out of sync.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (USERGRID-1353) Shiro cache tokens are not synced with Cassandra

2018-12-19 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725505#comment-16725505
 ] 

Keyur Karnik commented on USERGRID-1353:


Fixed in https://github.com/apache/usergrid/pull/618

> Shiro cache tokens are not synced with Cassandra 
> -
>
> Key: USERGRID-1353
> URL: https://issues.apache.org/jira/browse/USERGRID-1353
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>    Reporter: Keyur Karnik
>Assignee: Keyur Karnik
>Priority: Major
>
> When there are multiple logins, cassandra tokens and shiro cache tokens get 
> out of sync.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (USERGRID-1353) Shiro cache tokens are not synced with Cassandra

2018-12-17 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik updated USERGRID-1353:
---
Description: When there are multiple logins, cassandra tokens and shiro 
cache tokens get out of sync.  (was: In certain cases, a guest user can end up 
getting app level access. This needs to be fixed to ensure that the case does 
not occur.

This case can occur if an app user has logged in before the guest user.

Due to this case, either of the guest or app principals logging out results in 
the other one logging out as well.)
 Issue Type: Improvement  (was: Bug)
Summary: Shiro cache tokens are not synced with Cassandra   (was: Guest 
user gets application level access)

> Shiro cache tokens are not synced with Cassandra 
> -
>
> Key: USERGRID-1353
> URL: https://issues.apache.org/jira/browse/USERGRID-1353
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>    Reporter: Keyur Karnik
>Assignee: Keyur Karnik
>Priority: Major
>
> When there are multiple logins, cassandra tokens and shiro cache tokens get 
> out of sync.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1353) Guest user gets application level access

2018-12-17 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1353:
--

 Summary: Guest user gets application level access
 Key: USERGRID-1353
 URL: https://issues.apache.org/jira/browse/USERGRID-1353
 Project: Usergrid
  Issue Type: Bug
  Components: Stack
Reporter: Keyur Karnik
Assignee: Keyur Karnik


In certain cases, a guest user can end up getting app level access. This needs 
to be fixed to ensure that the case does not occur.

This case can occur if an app user has logged in before the guest user.

Due to this case, either of the guest or app principals logging out results in 
the other one logging out as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1351) Refactor constants used by MapManagerFactory

2018-10-22 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1351:
--

 Summary: Refactor constants used by MapManagerFactory
 Key: USERGRID-1351
 URL: https://issues.apache.org/jira/browse/USERGRID-1351
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik
 Fix For: 2.2.0


Move constants for every class using MapManagerFactory:createMapManager to a 
central location ensuring that there are no conflicts.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1350) Add feature to provide a restore password when soft deleting an application

2018-10-22 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1350:
--

 Summary: Add feature to provide a restore password when soft 
deleting an application
 Key: USERGRID-1350
 URL: https://issues.apache.org/jira/browse/USERGRID-1350
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
Assignee: Keyur Karnik
 Fix For: 2.2.0


This is a feature request for managed usergrid apps. When soft deleting an 
application, a password can be supplied so that an orgadmin for the org 
containing the app cannot restore the app without supplying the password.

If the owner of the app requests data deletion, that owner should not be able 
to restore.

Sys admin can restore without knowing the password.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (USERGRID-1349) Feature for querying directly from C* instead of ES when using UUID or name

2018-09-26 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik reassigned USERGRID-1349:
--

Assignee: Keyur Karnik

> Feature for querying directly from C* instead of ES when using UUID or name
> ---
>
> Key: USERGRID-1349
> URL: https://issues.apache.org/jira/browse/USERGRID-1349
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>    Assignee: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> Add a feature so that Usergrid does not have to query Elasticsearch if the 
> query contains only (one or more) UUIDs or names.
> This kind of query can be termed as a 'direct' query where a new operator 
> 'direct' can be introduced. Any queries with 'direct' will be fired only on 
> C* and not ES as all required details are present in C*
>  
> Example :  
> 0:8080/org/app/collection?ql = select * where  *direct* name1, uuid1, uuid2, 
> name2
> This should result in a C* only fetch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (USERGRID-1349) Feature for querying directly from C* instead of ES when using UUID or name

2018-09-25 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik resolved USERGRID-1349.

Resolution: Fixed

> Feature for querying directly from C* instead of ES when using UUID or name
> ---
>
> Key: USERGRID-1349
> URL: https://issues.apache.org/jira/browse/USERGRID-1349
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> Add a feature so that Usergrid does not have to query Elasticsearch if the 
> query contains only (one or more) UUIDs or names.
> This kind of query can be termed as a 'direct' query where a new operator 
> 'direct' can be introduced. Any queries with 'direct' will be fired only on 
> C* and not ES as all required details are present in C*
>  
> Example :  
> 0:8080/org/app/collection?ql = select * where  *direct* name1, uuid1, uuid2, 
> name2
> This should result in a C* only fetch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (USERGRID-1349) Feature for querying directly from C* instead of ES when using UUID or name

2018-09-25 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626850#comment-16626850
 ] 

Keyur Karnik commented on USERGRID-1349:


This has been implemented and tested in 
https://github.com/apache/usergrid/pull/597

> Feature for querying directly from C* instead of ES when using UUID or name
> ---
>
> Key: USERGRID-1349
> URL: https://issues.apache.org/jira/browse/USERGRID-1349
> Project: Usergrid
>  Issue Type: Improvement
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>Priority: Major
> Fix For: 2.2.0
>
>
> Add a feature so that Usergrid does not have to query Elasticsearch if the 
> query contains only (one or more) UUIDs or names.
> This kind of query can be termed as a 'direct' query where a new operator 
> 'direct' can be introduced. Any queries with 'direct' will be fired only on 
> C* and not ES as all required details are present in C*
>  
> Example :  
> 0:8080/org/app/collection?ql = select * where  *direct* name1, uuid1, uuid2, 
> name2
> This should result in a C* only fetch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1349) Feature for querying directly from C* instead of ES when using UUID or name

2018-09-25 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1349:
--

 Summary: Feature for querying directly from C* instead of ES when 
using UUID or name
 Key: USERGRID-1349
 URL: https://issues.apache.org/jira/browse/USERGRID-1349
 Project: Usergrid
  Issue Type: Improvement
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
 Fix For: 2.2.0


Add a feature so that Usergrid does not have to query Elasticsearch if the 
query contains only (one or more) UUIDs or names.

This kind of query can be termed as a 'direct' query where a new operator 
'direct' can be introduced. Any queries with 'direct' will be fired only on C* 
and not ES as all required details are present in C*

 

Example :  
0:8080/org/app/collection?ql = select * where  *direct* name1, uuid1, uuid2, 
name2

This should result in a C* only fetch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (USERGRID-1348) Fix ignored test in CollectionDeleteTest

2018-09-24 Thread Keyur Karnik (JIRA)


 [ 
https://issues.apache.org/jira/browse/USERGRID-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keyur Karnik resolved USERGRID-1348.

Resolution: Fixed

> Fix ignored test in CollectionDeleteTest
> 
>
> Key: USERGRID-1348
> URL: https://issues.apache.org/jira/browse/USERGRID-1348
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>Priority: Minor
> Fix For: 2.2.0
>
>
> The CollectionDeleteTest has been ignored with a "fix later" comment. This 
> test fails sporadically and will require some debugging.
> This should not affect actual functionality as Collection Delete has been 
> tested and found working.
> Ref :
> https://github.com/apache/usergrid/blob/3c31713fe366d446c0b1bacd2b89dd3c5eed8db8/stack/core/src/test/java/org/apache/usergrid/persistence/CollectionDeleteTest.java#L46



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (USERGRID-1348) Fix ignored test in CollectionDeleteTest

2018-09-24 Thread Keyur Karnik (JIRA)


[ 
https://issues.apache.org/jira/browse/USERGRID-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626644#comment-16626644
 ] 

Keyur Karnik commented on USERGRID-1348:


Fixed here : 

https://github.com/apache/usergrid/pull/597/commits/5fc3c506a14ac28a702a2c146466b9f3907e4125

> Fix ignored test in CollectionDeleteTest
> 
>
> Key: USERGRID-1348
> URL: https://issues.apache.org/jira/browse/USERGRID-1348
> Project: Usergrid
>  Issue Type: Bug
>  Components: Stack
>Affects Versions: 2.2.0
>Reporter: Keyur Karnik
>Priority: Minor
> Fix For: 2.2.0
>
>
> The CollectionDeleteTest has been ignored with a "fix later" comment. This 
> test fails sporadically and will require some debugging.
> This should not affect actual functionality as Collection Delete has been 
> tested and found working.
> Ref :
> https://github.com/apache/usergrid/blob/3c31713fe366d446c0b1bacd2b89dd3c5eed8db8/stack/core/src/test/java/org/apache/usergrid/persistence/CollectionDeleteTest.java#L46



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (USERGRID-1348) Fix ignored test in CollectionDeleteTest

2018-09-24 Thread Keyur Karnik (JIRA)
Keyur Karnik created USERGRID-1348:
--

 Summary: Fix ignored test in CollectionDeleteTest
 Key: USERGRID-1348
 URL: https://issues.apache.org/jira/browse/USERGRID-1348
 Project: Usergrid
  Issue Type: Bug
  Components: Stack
Affects Versions: 2.2.0
Reporter: Keyur Karnik
 Fix For: 2.2.0


The CollectionDeleteTest has been ignored with a "fix later" comment. This test 
fails sporadically and will require some debugging.

This should not affect actual functionality as Collection Delete has been 
tested and found working.

Ref :
https://github.com/apache/usergrid/blob/3c31713fe366d446c0b1bacd2b89dd3c5eed8db8/stack/core/src/test/java/org/apache/usergrid/persistence/CollectionDeleteTest.java#L46



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: [VOTE] Michael Russo as new VP of Usergrid

2018-09-24 Thread Keyur Karnik
+1

On Mon, Sep 24, 2018, 13:11 Ed Anuff  wrote:

> +1
>
> On Mon, Sep 24, 2018 at 1:03 PM Todd Nine  wrote:
>
> > Hi All,
> >   After some discussion on the private list, Michael Russo has
> volunteered
> > to take over as the VP of Apache Usergrid.  I have too much on my plate
> to
> > continue, I'm not giving it the attention it deserves.   I think Russo
> is a
> > great choice to become the VP of Usergrid.
> >
> > This vote will close 72 hours from now.  It needs 3 +1 votes from PMC
> > members to pass.
> >
> > +1
> >
> > Thanks,
> > Todd
> >
>


Pull request 597

2018-09-24 Thread Keyur Karnik
Hi all,
I need to get this PR merged into master. I have fixed all tests and some
bugs to ensure that the build compiles and tests correctly.

https://github.com/apache/usergrid/pull/597

Thanks,
Keyur


Re: unable to run tests

2018-09-05 Thread Keyur Karnik
These tests have now been fixed. This was being caused by some race
conditions internally.
Solved by annotating affected classes with @NotThreadSafe

On Tue, Sep 4, 2018 at 9:27 AM Keyur Karnik  wrote:

> Hi all,
>
> I am attempting to fix the tests for the current master branch.
> https://github.com/apache/usergrid/pull/598 solves one such test broken
> due to the last merge. Please merge that.
>
> At the same time, there are a few other tests breaking, but exhibit
> inconsistent behavior
>
> mvn -pl services test
>
> [INFO] Usergrid Services .. FAILURE [11:52
> min]
>
>
> ---
> Test set: org.apache.usergrid.management.OrganizationConfigIT
>
> ---
> Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.88 sec
> <<< FAILURE! - in org.apache.usergrid.management.OrganizationConfigIT
> testNonOrgProperty(org.apache.usergrid.management.OrganizationConfigIT)
> Time elapsed: 0.097 sec  <<< ERROR!
> java.lang.NullPointerException: null
> at
> org.apache.shiro.mgt.AuthorizingSecurityManager.hasRole(AuthorizingSecurityManager.java:153)
> at
> org.apache.shiro.subject.support.DelegatingSubject.hasRole(DelegatingSubject.java:224)
> at
> org.apache.usergrid.security.shiro.utils.SubjectUtils.isServiceAdmin(SubjectUtils.java:285)
> at
> org.apache.usergrid.services.AbstractService.checkPermissionsForPath(AbstractService.java:1359)
> at
> org.apache.usergrid.services.AbstractService.checkPermissionsForCollection(AbstractService.java:1325)
> at
> org.apache.usergrid.services.AbstractCollectionService.postCollection(AbstractCollectionService.java:411)
> at
> org.apache.usergrid.services.groups.activities.ActivitiesService.postCollection(ActivitiesService.java:50)
> at
> org.apache.usergrid.services.AbstractService.invokeCollection(AbstractService.java:811)
>
>
> But if I run this test individually, it works fine.
>
> mvn -pl services test -Dtest=OrganizationConfigIT
>
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.352 sec
> - in org.apache.usergrid.management.OrganizationConfigIT
> 2018-09-04 09:21:37,253 INFO (Thread-4) ActorSystemManagerImpl - Downing
> self: akka.tcp://ClusterSystem@localhost:2551 from cluster: ClusterSystem
>
> Results :
>
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>
> [INFO]
> 
> [INFO] BUILD SUCCESS
> [INFO]
> 
> [INFO] Total time: 59.764 s
> [INFO] Finished at: 2018-09-04T09:21:37-07:00
> [INFO]
> 
>
>
> This test has 3 Rules :
>
> @Rule
>
> public ClearShiroSubject clearShiroSubject = new ClearShiroSubject();
>
>
> @ClassRule
>
> public static ServiceITSetup setup = new ServiceITSetupImpl();
>
>
> @Rule
>
> public NewOrgAppAdminRule newOrgAppAdminRule = new
> NewOrgAppAdminRule( setup );
>
> The NewOrgAppAdminRule gets called for all the methods, and the error is
> thrown during this rule execution. The same rule executes successfully for
> the other methods.
> I added a couple of new dummy methods, and what I observed is that this
> error gets thrown for the LAST method that is going to be tested.
>
> Do any of you have prior experience on this behavior?
>
>
>
>
>
> On Tue, Aug 28, 2018 at 8:15 AM Todd Nine  wrote:
>
>> Looks like you'll need Cassandra Running locally. I can't seem to connect
>> to it to run the data access integration tests.  See the connection to
>> localhost port 9042 below.
>>
>> 1) Error injecting constructor,
>> com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s)
>> tried for query failed (tried: localhost/127.0.0.1:9042
>> (com.datastax.driver.core.TransportException: [localhost/127.0.0.1:9042]
>> Cannot connect))
>>   at
>> org.apache.usergrid.persiste
>>
>> On Tue, Aug 28, 2018 at 7:41 AM Rod Simpson  wrote:
>>
>> > Hello all,
>> >
>> > I am unable to get the tests to run.  I have tried the last 5 commits,
>> but
>> > I get the same error:
>> >
>> > Tests in error:
>> >
>> >
>> >
>> ColumnNameIteratorTest.org.apache.usergrid.persistence.core.astyanax.ColumnNameIteratorTest
>> > » Creation
>> >
>> >
>> >
>&g

Re: unable to run tests

2018-09-04 Thread Keyur Karnik
Hi all,

I am attempting to fix the tests for the current master branch.
https://github.com/apache/usergrid/pull/598 solves one such test broken due
to the last merge. Please merge that.

At the same time, there are a few other tests breaking, but exhibit
inconsistent behavior

mvn -pl services test

[INFO] Usergrid Services .. FAILURE [11:52
min]

---
Test set: org.apache.usergrid.management.OrganizationConfigIT
---
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.88 sec
<<< FAILURE! - in org.apache.usergrid.management.OrganizationConfigIT
testNonOrgProperty(org.apache.usergrid.management.OrganizationConfigIT)
Time elapsed: 0.097 sec  <<< ERROR!
java.lang.NullPointerException: null
at
org.apache.shiro.mgt.AuthorizingSecurityManager.hasRole(AuthorizingSecurityManager.java:153)
at
org.apache.shiro.subject.support.DelegatingSubject.hasRole(DelegatingSubject.java:224)
at
org.apache.usergrid.security.shiro.utils.SubjectUtils.isServiceAdmin(SubjectUtils.java:285)
at
org.apache.usergrid.services.AbstractService.checkPermissionsForPath(AbstractService.java:1359)
at
org.apache.usergrid.services.AbstractService.checkPermissionsForCollection(AbstractService.java:1325)
at
org.apache.usergrid.services.AbstractCollectionService.postCollection(AbstractCollectionService.java:411)
at
org.apache.usergrid.services.groups.activities.ActivitiesService.postCollection(ActivitiesService.java:50)
at
org.apache.usergrid.services.AbstractService.invokeCollection(AbstractService.java:811)


But if I run this test individually, it works fine.

mvn -pl services test -Dtest=OrganizationConfigIT

Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.352 sec -
in org.apache.usergrid.management.OrganizationConfigIT
2018-09-04 09:21:37,253 INFO (Thread-4) ActorSystemManagerImpl - Downing
self: akka.tcp://ClusterSystem@localhost:2551 from cluster: ClusterSystem

Results :

Tests run: 3, Failures: 0, Errors: 0, Skipped: 0

[INFO]

[INFO] BUILD SUCCESS
[INFO]

[INFO] Total time: 59.764 s
[INFO] Finished at: 2018-09-04T09:21:37-07:00
[INFO]



This test has 3 Rules :

@Rule

public ClearShiroSubject clearShiroSubject = new ClearShiroSubject();


@ClassRule

public static ServiceITSetup setup = new ServiceITSetupImpl();


@Rule

public NewOrgAppAdminRule newOrgAppAdminRule = new NewOrgAppAdminRule(
setup );

The NewOrgAppAdminRule gets called for all the methods, and the error is
thrown during this rule execution. The same rule executes successfully for
the other methods.
I added a couple of new dummy methods, and what I observed is that this
error gets thrown for the LAST method that is going to be tested.

Do any of you have prior experience on this behavior?





On Tue, Aug 28, 2018 at 8:15 AM Todd Nine  wrote:

> Looks like you'll need Cassandra Running locally. I can't seem to connect
> to it to run the data access integration tests.  See the connection to
> localhost port 9042 below.
>
> 1) Error injecting constructor,
> com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s)
> tried for query failed (tried: localhost/127.0.0.1:9042
> (com.datastax.driver.core.TransportException: [localhost/127.0.0.1:9042]
> Cannot connect))
>   at
> org.apache.usergrid.persiste
>
> On Tue, Aug 28, 2018 at 7:41 AM Rod Simpson  wrote:
>
> > Hello all,
> >
> > I am unable to get the tests to run.  I have tried the last 5 commits,
> but
> > I get the same error:
> >
> > Tests in error:
> >
> >
> >
> ColumnNameIteratorTest.org.apache.usergrid.persistence.core.astyanax.ColumnNameIteratorTest
> > » Creation
> >
> >
> >
> MultiKeyColumnNameIteratorTest.org.apache.usergrid.persistence.core.astyanax.MultiKeyColumnNameIteratorTest
> > » Creation
> >
> >
> >
> MultiRowColumnIteratorTest.org.apache.usergrid.persistence.core.astyanax.MultiRowColumnIteratorTest
> > » Creation
> >
> >
> >
> MigrationInfoSerializationTest.org.apache.usergrid.persistence.core.migration.data.MigrationInfoSerializationTest
> > » Creation
> >
> >
> >
> DataStaxClusterTest.org.apache.usergrid.persistence.core.datastax.DataStaxClusterTest
> > » Creation
> >
>  CQLUtilsTest.org.apache.usergrid.persistence.core.datastax.CQLUtilsTest »
> > Creation
> >
> >
> >
> > They fail in the same place for all of the last 5 commits:
> >
> > 2018-08-28 07:24:37 INFO driver.core.ClockFactory.newInstance(52)-
> > Using native clock to generate timestamps.
> > Tests run: 5, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.82 sec
> > <<< FAILURE! - in
> > org.apache.usergrid.persistence.core.astyanax.MultiRowColumnIteratorTest
> > 

Usergrid Ongoing Attic Vote / New Contributions

2018-08-21 Thread Keyur Karnik
Hi,

I and another dev are planning to make sustained contributions to Usergrid
and will be opening PRs over the next few days and weeks. Some immediate
contributions will include:


- fixes for Shiro related session issues
- improve export utilities (current utils are taking 6 days to export a few
million records - we wrote new code that manages the same in a couple of
hours)
- update the APNS push libraries to use the latest adapters
- update dependent libraries to their latest versions (like RxJ, loggers,
Akka etc)
- bug fixes

Some Longer term contributions:

- add support the later versions of Elasticsearch
- make Elasticsearch optional -- persistent storage/graph without query for
the deployments that do not need full-text search
- continue the consolidation of Cassandra drivers - get rid of hector (and
then astyanax) and stick to Datastax driver

Some of these changes are ready to be contributed and we just have not
opened the pull requests yet. Requesting that the ongoing attic vote be
stopped so that we can continue to actively contribute to the project.

Thanks,
Keyur