RE: [VOTE] Release of Apache Mnemonic-0.8.0-incubating [rc1]

[Wang, Gang1]

Hi Josh,

Thank you for the review and suggestion, Yes it makes sense to construct a set 
of pure Java memory services as fallback for the experience of first users. we 
would add this feature to Mnemonic later, Thanks!

Best Regards
Gary
  (323)801-6286 (WhatsApp)

-Original Message-
From: Josh Elser [mailto:els...@apache.org] 
Sent: Tuesday, June 20, 2017 2:37 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release of Apache Mnemonic-0.8.0-incubating [rc1]

+1 (binding)

- xsums/sigs OK
- L look ok
- KEYS is good
- Could sort of build from source. On OSX, I can only get so far into the build 
until I start running into native compilation failures. The docs are a little 
sparse on this -- it would be awesome if there was some non-native fallback 
mechanism to improve the first-time user experience.
- apache-rat:check looks good
- Scoped out the rest of the files included

On 6/16/17 2:26 AM, Debojyoti Dutta wrote:
> Hello incubator PMCs,
> 
> The Apache Mnemonic community PPMCs and developers have voted and 
> approved the proposal to release Apache Mnemonic 0.8.0 (incubating).
> 
> Apache Mnemonic is an advanced hybrid memory storage oriented library.
> It consists of a non-volatile/durable Java object model and a durable 
> computing model that significantly improves the performance of massive 
> real-time data processing and analytics pipelines, built on top of 
> JVMs. Developers can also use this library to design cache-less and 
> SerDe-less high performance applications, thus leveraging the core 
> benefits of non-volatile memory technologies.
> 
> [VOTE] thread:
> https://lists.apache.org/thread.html/1a04f89e9bc8f4bd588a017184c1bd2f9
> 9922506215a66ed37881fd7@%3Cdev.mnemonic.apache.org%3E
> 
> [VOTE RESULT] thread:
> https://lists.apache.org/thread.html/aaa59cc08283f085608e37f07c3f2178b
> 19b08d260436c370428e3d3@%3Cdev.mnemonic.apache.org%3E
> and an update (Patrick Hunt's vote was binding but was included as non 
> binding):
> https://lists.apache.org/thread.html/a11aa5fe89e4784e610873548c26c7a08
> 57b2216a3ac1400f45d5b27@%3Cdev.mnemonic.apache.org%3E
> 
> We now kindly request the Incubator PMC members review and vote on 
> this incubator release. The Apache Mnemonic-0.8.0-incubating release 
> candidate is now available with the following artifacts for a project
> vote:
> 
> The source tarball, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/incubator/mnemonic/0.8.0-incuba
> ting-rc1/src/
> 
> The tag to be voted upon is v0.8.0-incubating:
> https://git-wip-us.apache.org/repos/asf?p=incubator-mnemonic.git;a=tag
> ;h=refs/tags/v0.8.0-incubating
> 
> The release hash is 2941b87:
> https://git-wip-us.apache.org/repos/asf?p=incubator-mnemonic.git;a=com
> mit;h=2941b87f7e28c898cbecb35c845e5b4cd90bc197
> 
> Release artifacts are signed with the following key:
> https://dist.apache.org/repos/dist/dev/incubator/mnemonic/KEYS
> 
> KEYS file available:
> https://dist.apache.org/repos/dist/dev/incubator/mnemonic/KEYS
> 
> For information about the contents of this release, see:
> https://dist.apache.org/repos/dist/dev/incubator/mnemonic/0.8.0-incuba
> ting-rc1/CHANGES.txt
> 
> The vote will be open for ~72 hours. Please download the release 
> candidate and evaluate the necessary items including checking hashes, 
> signatures, build from source, and test.
> 
> please vote:
> [ ] +1 Release this package as apache-mnemonic--incubating
> [ ] +0 no opinion
> [ ] -1 Do not release this package because...
> 
> Thanks,
> Debo Dutta, on behalf of the Apache Mnemonic (incubating) team
> 
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
> 

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Apache Gearpump (incubating) 0.8.3-RC1

[Wang, Gang1]

+1, Thanks.

Best Regards
Gary (Wang, Gang)

External Contact:
  (323)801-6286 (WhatsApp)

-Original Message-
From: Karol Brejna [mailto:karolbre...@apache.org] 
Sent: Tuesday, April 11, 2017 2:34 AM
To: general@incubator.apache.org
Cc: d...@gearpump.incubator.apache.org
Subject: [VOTE] Apache Gearpump (incubating) 0.8.3-RC1

Hi IPMC Community,

The PPMC vote to release Apache Gearpump (incubating) 0.8.3-RC1 has passed.
We would like to now submit this release candidate to the IPMC.

The PPMC vote thread is here:
https://lists.apache.org/thread.html/0e1022d2f3b5b2a2b879e4c278d7fc44d094058550d47ae7e07702ec@%3Cdev.gearpump.apache.org%3E

The source and binary tarballs, including signatures, digests, etc.
can be found at:
https://dist.apache.org/repos/dist/dev/incubator/gearpump/0.8.3-incubating/RC1/

Release artifacts are signed with the key with fingerprint:
3F12 81A2 DB58 0842 5ABA  6962 D8A8 4FBC 0A83 B291

The KEYS file is available here:
https://dist.apache.org/repos/dist/dev/incubator/gearpump/KEYS

The tag to be voted upon is:
https://git-wip-us.apache.org/repos/asf?p=incubator-gearpump.git;a=shortlog;h=refs/tags/0.8.3-RC1

The release hash is:
https://git-wip-us.apache.org/repos/asf?p=incubator-gearpump.git;a=commit;h=80f49154428cd18b5a27d946b8c9536124849cc9

For information about the contents of this release see:
https://issues.apache.org/jira/browse/GEARPUMP-294?jql=project%20%3D%20GEARPUMP%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.8.3

This vote will be open for 72 hours (Thursday, April 13, 2017 at 3:00AM PST).

Please download the release candidate and evaluate the necessary items 
including checking hashes, signatures, build from source, run the binary 
artifacts in the binary release and test.
Please vote:

[ ] +1 Release this package as gearpump-0.8.3 [ ] +0 no opinion [ ] -1 Do not 
release this package because because...

Thanks,
Karol

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Release of Apache Mnemonic-0.4.0-incubating [rc1]

[Wang, Gang1]

Hi Justin,

The year of NOTICE file has been updated on branch 0.5.0-dev not yet merged 
into master branch, Thanks for your reminding.

Sincerely.
Gary
-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Tuesday, January 24, 2017 4:32 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release of Apache Mnemonic-0.4.0-incubating [rc1]

Hi,

Vote results been called, but I did check. All good but don’t forget to update 
the year in your NOTICE file.

Thanks,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Release of Apache Mnemonic-0.3.0-incubating [rc4]

[Wang, Gang1]

Hi Justin,

Thank you very much for your review and voting.

Sure, I will indicate the binding IPMC votes from next release voting. Thanks 
for your advice and It is my honor to have your 250th votes. :-)

Best Regards
Gary


-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Friday, October 21, 2016 3:09 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release of Apache Mnemonic-0.3.0-incubating [rc4]

Hi,

A bit late as the result has been called but as I was 1/2 way through the 
review I thought I’d finish it. Everything looks good.

In future it would be nice to indicate how many binding IPMC votes you had in 
the vote email.

I checked
- name contains incubating
- signatures and hashes good
- DISCLAIMER exists
- LICENSE and NOTICE correct
- All source files have ASF headers
- No binary files in release
- Can compile from source

Thanks,
Justin

PS Give or take a couple of votes this is the 250th time I’ve voted on an 
incubating release :-)


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Release Apache Beam, version 0.2.0-incubating

[Wang, Gang1]

Hi Justin and Apache Beam team,

  I'm so Sorry, It is my bad, please ignore my previous mail, Thanks.

Best Regards
+Gary 


-Original Message-
From: Wang, Gang1 [mailto:gang1.w...@intel.com] 
Sent: Tuesday, August 2, 2016 10:42 AM
To: general@incubator.apache.org
Subject: RE: [VOTE] Release Apache Beam, version 0.2.0-incubating

Hi Justin,

   Thank you for catching that, We would fix those issues you mentioned, Thanks.

Best Regards
+Gary 


-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Monday, August 1, 2016 5:17 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release Apache Beam, version 0.2.0-incubating

Hi,

+1 (binding)

I checked:
- file name contains incubating
- signature and hash good
- LICENSE and NOTICE good. (Although not 100% sure why the NOTICE mentions 
google twice)
- No binary files in release
- All source code has ASF headers
- Can compile from source

Just a few minor things I noticed while looking at your web site. You have a 
direct link to your last release here [1] rather than a link going via the 
Apache mirrors script [5] and this link [2] in Learn menu goes nowhere. 
Branding wise I think you are missing a few of the required links [3] including 
a link back to the Apache homepage. A feather ASF logo would be a nice addition 
as well. [4]

Thanks,
Justin

1 . http://beam.incubator.apache.org/releases/
2. http://beam.incubator.apache.org/docs/learn/programming-guide/
3. http://www.apache.org/foundation/marks/pmcs.html#navigation 
4. http://www.apache.org/foundation/press/kit/#links
5. http://www.apache.org/dev/release-download-pages.html#closer
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Release Apache Beam, version 0.2.0-incubating

[Wang, Gang1]

Hi Justin,

   Thank you for catching that, We would fix those issues you mentioned, Thanks.

Best Regards
+Gary 


-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Monday, August 1, 2016 5:17 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release Apache Beam, version 0.2.0-incubating

Hi,

+1 (binding)

I checked:
- file name contains incubating
- signature and hash good
- LICENSE and NOTICE good. (Although not 100% sure why the NOTICE mentions 
google twice)
- No binary files in release
- All source code has ASF headers
- Can compile from source

Just a few minor things I noticed while looking at your web site. You have a 
direct link to your last release here [1] rather than a link going via the 
Apache mirrors script [5] and this link [2] in Learn menu goes nowhere. 
Branding wise I think you are missing a few of the required links [3] including 
a link back to the Apache homepage. A feather ASF logo would be a nice addition 
as well. [4]

Thanks,
Justin

1 . http://beam.incubator.apache.org/releases/
2. http://beam.incubator.apache.org/docs/learn/programming-guide/
3. http://www.apache.org/foundation/marks/pmcs.html#navigation 
4. http://www.apache.org/foundation/press/kit/#links
5. http://www.apache.org/dev/release-download-pages.html#closer
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [VOTE] Release of Apache Mnemonic-0.2.0-incubating [rc3]

[Wang, Gang1]

Hi Justin,

Thank your for voting and advices, We will try to improve the README.md about 
compiling on MacOSX and Yes it is not optional by default, I guess the reason 
why cannot include module mnemonic-pmalloc-service that probably stems from 
compiling or installation of pmalloc project, Thanks.

As you mentioned, the artifact "org.beanshell:bsh" is licensed in LGPL that 
should be introduced by testng and only be used by test process. The mnemonic 
does not depend on "bsh" elsewhere, I appreciate your reminding and letting me 
beware of that. 

Best Regards
+Gary

-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Friday, July 29, 2016 6:48 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release of Apache Mnemonic-0.2.0-incubating [rc3]

Hi,

+1 (binding)

I checked:
- release contains incubating
- signature and hash good
- LICENSE and NOTICE good
- No binaries in source
- All files have ASF headers
- Could compile from source but some minor issues (on OSX)

I think the README could do with some clearer information on how to compile on 
OSX. It seem the optional parts are not optional by default?

I manage to get it to compile by skipping the optional bits:
mvn -pl '!mnemonic-memory-services/mnemonic-nvml-vmem-service' -pl 
'!mnemonic-memory-services/mnemonic-pmalloc-service' clean package install

You may want to double check your dependancies as I’m seeing a LGPL dependancy 
but it seems to be for testing?

[INFO] org.apache.mnemonic:mnemonic-utilities-service:jar:0.2.0-incubating
[INFO] +- org.testng:testng:jar:6.8.17:test [INFO] |  +- 
org.beanshell:bsh:jar:2.0b4:test [INFO] |  \- com.beust:jcommander:jar:1.27:test
[INFO] +- org.apache.mnemonic:mnemonic-core:jar:0.2.0-incubating:compile
[INFO] |  +- org.flowcomputing.commons:commons-resgc:jar:0.8.9:compile
[INFO] |  \- com.squareup:javapoet:jar:1.6.1:compile
[INFO] +- org.apache.mnemonic:mnemonic-collections:jar:0.2.0-incubating:compile
[INFO] \- org.flowcomputing.commons:commons-primitives:jar:0.6.0:compile


Thanks,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [RESULT][VOTE][Revised] Release of Apache Mnemonic-0.1.2-incubating [rc2] (Revised)

[Wang, Gang1]

Hi Patrick,

   My apologies that I have missed your email in the general@incubator list, 
I'm really sorry.

As your advised, the completed vote result is

Hi all,

After being open for over 72 hours, the combined vote for releasing Apache 
Mnemonic 0.1.2-incubating passed with 4 binding +1s and no +0 and no -1.

Binding +1s:
Patrick Hunt
Henry Saputra
Justin Mclean
Gangumalla, Uma

Other votes +1s:
Yanping Wang
Gary

A issue we need to work on -
1. Justin had issues building from source on OSX . We will look into the issue.

Thanks to everyone who voted!
Gary on behalf of the Apache Mnemonic (incubating) team

Best Regards
+Gary

-Original Message-
From: Patrick Hunt [mailto:ph...@apache.org] 
Sent: Tuesday, May 24, 2016 9:07 AM
To: general@incubator.apache.org
Subject: Re: [RESULT][VOTE] Release of Apache Mnemonic-0.1.2-incubating [rc2] 
(Revised)

Hi Gary. You want to summarize all the votes, including the ones on the 
project's dev list, here - I (and others) had voted on the dev list thread 
already.

Patrick

On Tue, May 24, 2016 at 8:55 AM, Gary  wrote:

> Hi all,
>
>
> After being open for over 72 hours, the vote for releasing Apache 
> Mnemonic 0.1.2-incubating passed with 3 binding +1s and no +0 and no -1.
>
>
>
> Binding +1s:
>
> Henry Saputra
>
> Justin Mclean
> Gangumalla, Uma
>
>
> A issue we need to work on -
>
> 1. Justin had issues building from source on OSX . We will look into 
> the issue.
>
>
> Thanks to everyone who voted!
>
>
> Thanks,
>
> Gary on behalf of the Apache Mnemonic (incubating) team
>
>
>

RE: [VOTE] Accept CarbonData into the Apache Incubator

[Wang, Gang1]

+1 (no-binding)

Best Regards
+Gary.

-Original Message-
From: Cheng, Hao [mailto:hao.ch...@intel.com] 
Sent: Wednesday, May 25, 2016 7:09 PM
To: general@incubator.apache.org
Subject: RE: [VOTE] Accept CarbonData into the Apache Incubator

+1

-Original Message-
From: Jacques Nadeau [mailto:jacq...@apache.org]
Sent: Thursday, May 26, 2016 8:26 AM
To: general@incubator.apache.org
Subject: Re: [VOTE] Accept CarbonData into the Apache Incubator

+1 (binding)

On Wed, May 25, 2016 at 4:04 PM, John D. Ament 
wrote:

> +1
>
> On Wed, May 25, 2016 at 4:41 PM Jean-Baptiste Onofré 
> wrote:
>
> > Hi all,
> >
> > following the discussion thread, I'm now calling a vote to accept 
> > CarbonData into the Incubator.
> >
> > ​[ ] +1 Accept CarbonData into the Apache Incubator [ ] +0 Abstain [ 
> > ] -1 Do not accept CarbonData into the Apache Incubator, because ...
> >
> > This vote is open for 72 hours.
> >
> > The proposal follows, you can also access the wiki page:
> > https://wiki.apache.org/incubator/CarbonDataProposal
> >
> > Thanks !
> > Regards
> > JB
> >
> > = Apache CarbonData =
> >
> > == Abstract ==
> >
> > Apache CarbonData is a new Apache Hadoop native file format for 
> > faster interactive query using advanced columnar storage, index, 
> > compression and encoding techniques to improve computing efficiency, 
> > in turn it will help speedup queries an order of magnitude faster 
> > over PetaBytes of data.
> >
> > CarbonData github address: 
> > https://github.com/HuaweiBigData/carbondata
> >
> > == Background ==
> >
> > Huawei is an ICT solution provider, we are committed to enhancing 
> > customer experiences for telecom carriers, enterprises, and 
> > consumers on big data, In order to satisfy the following customer 
> > requirements, we created a new Hadoop native file format:
> >
> >   * Support interactive OLAP-style query over big data in seconds.
> >   * Support fast query on individual record which require touching 
> > all fields.
> >   * Fast data loading speed and support incremental load in period 
> > of minutes.
> >   * Support HDFS so that customer can leverage existing Hadoop cluster.
> >   * Support time based data retention.
> >
> > Based on these requirements, we investigated existing file formats 
> > in the Hadoop eco-system, but we could not find a suitable solution 
> > that satisfying requirements all at the same time, so we start 
> > designing CarbonData.
> >
> > == Rationale ==
> >
> > CarbonData contains multiple modules, which are classified into two
> > categories:
> >
> >   1. CarbonData File Format: which contains core implementation for 
> > file format such as 
> > columnar,index,dictionary,encoding+compression,API for reading/writing etc.
> >   2. CarbonData integration with big data processing framework such 
> > as Apache Spark, Apache Hive etc. Apache Beam is also planned to 
> > abstract the execution runtime.
> >
> > === CarbonData File Format ===
> >
> > CarbonData file format is a columnar store in HDFS, it has many 
> > features that a modern columnar format has, such as splittable, 
> > compression schema ,complex data type etc. And CarbonData has 
> > following unique
> > features:
> >
> >  Indexing 
> >
> > In order to support fast interactive query, CarbonData leverage 
> > indexing technology to reduce I/O scans. CarbonData files stores 
> > data along with index, the index is not stored separately but the 
> > CarbonData file itself contains the index. In current 
> > implementation, CarbonData supports 3 types of indexing:
> >
> > 1. Multi-dimensional Key (B+ Tree index)
> >   The Data block are written in sequence to the disk and within each 
> > data blocks each column block is written in sequence. Finally, the 
> > metadata block for the file is written with information about byte 
> > positions of each block in the file, Min-Max statistics index and 
> > the start and end MDK of each data block. Since, the entire data in 
> > the file is in sorted order, the start and end MDK of each data 
> > block can be used to construct a B+Tree and the file can be 
> > logically  represented as a
> > B+Tree with the data blocks as leaf nodes (on disk) and the 
> > B+remaining
> > non-leaf nodes in memory.
> > 2. Inverted index
> >   Inverted index is widely used in search engine. By using this 
> > index, it helps processing/query engine to do filtering inside one HDFS 
> > block.
> > Furthermore, query acceleration for count distinct like operation is 
> > made possible when combining bitmap and inverted index in query time.
> > 3. MinMax index
> >   For all columns, minmax index is created so that processing/query 
> > engine can skip scan that is not required.
> >
> >  Global Dictionary 
> >
> > Besides I/O reduction, CarbonData accelerates computation by using 
> > global dictionary, which enables processing/query engines to perform 
> > all processing on encoded data without having to 

RE: [VOTE] Release of Apache Mnemonic-0.1.2-incubating [rc2] (Revised)

[Wang, Gang1]

Hi Justin,

   Thanks for your review and advices, we will create a ticket to add that  to 
README for OSX platform, Thanks.

Best Regards
B.R,
+Gary

-Original Message-
From: Justin Mclean [mailto:jus...@classsoftware.com] 
Sent: Thursday, May 19, 2016 7:37 PM
To: general@incubator.apache.org
Subject: Re: [VOTE] Release of Apache Mnemonic-0.1.2-incubating [rc2] (Revised)

Hi,

+1 binding

I checked:
- file name contains incubating
- DISCLAIMER exits
- LICENSE and NOTICE correct
- All source files have headers
- No binary files in release
- Unable to build from source 

Other than the build issue also a very easy release to review.

I was unable to build from source on OSX even with:
 mvn -pl '!mnemonic-memory-services/mnemonic-nvml-vmem-service' clean package

But assuming it’s my setup.

Would be nice for the README could have slightly clearer instructions on how to 
build on different platforms.

Thanks,
Justin
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [DISCUSS] Mnemonic incubator proposal

[Wang, Gang1]

Hi Liang

   please find my response inline below

Best Regards
Gary (Wang, Gang), PMP(r), CMMI(r) Appraiser, ITIL(r) Foundation
NRDC: Donate (Natural Resources Defense Council)


-Original Message-
From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com] 
Sent: Tuesday, February 23, 2016 8:06 PM
To: general@incubator.apache.org
Subject: Re: [DISCUSS] Mnemonic incubator proposal

Hi Liang,

Thank you for your interest. Sure we would consider you adding in interested 
contributors list.
 
>Mnemonic is trying to solve performance issues associated
with serialization/deserialization of java object when dealing with JVM & disk 
directly as well as GC pressure caused by caching ?

Yes.

>whether Mnemonic could solve Hadoop Namenode pressure of large
scale of cluster scenaros, or not?
Yeah, we are thinking on some aspects considering memory and GC overheads in 
Namenode too.
Example couple of JIRAs already there in HDFS to move some of data structure to 
off heap. So, we had plans to get the standard data structures from this 
library and can make use of them push.
Also we could make advantage if persistence here.


@Yanping/Gary, may be you could add more points if you have?

[Gary] Thanks Uma, in addition, you can plug-in your special allocators that 
could be optimized for namenode usage patterns, by this way, the performance 
could be better and more predictable. Thanks.

Regards,
Uma

On 2/23/16, 6:48 PM, "Liang Chen"  wrote:

>Interesting, would love to become the contributor
>
>My understanding: Mnemonic is trying to solve performance issues 
>associated with serialization/deserialization of java object when 
>dealing with JVM & disk directly as well as GC pressure caused by 
>caching ?
>
>one question: whether Mnemonic could solve Hadoop Namenode pressure of 
>large scale of cluster scenaros, or not?
>
>
>
>--
>View this message in context:
>http://apache-incubator-general.996316.n3.nabble.com/DISCUSS-Mnemonic-i
>ncu
>bator-proposal-tp48502p48533.html
>Sent from the Apache Incubator - General mailing list archive at 
>Nabble.com.
>
>-
>To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
>For additional commands, e-mail: general-h...@incubator.apache.org
>


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org

RE: [DISCUSS] Mnemonic incubator proposal

[Wang, Gang1]

sets input
> > d) Non-Volatile RDD operations
> > The best use case for Apache Spark™ computing is that the input data 
> > is stored in form of Mnemonic native storage to avoid caching its 
> > row data
> for
> > iterative processing. Moreover, Spark applications can leverage 
> > Mnemonic
> to
> > perform data transforming in persistent or non-persistent memory 
> > without SerDes.
> >
> > For Apache™ Hadoop®, we are integrating HDFS Caching with Mnemonic
> instead
> > of mmap. This will take advantage of persistent memory related features.
> We
> > also plan to evaluate to integrate in Namenode Editlog, FSImage
> persistent
> > data into Mnemonic persistent memory area.
> >
> > For Apache HBase™, we are using Mnemonic for BucketCache and 
> > evaluating performance improvements.
> >
> > We expect Mnemonic will be further developed and integrated into 
> > many Apache BigData projects and so on, to enhance memory management 
> > solutions for much improved performance and reliability.
> >
> >  An Excessive Fascination with the Apache Brand  While we 
> > expect Apache brand helps to attract more contributors, our 
> > interests in starting this project is based on the factors mentioned 
> > in
> the
> > Rationale section.
> >
> > We would like Mnemonic to become an Apache project to further foster 
> > a healthy community of contributors and consumers in BigData 
> > technology R areas. Since Mnemonic can directly benefit many 
> > Apache projects and
> solves
> > major performance problems, we expect the Apache Software Foundation 
> > to increase interaction with the larger community as well.
> >
> > === Documentation ===
> > The documentation is currently available at Intel and will be posted
> > under: https://mnemonic.incubator.apache.org/docs
> >
> > === Initial Source ===
> > Initial source code is temporary hosted Github for general viewing:
> > https://github.com/NonVolatileComputing/Mnemonic.git
> > It will be moved to Apache http://git.apache.org/ after podling.
> >
> > The initial Source is written in Java code (88%) and mixed with JNI 
> > C
> code
> > (11%) and shell script (1%) for underlying native allocation libraries.
> >
> > === Source and Intellectual Property Submission Plan === As soon as 
> > Mnemonic is approved to join the Incubator, the source code will be 
> > transitioned via the Software Grant Agreement onto ASF 
> > infrastructure and in turn made available under the Apache License,
> version
> > 2.0.
> >
> > === External Dependencies ===
> > The required external dependencies are all Apache licenses or other 
> > compatible Licenses
> > Note: The runtime dependent licenses of Mnemonic are all declared as 
> > Apache 2.0, the GNU licensed components are used for Mnemonic build 
> > and deployment. The Mnemonic JNI libraries are built using the GNU tools.
> >
> > maven and its plugins (http://maven.apache.org/ ) [Apache 2.0]
> > JDK8 or OpenJDK 8 (http://java.com/) [Oracle or Openjdk JDK License] 
> > Nvml (http://pmem.io ) [optional] [Open Source] PMalloc 
> > (https://github.com/bigdata-memory/pmalloc ) [optional] [Apache 2.0]
> >
> > Build and test dependencies:
> > org.testng.testng v6.8.17  (http://testng.org) [Apache 2.0] 
> > org.flowcomputing.commons.commons-resgc v0.8.7 [Apache 2.0] 
> > org.flowcomputing.commons.commons-primitives v.0.6.0 [Apache 2.0] 
> > com.squareup.javapoet v1.3.1-SNAPSHOT [Apache 2.0]
> > JDK8 or OpenJDK 8 (http://java.com/) [Oracle or Openjdk JDK License]
> >
> > === Cryptography ===
> > Project Mnemonic does not use cryptography itself, however, Hadoop 
> > projects use standard APIs and tools for SSH and SSL communication 
> > where necessary.
> >
> > === Required Resources ===
> > We request that following resources be created for the project to 
> > use
> >
> >  Mailing lists 
> > priv...@mnemonic.incubator.apache.org (moderated subscriptions) 
> > comm...@mnemonic.incubator.apache.org
> > d...@mnemonic.incubator.apache.org
> >
> >  Git repository 
> > https://github.com/apache/incubator-mnemonic
> >
> >  Documentation 
> > https://mnemonic.incubator.apache.org/docs/
> >
> >  JIRA instance 
> > https://issues.apache.org/jira/browse/mnemonic
> >
> > === Initial Committers ===
> > * Gang (Gary) Wang (gang1 dot wang at intel dot com)
> > * Yanping Wang (yanping dot wang at intel dot com)
> > * Uma Maheswara Rao G (umamahesh at apache dot org)
> > * Kai Zheng (drankye at apache dot org)
> > * Rakesh Radhakrishnan Potty  (rakeshr at apache dot org)
> > * Sean Zhong  (seanzhong at apache dot org)
> > * Henry Saputra  (hsaputra at apache dot org)
> > * Hao Cheng (hao dot cheng at intel dot com)
> >
> > === Affiliations ===
> > * Gang (Gary) Wang, Intel
> > * Yanping Wang, Intel
> > * Uma Maheswara Rao G, Intel
> > * Kai Zheng, Intel
> > * Rakesh Radhakrishnan Potty, Intel
> > * Sean Zhong, Intel
> > * Henry Saputra, Independent
> > * Hao Cheng, Intel
> >
> > === Sponsors ===
> >  Champion 
> > Patrick Hunt
> >
> >  Nominated Mentors 
> > * Patrick Hunt  - Apache IPMC member
> > * Andrew Purtell  - Apache IPMC member
> > * James Taylor  - Apache IPMC member
> > * Henry Saputra  - Apache IPMC member
> >
> >  Sponsoring Entity 
> > Apache Incubator PMC
> >
>