Re: tar ball not getting created from the latest trunk code

On Mon, Apr 1, 2013 at 10:38 PM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Hi > > I checked out a new trunk code base today. I tried the following commands > to create a tar ball. > mvn -X -DskipTests help:active-profiles package assembly:assembly -Prelease > -Dhadoop.prof

Re: HBase Types: Explicit Null Support

Maybe if we can keep nullability separate from the serialization/deserialization, we can come up with a solution that works? We're able to essentially infer that a column is null based on its value being missing or empty. So if an iterator through the row key bytes could detect/indicate that, t

Re: HBase Types: Explicit Null Support

Actually, that isn't all that far-fetched of a format Matt - pretty common anytime anyone wants to do sortable lat/long (*cough* three letter agencies cough*). Wouldn't we get the same by providing a simple set of libraries (ala orderly + other HBase useful things) and then still give access to th

Re: HBase Types: Explicit Null Support

Ah, I didn't even realize sql allowed null key parts. Maybe a goal of the interfaces should be to provide first-class support for custom user types in addition to the standard ones included. Part of the power of hbase's plain byte[] keys is that users can concoct the perfect key for their data ty

tar ball not getting created from the latest trunk code

Hi I checked out a new trunk code base today. I tried the following commands to create a tar ball. mvn -X -DskipTests help:active-profiles package assembly:assembly -Prelease -Dhadoop.profile=2.0 mvn clean install -Dhadoop.profile=2.0 -DskipTests assembly:assembly mvn clean install javadoc:aggre

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

On Mon, Apr 1, 2013 at 6:05 PM, Jean-Marc Spaggiari wrote: > Hi Stack, > > What are the expectations regarding 0.95? Should we open JIRAs for the > issues we found like for the other releases? > > That'd be great JM. > I just tried to start it out of the box and it's failing. It tries to > wri

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

On Mon, Apr 1, 2013 at 6:01 PM, Enis Söztutar wrote: > Great work. > > How will we effectively communicate that this release can eat your computer > (developer release)? Any pointers from the last 0.89 attempt? > > I can add to the head of this document, http://wiki.apache.org/hadoop/Hbase/HBaseV

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

On Mon, Apr 1, 2013 at 4:59 PM, Jean-Marc Spaggiari wrote: > This is huge! > > Just looking at the JIRAs is staggering. There is many things I'm > eager to see on a production release. > I think my list included issues as yet not resolved... let me fix. Good on you JM, St.Ack

[jira] [Resolved] (HBASE-7925) Back port HBASE-6881 into 0.94

[ https://issues.apache.org/jira/browse/HBASE-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu resolved HBASE-7925. --- Resolution: Fixed > Back port HBASE-6881 into 0.94 > -- > >

Re: HBase Types: Explicit Null Support

I think having Int32, and NullableInt32 would support minimum overhead, as well as allowing SQL semantics. On Mon, Apr 1, 2013 at 7:26 PM, Nick Dimiduk wrote: > Furthermore, is is more important to support null values than squeeze all > representations into minimum size (4-bytes for int32, &c.)

[jira] [Created] (HBASE-8240) CompoundConfiguration should implement Iterable

Ted Yu created HBASE-8240: - Summary: CompoundConfiguration should implement Iterable Key: HBASE-8240 URL: https://issues.apache.org/jira/browse/HBASE-8240 Project: HBase Issue Type: Bug R

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

> I just tried to start it out of the box and it's failing. It tries to write on the /var/folders/ directory, which doesn't exist. I think a failure to launch should sink the RC. :-) Beyond that I'd suggest crash bugs or recurring ERRORS or data corruption / loss. On Monday, April 1, 2013, Jean-M

Re: HBase Types: Explicit Null Support

Furthermore, is is more important to support null values than squeeze all representations into minimum size (4-bytes for int32, &c.)? On Apr 1, 2013 4:41 PM, "Nick Dimiduk" wrote: > On Mon, Apr 1, 2013 at 4:31 PM, James Taylor wrote: > >> From the SQL perspective, handling null is important. > >

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

On Mon, Apr 1, 2013 at 6:01 PM, Enis Söztutar wrote: > How will we effectively communicate that this release can eat your computer > (developer release)? Any pointers from the last 0.89 attempt? > Since Stack figured out the hadoop1, hadoop2 suffix business, how about adding "-eats-your-data" to

[jira] [Created] (HBASE-8239) ChaosMonkey actions for root and meta don't work

Sergey Shelukhin created HBASE-8239: --- Summary: ChaosMonkey actions for root and meta don't work Key: HBASE-8239 URL: https://issues.apache.org/jira/browse/HBASE-8239 Project: HBase Issue Ty

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

Hi Stack, What are the expectations regarding 0.95? Should we open JIRAs for the issues we found like for the other releases? I just tried to start it out of the box and it's failing. It tries to write on the /var/folders/ directory, which doesn't exist. Since it's a dev release, I can configure

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

Great work. How will we effectively communicate that this release can eat your computer (developer release)? Any pointers from the last 0.89 attempt? Going to hbase.apache.org -> Downloads -> might directly lead users to download 0.95, and play with it. Should we add something to the home page?

Re: HBase Types: Explicit Null Support

Since SQL allows null valued composite key parts, we needed to support it. On 04/01/2013 05:10 PM, Ted Yu wrote: bq. I create a dummy qualifier with a dummy value For any single application, the above can be done. For generic applications, how would we do this ? Thanks On Mon, Apr 1, 2013 at

Re: HBase Types: Explicit Null Support

bq. I create a dummy qualifier with a dummy value For any single application, the above can be done. For generic applications, how would we do this ? Thanks On Mon, Apr 1, 2013 at 5:07 PM, Matt Corgan wrote: > I generally don't allow nulls in my composite row keys. Does SQL allow > nulls in

Re: HBase Types: Explicit Null Support

I generally don't allow nulls in my composite row keys. Does SQL allow nulls in the PK? In the rare case I wanted to do that I might create a separate format called NullableCInt32 with 5 bytes where the first one determined null. It's important to keep the pure types pure. I have lots of null *

Re: VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

This is huge! Just looking at the JIRAs is staggering. There is many things I'm eager to see on a production release. Thanks for this develper release! JM 2013/4/1 Stack : > Here is our first 0.95.0 release candidate. Should we put this out as > 0.95.0? > > The 0.95.x series of releases are de

Re: Please hold off on 0.95 branch commits. Thanks.

All clear again. Thanks, St.Ack On Mon, Apr 1, 2013 at 12:56 PM, Stack wrote: > St.Ack >

VOTE: hbase-0.95.0RC0, the first "Developer Release" release candidate is available for download and vote

Here is our first 0.95.0 release candidate. Should we put this out as 0.95.0? The 0.95.x series of releases are designated "developer releases", a type of release we have done in the past -- see the 0.89.x series -- where we let out 'raw', barely-tested product so developers and those generally i

Re: HBase Types: Explicit Null Support

On 04/01/2013 04:41 PM, Nick Dimiduk wrote: On Mon, Apr 1, 2013 at 4:31 PM, James Taylor wrote: From the SQL perspective, handling null is important. From your perspective, it is critical to support NULLs, even at the expense of fixed-width encodings at all or supporting representation of

Re: HBase Types: Explicit Null Support

On Mon, Apr 1, 2013 at 4:31 PM, James Taylor wrote: > From the SQL perspective, handling null is important. >From your perspective, it is critical to support NULLs, even at the expense of fixed-width encodings at all or supporting representation of a full range of values. That is, you'd rather

Re: HBase Types: Explicit Null Support

From the SQL perspective, handling null is important. Phoenix supports null in the following way: - the absence of a key value - an empty value in a key value - an empty value in a multi part row key - for variable length types (VARCHAR and DECIMAL) a null byte separator would be used if not t

Build failed in Jenkins: hbase-0.95-on-hadoop2 #51

See -- [...truncated 24186 lines...] Running org.apache.hadoop.hbase.rest.TestGzipFilter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.081 sec Forking command line: /bin/sh -c cd

[jira] [Resolved] (HBASE-7904) Make mapreduce jobs pass based on 2.0.4-alpha

[ https://issues.apache.org/jira/browse/HBASE-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-7904. --- Resolution: Invalid Fix Version/s: (was: 0.95.0) (was: 0.98.

[jira] [Resolved] (HBASE-8238) xref docs missing from site gen

[ https://issues.apache.org/jira/browse/HBASE-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8238. -- Resolution: Fixed Fix Version/s: 0.95.0 Assignee: stack Committed to 0.95 and trunk.

[jira] [Created] (HBASE-8238) xref docs missing from site gen

stack created HBASE-8238: Summary: xref docs missing from site gen Key: HBASE-8238 URL: https://issues.apache.org/jira/browse/HBASE-8238 Project: HBase Issue Type: Bug Reporter: stack

Re: alternative to HTablePool

That was the idea. See https://issues.apache.org/jira/browse/HBASE-4805. From: Elliott Clark To: "dev@hbase.apache.org" Sent: Monday, April 1, 2013 2:48 PM Subject: Re: alternative to HTablePool Creating the HTable with a supplied executor and keeping the c

Build failed in Jenkins: HBase-TRUNK #4004

See Changes: [stack] HBASE-8236 Set finalName property in hbase-assembly else basename is hbase-assembly rather than hbase [stack] HBASE-8164 TestTableLockManager fails intermittently in trunk builds [apurtell] HBASE-8213. Global authori

Re: alternative to HTablePool

Creating the HTable with a supplied executor and keeping the conf the same should give you most of what an HTablePool gives you. On Sun, Mar 31, 2013 at 8:42 AM, Ted Yu wrote: > Hi, > In HBASE-8218 pass HTable as a parameter to method of AggregationClient, > there is this question: > As HTableP

Re: HBase Types: Explicit Null Support

bq. with a base implementation that does not support nulls +1 On Mon, Apr 1, 2013 at 1:32 PM, Nick Dimiduk wrote: > Thanks for the thoughtful response (and code!). > > I'm thinking I will press forward with a base implementation that does not > support nulls. The idea is to provide an extensib

Jenkins build is back to normal : HBase-0.94 #934

See

Re: HBase Types: Explicit Null Support

Thanks for the thoughtful response (and code!). I'm thinking I will press forward with a base implementation that does not support nulls. The idea is to provide an extensible set of interfaces, so I think this will not box us into a corner later. That is, a mirroring package could be implemented t

Jenkins build is back to normal : hbase-0.95 #118

See

Please hold off on 0.95 branch commits. Thanks.

St.Ack

[jira] [Created] (HBASE-8237) Integrate HDFS request profiling with HBase request profiling

Alex Feinberg created HBASE-8237: Summary: Integrate HDFS request profiling with HBase request profiling Key: HBASE-8237 URL: https://issues.apache.org/jira/browse/HBASE-8237 Project: HBase

Re: HBase Types: Explicit Null Support

I spent some time this weekend extracting bits of our serialization code to a public github repo at http://github.com/hotpads/data-tools. Contributions are welcome - i'm sure we all have this stuff laying around. You can see I've bumped into the NULL problem in a few places: * https://github.com/

[jira] [Resolved] (HBASE-8236) Set finalName property in hbase-assembly else basename is hbase-assembly rather than hbase.

[ https://issues.apache.org/jira/browse/HBASE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8236. -- Resolution: Fixed Fix Version/s: 0.95.0 Assignee: stack Committed to 0.95 and trunk.

[jira] [Created] (HBASE-8236) Set finalName property in hbase-assembly else basename is hbase-assembly rather than hbase.

stack created HBASE-8236: Summary: Set finalName property in hbase-assembly else basename is hbase-assembly rather than hbase. Key: HBASE-8236 URL: https://issues.apache.org/jira/browse/HBASE-8236 Project: HB

Re: Wanted your thoughts on Rolling Upgrade Testing in HBase

On Fri, Mar 29, 2013 at 3:49 PM, Aleksandr Shulman wrote: > > *Potential Solution:* > I propose using IntegrationTest to bind to an existing remote cluster. > Better support for external clusters in IntegrationTest land will make a big difference for us. I believe nkeywal started progress on this

Re: HBase Types: Explicit Null Support

HmmmŠ good question. I think that fixed width support is important for a great many rowkey constructs cases, so I'd rather see something like losing MIN_VALUE and keeping fixed width. On 4/1/13 2:00 PM, "Nick Dimiduk" wrote: >Heya, > >Thinking about data types and serialization. I think nul

HBase Types: Explicit Null Support

Heya, Thinking about data types and serialization. I think null support is an important characteristic for the serialized representations, especially when considering the compound type. However, doing so in directly incompatible with fixed-width representations for numerics. For instance, if we wa

[jira] [Created] (HBASE-8235) Adding inmemory CF attribute to LoadTest and PerformanceEvaluation tool

ramkrishna.s.vasudevan created HBASE-8235: - Summary: Adding inmemory CF attribute to LoadTest and PerformanceEvaluation tool Key: HBASE-8235 URL: https://issues.apache.org/jira/browse/HBASE-8235

Build failed in Jenkins: HBase-0.94 #933

See -- [...truncated 5939 lines...] Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.479 sec Running org.apache.hado