RE: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread ashish singhi
Usually I pass -Dtest.build.data.basedirectory=D:/testDir as VM argument to run the test in Windows to avoid these problem. Regards, Ashish -Original Message- From: Nkechi Achara [mailto:nkach...@googlemail.com] Sent: 15 March 2016 03:52 To: Ted Yu Cc: user@hbase.apache.org Subject:

Re: [Query:]Table creation with column family in Phoenix

2016-03-14 Thread Divya Gehlot
Thanks Harish for the responding to my query and explanation. On 12 March 2016 at 06:53, Harish Krishnan wrote: > Your scan query is returning all states/versions of your columns and column > families > > Thanks & Regards, > Harish.T.K > > On Thu, Mar 10, 2016 at

Re: [Query:]Table creation with column family in Phoenix

2016-03-14 Thread Divya Gehlot
Thanks Enis for such a good explanation . On 15 March 2016 at 08:13, Enis Söztutar wrote: > Phoenix maintains a column with empty value, because unlike a row-oriented > RDBMS, a NULL column is not represented explicitly in HBase, but implicitly > where the cell is not in

Re: [Query:]Table creation with column family in Phoenix

2016-03-14 Thread Enis Söztutar
Phoenix maintains a column with empty value, because unlike a row-oriented RDBMS, a NULL column is not represented explicitly in HBase, but implicitly where the cell is not in HBase at all. Here is the explanation from phoenix.apache.org: For CREATE TABLE, an empty key value will also be added

Re: How to change the base data directory with HBaseTestingUtility

2016-03-14 Thread Ted Yu
Please take a look at: private Path getBaseTestDir() { String PathName = System.getProperty( BASE_TEST_DIRECTORY_KEY, DEFAULT_BASE_TEST_DIRECTORY); where: public static final String BASE_TEST_DIRECTORY_KEY = "test.build.data.basedirectory"; FYI On Mon, Mar 14, 2016 at

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Nkechi Achara
Hi Ted, I believe it is an issue with long file name lengths in windows as when i attempt to get to the directory it is trying to replicate the block to, I recieve the ever annoying error of: The filename or extension is too long. Does anyone know how to fix this? On 14 March 2016 at 18:42,

How to change the base data directory with HBaseTestingUtility

2016-03-14 Thread Nkechi Achara
Hi, I am having issues running the HbaseTestingUtility within IntelliJ IDE, and I can see the following error is probably a result of the file name being too long: 16/03/14 22:45:13 WARN datanode.DataNode: IOException in BlockReceiver.run(): java.io.IOException: Failed to move meta file for

Re: Testing HBase packaging changes

2016-03-14 Thread Ted Yu
On top of letting unit test suite pass, running IntegrationTestBigLinkedList (and integration test related to the feature you modify) regularly is a good practice such that the changes do not introduce regression. FYI On Mon, Mar 14, 2016 at 2:15 PM, Bryan Beaudreault

Testing HBase packaging changes

2016-03-14 Thread Bryan Beaudreault
Hello, We've been using CDH community for a few years now, but have reached the point where we want to be able to do some development and backporting upstream. We'd like to keep the base CDH packaging for consistency, but have come up with some automation around building CDH from source RPM, with

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Ted Yu
You can inspect the output from 'mvn dependency:tree' to see if any incompatible hadoop dependency exists. FYI On Mon, Mar 14, 2016 at 10:26 AM, Parsian, Mahmoud wrote: > Hi Keech, > > Please post your sample test, its run log, version of Hbase , hadoop, … > And make

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Parsian, Mahmoud
Hi Keech, Please post your sample test, its run log, version of Hbase , hadoop, … And make sure that hadoop-core-1.2.1.jar is not your classpath (causes many errors!). Best, Mahmoud From: Nkechi Achara > Date: Monday, March 14, 2016 at

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Nkechi Achara
Thanks Mahmoud, This is what I am using, but as the previous reply stated, I receiving an exception when starting the cluster. Thinking about it, it looks to be more of a build problem of my hbase mini cluster, as I am receiving the following error: 16/03/14 12:29:00 WARN datanode.DataNode:

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Parsian, Mahmoud
Hi Keech, You may use the org.apache.hadoop.hbase.HBaseCommonTestingUtility class to start a ZK, and an HBase cluster and then do your unit tests and integration. I am using this with junit and it works very well. But I am using Java only. Best regards, Mahmoud Parsian On 3/13/16, 11:52 PM,

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Nkechi Achara
Hi Gaurav / All, I am using the java version, as scala does use the JVM and provides interoperability of Java classes, but with the HbaseTestingUtility I am receiving the following error when I call the below: hbaseTestUtil = new HBaseTestingUtility(conf) hbase below: 16/03/14 12:29:00 WARN

Re: Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Gaurav Agarwal
I am not aware of a scala heating am only aware of java testing with hbase. You can hbasetestingutility.java that is present in hbase testing java. Call there startminicluster or dfs cluster. Thanks On Mar 14, 2016 12:22 PM, "Nkechi Achara" wrote: > Hi, > > I am trying

Example of spinning up a Hbase mock style test for integration testing in scala

2016-03-14 Thread Nkechi Achara
Hi, I am trying to find an example of how to spin up a Hbase server in a mock or integration style, so I can test my code locally in my IDE. I have tried fake-hbase and hbase testing utility and receive errors especially when trying to start the cluster. Has anyone got any examples in scala to do