Re: List of unique qualifiers [SEC=UNOFFICIAL]

2014-01-15 Thread Corey Nolet
Matt, This should help: Collection> cols = Collections.singleton(new Pair(new Text("cityOfBirth"), null)); AccumuloInputFormat.fetchColumns(job, cols); On Wed, Jan 15, 2014 at 7:29 PM, Dickson, Matt MR < matt.dick...@defence.gov.au> wrote: > *UNOFFICIAL* > Thanks Keith. I've run a simple mr

Re: List of unique qualifiers [SEC=UNOFFICIAL]

2014-01-15 Thread Eric Newton
You could create a locality group for your column family. However, you would need to recompact for the benefit. And the benefit might not be there if your column family includes a major portion of the data. But! If you could recompact once, and keeping this data in its own locality group was us

RE: List of unique qualifiers [SEC=UNOFFICIAL]

2014-01-15 Thread Dickson, Matt MR
UNOFFICIAL Thanks Keith. I've run a simple mr job based on the UniqueColumns example, but due to the size of the table this is taking a very long time. Is it possible to pre-filter the data that goes to the MR job based on family, eg only run the MR job on columns with a specific column famil

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Sean Busbey
On Wed, Jan 15, 2014 at 4:09 PM, Kesten Broughton wrote: > > I have seen similar problems caused by only installing the bin rpm. > The docs seem to suggest you can choose one or the other. > > However, I was only able to get it to work by installing both and then > selecting the one i would use in

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Kesten Broughton
Spam Not spam Forget previous vote ____ Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=s> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=n> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Arshak Navruzyan
Steve, try this to get your datanode(s) going hadoop-daemon.sh start datanode I am curious did you install your Hadoop from rpm? Also this Sqrrl writeup might be helpful: http://sqrrl.com/quick-accumulo-install/ Arshak On Wed, Jan 15, 2014 at 1:42 PM, Sean Busbey wrote: > On Wed, Jan 15, 20

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Sean Busbey
On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse wrote: > Sean, > > > > The classpath for HDFS was incorrect and that definitely helped when I > corrected it. Now it seems I’m having a hadoop issue where the datanodes > are not running. I’m going to keep plugging away. > > > > > Glad to hear you mad

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Sean Busbey
e following page and I now >> am running in= to a problem when I try to start accumulo up. The error I >> receive is the f= >> >> ollowing: >> >> >> >> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null >> java.l

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Eric Newton
t; at > org.apache.accumulo.core.client.ZooKeeperInstance.getIns= > > tanceIDFromHdfs(ZooKeeperInstance.java:293) > > at > org.apache.accumulo.server.client.HdfsZooInstance._getIn= > > stanceID(HdfsZooInstance.java:126) > > at > org.apache.accumulo.server.client.HdfsZooInstance.getIns= > > tanceID(HdfsZooInstance.java:119) > > at > org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt= > > il.java:24) > > at > org.apache.accumulo.server.master.state.SetGoalState.mai= > > n(SetGoalState.java:46) > > ... 6 more > > > > I have tried to run accumulo init several times but I still get the same > re= sult every single time. Any help would be much appreciated. > > > > Thanks, > > > > Steve > > > > *H. Stephen Kruse* > > Software Engineer > > Adaptive Methods > > 5860 Trinity Parkway, Suite 200 > > Centreville, VA 20121 > > phone: (703) 968-6132 > > email: skr...@adaptivemethods.com > > > > > > > -- > > > Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=s> > Not > spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=n> > Forget previous > vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=f> >

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Steve Kruse
eve H. Stephen Kruse Software Engineer Adaptive Methods 5860 Trinity Parkway, Suite 200 Centreville, VA 20121 phone: (703) 968-6132 email: skr...@adaptivemethods.com<mailto:skr...@adaptivemethods.com> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLek

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Sean Busbey
Hi Steve! It looks like you don't have any log4j settings, so you may not get some error messages reported. You should copy the log4j.properties and *_logger.xml files from one of hte configuration examples into $ACCUMULO_CONF_DIR before running init. On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Steve Kruse
uite 200 Centreville, VA 20121 phone: (703) 968-6132 email: skr...@adaptivemethods.com<mailto:skr...@adaptivemethods.com> Spam Not spam Forget previous vote ____ Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejV

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread John Vines
> > > I have tried to run accumulo init several times but I still get the > > same re= sult every single time. Any help would be much appreciated. > > > > > > > > Thanks, > > > > > > > > Steve > > > > > > > >

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Arshak Navruzyan
have tried to run accumulo init several times but I still get the same > re= sult every single time. Any help would be much appreciated. > > > > Thanks, > > > > Steve > > > > *H. Stephen Kruse* > > Software Engineer > > Adaptive Methods > > 5860 Trinity Parkway, Suite 200 > > Centreville, VA 20121 > > phone: (703) 968-6132 > > email: skr...@adaptivemethods.com > > > > > -- > > > Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=ec445a2d&t=20140115&c=s> > Not > spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=ec445a2d&t=20140115&c=n> > Forget previous > vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=ec445a2d&t=20140115&c=f> >

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Steve Kruse
be much appreciated. > > > > Thanks, > > > > Steve > > > > H. Stephen Kruse > > Software Engineer > > Adaptive Methods > > 5860 Trinity Parkway, Suite 200 > > Centreville, VA 20121 > > phone: (703) 968-6132 > > email: skr...@adaptivemetho

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Steve Kruse
preciated. Thanks, Steve H. Stephen Kruse Software Engineer Adaptive Methods 5860 Trinity Parkway, Suite 200 Centreville, VA 20121 phone: (703) 968-6132 email: skr...@adaptivemethods.com<mailto:skr...@adaptivemethods.com> Spam<https://antispam.roaringpenguin.

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Christopher
Which version of Accumulo are you using? And, does the HDFS directory already exist for Accumulo? If so, Accumulo expects to be able to create this directory itself when you init. -- Christopher L Tubbs II http://gravatar.com/ctubbsii On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse wrote: > Hello,

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Mike Drob
What do you get when you try to run "accumulo init"? On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse wrote: > Hello, > > > > I'm new to accumulo and I am trying to get it up and running. I currently > = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running. I have gone > t= hrough the insta

accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

2014-01-15 Thread Steve Kruse
Hello, I'm new to accumulo and I am trying to get it up and running. I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running. I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up. The erro

Re: Accumulo and Spark

2014-01-15 Thread Jared Winick
I tried myself a few weeks ago and saw that it "just works" too for the very simple test I ran. I did see some error messages when running from sbt after the job successfully completed and the SparkContext was closing. I assume this has to do with resources within the AccumuloInputFormat? This was

Re: Bulk ingest losing tablet server

2014-01-15 Thread Anthony F
Ok, makes sense. So 1GB for native heap is reasonable? Tablet server A was alive and well when looking in the monitor. Those 'constraint violations' do not stop until after I've restarted all of the tservers. On Wed, Jan 15, 2014 at 8:49 AM, Eric Newton wrote: > When a tablet server (lets ca

Re: Bulk ingest losing tablet server

2014-01-15 Thread Eric Newton
When a tablet server (lets call it A) bulk imports a file, it makes a few bookkeeping entries in the !METADATA table. The tablet server that is serving the !METADATA table (lets call it B) checks a constraint: tablet server A must still have its zookeeper lock. This constraint is being violated be

Re: Bulk ingest losing tablet server

2014-01-15 Thread Anthony F
Just checked on the native mem maps . . . looks like it is set to 1GB. Do the index and data caches reside in native mem maps if available or is native mem used for something else? I just repeated an ingest . . . this time I did not lose any tablet servers but my logs are filling up with the foll