Re: Unable to get Mini to use native maps - 1.6.2

2016-02-23 Thread Michael Wall
Dan, My first though was are you setting LD_LIBRARY_PATH or DYLIB_LIBRARY_PATH to a directory that contains the libaccumulo shared library? If that didn't work, are you setting -Djava.library.path=whateverdirectory. But looking through the code, at least in 1.6, it looks like the NativeMap is us

Re: Unable to get Mini to use native maps - 1.6.2

2016-02-24 Thread Michael Wall
Dan, I was unable to get Christopher's example to work as posted without steps mentioned earlier in the thread. In the MiniAccumuloCluster code for version 1.6.2, if I am reading it correctly, you must do a couple of things. 1 - build the native libs 2 - call config.setNativeLibPaths(somedirecto

Re: Recovery file versus directory

2016-03-19 Thread Michael Wall
Andrew, Sounds a lot like https://issues.apache.org/jira/browse/ACCUMULO-4157. I'll look to see if what you describe could also happen with this bug. If you still have the gc logs, can you look for a message like "Removing WAL for offline server" with the uuid? Mike On Tue, Mar 8, 2016 at 11:28

Re: Accumulo 1.7.1 on Docker

2016-03-22 Thread Michael Wall
Sven, did you ever put up a Dockerfile? I've done something like this waiting for HDFS to come out of safe mode. echo "Starting Hadoop" ${HADOOP_HOME}/sbin/start-dfs.sh echo "Waiting for hadoop to come out of safeMode" local x=0 while [ $x -lt 1 ] do # try 5 times, for slow computers ${HADOOP_H

Re: tableOperations().create hangs

2016-05-19 Thread Michael Wall
David, If you are still having problems, can you take a jstack of the process while it is hung and send it? Mike On Thu, May 19, 2016 at 9:59 AM, Sven Hodapp wrote: > Hi David, > > I had the same issue. I've found out to modify table configuration in > client code the master server must be ava

Re: Persistent outstanding migrations message

2016-08-04 Thread Michael Wall
Hi Tim, You can try scanning the metadata table for a future colfam. Something like scan -t accumulo.metadata -c fut If you find one, look at the tabletserver that is slated to host that tablet. There could be an issue with that server preventing assignment from completing. Get a jstack and s

Re: Persistent outstanding migrations message

2016-08-04 Thread Michael Wall
s that > don't have FATE operations and delete them from time to time? > > Thanks, > > Tim > > On Thu, Aug 4, 2016 at 11:44 AM, Michael Wall wrote: > >> Hi Tim, >> >> You can try scanning the metadata table for a future colfam. Something >> like

Re: hard reboot... can not start accumulo

2016-08-05 Thread Michael Wall
Kevin, We are going to need more info. Here are some things I can thing of. - What versions are you using? - By reboot, do you mean rebooted the box? How many nodes in your cluster? - How did you determine the init was successful? - What is currently happening on the master? - What messages ar

Re: hard reboot... can not start accumulo

2016-08-05 Thread Michael Wall
I'm very new to accumulo. >> >> I just freshed installed those versions above on Ubuntu 14.04. I've >> reinstalled it couple of times and still had the same result. It seems >> unless I execute stop-all.sh before reboot, I'm not able to start accumulo >>

Re: hard reboot... can not start accumulo

2016-08-05 Thread Michael Wall
(or at least used to) so > when you reboot they get clobbered. > > > On Fri, Aug 5, 2016 at 12:16 PM Michael Wall wrote: > >> Ok, great. One node. In a production cluster, services are distributed >> onto many nodes, so a random reboot has less impact. In your case, a >&

Re: hard reboot... can not start accumulo

2016-08-05 Thread Michael Wall
gt;> >> > - What is currently happening on the master? >>> >> > I'm not sure how to answer this. I'm very new to accumulo. >>> >> > >>> >> > - What messages are showing up on the monitor? >>> >> > I'

Re: reboot autostart

2016-08-05 Thread Michael Wall
What do you mean auto reboot sequence? Are you asking about the service start order? Start dfs, then yarn, then zookeeper, then accumulo's start-all. Shutdown is the reverse. On Fri, Aug 5, 2016 at 4:20 PM, Kevin Cho wrote: > Thanks again for helping on last ticket. I'm trying to create auto

[ANNOUNCE] Apache Accumulo 1.8.0 Released

2016-09-07 Thread Michael Wall
The Accumulo team is proud to announce the release of Accumulo version 1.8.0 ! Accumulo 1.8.0 is a minor release that includes over 200 bug fixes, 71 improvements and 4 new features. This release is backwards-compatible with 1.7.x. This version is now available in Maven Central, and at: https://

Re: setting tserver configs from the accumulo shell

2016-10-05 Thread Michael Wall
That is what I recall as well Josh. It is confusing for sure. On Wed, Oct 5, 2016 at 11:57 AM, Josh Elser wrote: > IIRC, a property being mutable in ZooKeeper is disjoint from whether it > will be dynamically reloaded. > > That is, a mutable ZK property does not imply that it is always > dynami

Re: Installing Accumulo in multinode setup

2016-10-06 Thread Michael Wall
Maybe this is already known, so apologies in advance. But don't you need to do $ $ZOOKEEPER_HOME/bin/zkCli.sh -server m4:2181,m5:2181,m6:2181 > rmr accumulo/WHATEVER-INSTANCE-ID/tracers instead of rmr /tracers If you don't know the instance id, I you can do the following in zookeeper get /accu

Re: Installing Accumulo in multinode setup

2016-10-07 Thread Michael Wall
tracers was at the root of ZooKeeper > > (not within the /accumulo/$instance.id znode). Maybe I looked at the > wrong > > code though? > > > > Michael Wall wrote: > >> > >> Maybe this is already known, so apologies in advance. But don't you &g

Re: How can I remove or fix a hanging droptable in Accumulo?

2016-10-12 Thread Michael Wall
Jeff, What is the master doing while the droptable is hung? Mike On Wed, Oct 12, 2016 at 6:14 PM, Jeff Kubina wrote: > How can I remove or fix a hanging droptable in Accumulo? > >

Re: How can I remove or fix a hanging droptable in Accumulo?

2016-10-12 Thread Michael Wall
e in Accumulo? > > > > Lots of bulk ingest assignments. It's been hung for days and even returned > after a reboot of the master and tservers. > > > -- > > Jeff Kubina > 410-988-4436 > > > > > > On Wed, Oct 12, 2016 at 6:28 PM, Michael Wall wrote: > > Jeff, > > What is the master doing while the droptable is hung? > > Mike > > > > On Wed, Oct 12, 2016 at 6:14 PM, Jeff Kubina > wrote: > > How can I remove or fix a hanging droptable in Accumulo? > > > > >

Re: How can I remove or fix a hanging droptable in Accumulo?

2016-10-13 Thread Michael Wall
Jeff, This is the bug I ran into, https://issues.apache.org/jira/browse/ACCUMULO-4143. Looks like it was around migrations instead of splitting. Mike On Wed, Oct 12, 2016 at 8:27 PM, Michael Wall wrote: > Jeff, > > There was a race condition around splitting I think, but I can&#

Re: java.IO.EOFException: ..../accumulo/recovery/.../part-r-00000/index not a SequenceFile.

2016-10-18 Thread Michael Wall
Jeff, Take a look at the master logs for where the WAL was sorted to the /accumulo/recovery/... directory. Then look to see if those WALs are still around and contain content. Where is this this EOF exception, on a tserver? Is the master log complaining about anything? Mike On Mon, Oct 17, 20

Re: java.IO.EOFException: ..../accumulo/recovery/.../part-r-00000/index not a SequenceFile.

2016-10-18 Thread Michael Wall
or extent xx logentry x > hdfs://path/to/wal/ > > Any ideas? I figure we can zero out the WAL and it will go on with life > but it would be nice to try and get the data! > > Thanks! > > > On 10/18/2016 08:55 AM, Jeff Kubina wrote: > > > On Tue, Oc

Re: java.IO.EOFException: ..../accumulo/recovery/.../part-r-00000/index not a SequenceFile.

2016-10-21 Thread Michael Wall
. It is version 1.6.4 > by the way. Unfortunately can't send the logs to you here but I did save > them off and I'll talk to Jeff about what we can do. > > We are currently getting a new error that I'm going to look into... > > Expected protocol id 82 but go

Re: VFS version in 1.6.6 binary release

2016-12-02 Thread Michael Wall
Andrew, The commons-vfs 2.1 jar broke the accumulo build in 1.6.6 using the hadoop 1 profile. That profile is remove in 1.7+, so the commons-vfs update was left out of 1.6.6. You should just replace the commons-vfs jar in your deployment. See https://issues.apache.org/jira/browse/ACCUMULO-3470

Re: VFS version in 1.6.6 binary release

2016-12-02 Thread Michael Wall
Andrew > On 12/02/2016 12:37 PM, Christopher wrote: > > The release notes for 1.6.6 are in error. I'll update them. > > On Fri, Dec 2, 2016 at 11:36 AM Michael Wall < > mjw...@gmail.com> wrote: > >> Andrew, >> >> The commons-vfs 2.1 jar broke th

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-17 Thread Michael Wall
Matt, Using the merge command can be a little tricky. Imagine your splits look like this for whatever table 1 is using 'scan -t accumulo.metadata -b 1; -e 2; -c ~tab' 1;a ~tab:~pr []\x00 1;b ~tab:~pr []\x01a 1;c ~tab:~pr []\x01b 1;d ~tab:~pr []\x01c 1;e ~tab:~pr []\x01d 1;f

Re: Tablet count per table [SEC=UNOFFICIAL]

2017-01-24 Thread Michael Wall
Matt, I typically run the following to see all the online tablets scan -t accumulo.metadata -c loc and the following to find all tablets, online and offline scan -t accumulo.metadata -c ~tab On Mon, Jan 23, 2017 at 11:35 PM Josh Elser wrote: > I believe this would be the number of unique r

Re: accumulo.root invalid table reference [SEC=UNOFFICIAL]

2017-02-21 Thread Michael Wall
Matt, If I am reading this correctly, you have a tablet that is being loading onto a tserver. That tserver dies, so the tablet is then assigned to another tablet. While the tablet is being loading, that tserver dies and so on. Is that correct? Can you identify the tablet that is bouncing aroun

Re: accumulo.root invalid table reference [SEC=UNOFFICIAL]

2017-02-21 Thread Michael Wall
to redistribute? > > -- > *From:* Michael Wall [mailto:mjw...@gmail.com] > *Sent:* Wednesday, 22 February 2017 02:44 > > *To:* user@accumulo.apache.org > *Subject:* Re: accumulo.root invalid table reference [SEC=UNOFFICIAL] > Matt, > > If I a

Re: accumulo.root invalid table reference [SEC=UNOFFICIAL]

2017-02-23 Thread Michael Wall
data table > > entries are in one tablet. All tablet servers then query the one > > node hosting that tablet. > > I suspect the cause of this was a poorly designed table that at one > > point the Accumulo gui reported 1.02T tablets for. We've > > subsequently deleted that table but it might be that there w

[ANNOUNCE] Apache Accumulo 1.8.1 Released

2017-02-27 Thread Michael Wall
The Accumulo team is proud to announce the release of Accumulo version 1.8.1! This release contains changes from more than 40 issues, comprised of bug-fixes, performance improvements, build quality improvements, and more. This is a maintenance (patch) release. Users of any previous 1.8.x release a

Re: Fix "Table x has a hole" [SEC=UNOFFICIAL]

2017-02-28 Thread Michael Wall
Matt, Did you get past this issue? Any thoughts on what happened? Did a metadata tablet get deleted? Once you are well again, I'd like to try to figure out how you got into this state. Mike On Mon, Feb 27, 2017 at 8:56 PM Marc P. wrote: > Since I'm on my phone and am likely to be more terse,

Re: Fix "Table x has a hole" [SEC=UNOFFICIAL]

2017-03-01 Thread Michael Wall
Matt, This sentence is concerning to me "I've always removed the referenced tablet in the metadata table to fix this and had no issues in the past." I rarely make edits to the metadata table and am very, very cautious when I do. This should not be part of normal operating procedures. Can you pr

Re: tserver.compaction.*.concurrent.max behavior in Accumulo 1.8.1

2017-03-23 Thread Michael Wall
Max, On you 3 node cluster, how many tables are you ingesting into? How many tablets are in each table? Are the tablets equally spread amongst the 3 tablet servers? Mike On Thu, Mar 23, 2017 at 10:13 AM Massimilian Mattetti wrote: > With the configuration I presented before the concurrent ma

Re: tserver.compaction.*.concurrent.max behavior in Accumulo 1.8.1

2017-03-23 Thread Michael Wall
among each tablet. > Max > > > > > From:Michael Wall > To:user@accumulo.apache.org > Date:23/03/2017 16:28 > Subject:Re: tserver.compaction.*.concurrent.max behavior in > Accumulo 1.8.1 > -- > >

Re: tserver.compaction.*.concurrent.max behavior in Accumulo 1.8.1

2017-03-23 Thread Michael Wall
s. > Thanks, > Max > > > > > From:Michael Wall > To:user@accumulo.apache.org > Date:23/03/2017 17:09 > Subject:Re: tserver.compaction.*.concurrent.max behavior in > Accumulo 1.8.1 > -- > > > >

Re: New accumulo instance with existed HDFS cluster

2017-04-05 Thread Michael Wall
Lee, Can you give us a little more details about what you are trying to do? Are you installing Accumulo for the first time or do you have an existing Accumulo that you are trying to use? What version of Accumulo are you using? If you are trying to get Accumulo running for the first time with an

[ANNOUNCE] Apache Accumulo 1.7.3 Released

2017-04-06 Thread Michael Wall
The Accumulo team is proud to announce the release of Accumulo version 1.7.3! This release contains changes from more than 75 issues, comprised of bug-fixes, performance improvements, build quality improvements, and more. This is a maintenance (patch) release. Users of any previous 1.7.x release ar

Re: Configure NetBeans to build projet using Accumulo

2017-05-09 Thread Michael Wall
evelop this type of application? > > For example what libraries are needed and more. > > As reference books I'm using: > > -Accumulo Application Development, Table Design, and Best Practices > > Aaron Cordova, Billie Rinaldi, and Michael Wall > > -Apache Hadoop

Re: scan of small table stopped working (hangs)

2017-05-23 Thread Michael Wall
Jim I suspect your installation used files in /tmp that have been cleaned up. Look at your hdfs-site.xml and ensure the dfs.name.dir and dfs.data.dir are not in /tmp. Then look at your zoo.cfg directory and ensure the dataDir is defined and not /tmp. Mike On Tue, May 23, 2017 at 2:02 AM o haya

Re: empty tablet direcoties on HDFS

2017-05-23 Thread Michael Wall
Was your cluster with the batch writer done spitting and moving data? That is a lot of splits that got generated. When a tablet is split, the files are inspected and potentially assigned to both new tablets. Compacting that range will rewrite the data into files for each tablet so rfiles contain

Re: empty tablet direcoties on HDFS

2017-05-23 Thread Michael Wall
you create the > 1.01 splits?" > I crated 3 splits for the bulk ingestion too. A separated file is written > and then imported for each split point. > > Thanks. > > Max > > > > From:Michael Wall > To:user@accumulo.apache.org > Date:23/0

Re: Accumulo upgrade rollback...

2017-06-06 Thread Michael Wall
Hi Bob, Unfortunately, rolling back an upgraded system is not an automated task. Moving from 1.5.4 to 1.6.6 as you saw !METADATA changed to accumulo.metadata and accumulo.root. The upgrade also changes the data version of the rfiles, so any new files written from mutations or compactions will not

Re: 'logs/' dir in the accumulo package

2017-06-26 Thread Michael Wall
Srikanth, Like Josh said, I don't think we make that guarantee. But it is part of the maven assembly ( https://github.com/apache/accumulo/blob/rel/1.8.1/assemble/src/main/assemblies/component.xml#L91) so I would expect the directory to continue to be there. Is that causing you issues? On Mon,

Re: New blog post

2017-06-30 Thread Michael Wall
Nice, thanks Mike. I assume without gitbox we can merge the PR manually but with gitbox we could click and merge. Is that correct? On Fri, Jun 30, 2017 at 12:34 PM Keith Turner wrote: > The edit link that automagically creates a PR is really neat. > > On Fri, Jun 30, 2017 at 12:26 PM, Mike Wal

Re: Modifying VisibilityEvaluator - Problem with Classpath for scanner

2017-07-31 Thread Michael Wall
You can use the classpath command to help troubleshoot as well $ACCUMULO_HOME/bin/accumulo classpath On Mon, Jul 31, 2017 at 8:33 AM ivan bella wrote: > Jim, > Putting the jars in the lib/ext directory is a perfectly acceptable > mechanism. Make sure your jars are in place on all of your tserve

Re: accumulo.metadata table online but scans hang

2017-08-31 Thread Michael Wall
Nick First step to make sure you have plenty of HDFS space. Seems like restarting fixed your du bug, so hopefully you are good there. Consider turning on HDFS trash as well, it can be very useful for recovery. Second step is to get your metadata table happy. Try the touchz for the WAL logs and

Re: problems restoring backups

2017-10-11 Thread Michael Wall
You can also inspect the rfiles directly using PrintInfo, see http://accumulo.apache.org/1.8/accumulo_user_manual.html#_tools On Wed, Oct 11, 2017 at 10:01 AM Keith Turner wrote: > Are you scanning with the correct authorizations? May be filtering > everything out on the server side if not. > >

Re: Major Compactions

2017-12-11 Thread Michael Wall
Hi Jeff I don't have the docs in front of m but there is a cancel for compactions. I have never had much success with that though A little more complex you could try deleting the fate transaction. It will require you stop the master. Hope that helps. Mike On Mon, Dec 11, 2017, 20:01 Jeff Down

Re: Major Compactions

2017-12-12 Thread Michael Wall
Good luck Jeff. Let us know if you have more issues. Mike On Tue, Dec 12, 2017 at 1:30 AM Jeff Downton wrote: > Thank you for the responses, I didn't see the --cancel option in the docs > so good that I asked. I don't think I'll go as far as trying to delete the > fate transaction but it's an

Re: Impala integration [SEC=UNOFFICIAL]

2018-01-12 Thread Michael Wall
Matt, I have not heard of anyone doing anymore with Impala besides that ticket. CC'ing the dev list for wider dissemination. Mike On Thu, Jan 11, 2018 at 8:43 PM Dickson, Matt MR < matt.dick...@defence.gov.au> wrote: > *UNOFFICIAL* > > > > I’m looking at integrating Impala with Accumulo and not

Re: Large number of used ports from tserver

2018-01-25 Thread Michael Wall
What tables/tablets are on that tserver? On Thu, Jan 25, 2018 at 11:27 AM Adam J. Shook wrote: > We're running Ubuntu 14.04, HDFS 2.6.0, ZooKeeper 3.4.6, and Accumulo > 1.8.1. I'm using `lsof -i` and grepping for the tserver PID to list all > the connections. Just now there are ~25k connection

Re: Metadata DataFileValue not Matching the Output of rfile-info Command

2018-02-13 Thread Michael Wall
Hi Dong, That file is the result of a bulk import. I can tell because it starts with a capital "I", see http://accumulo.apache.org/1.8/accumulo_user_manual.html#_file_naming_conventions. Bulk files are inspected on import to find all the ranges of data they contain. They are then assigned to all

Re: Metadata DataFileValue not Matching the Output of rfile-info Command

2018-02-13 Thread Michael Wall
Dong > > > > On Tue, Feb 13, 2018 at 11:05 AM Michael Wall wrote: > >> Hi Dong, >> >> That file is the result of a bulk import. I can tell because it starts >> with a capital "I", see >> http://accumulo.apache.org/1.8/accumulo_user_manual.

Re: Node reports assignment failed for tablet

2018-03-18 Thread Michael Wall
Hi Nick, Looks like you are on the right track with the recovery file, which are created when WALs have to be replayed, see http://accumulo.apache.org/1.8/accumulo_user_manual.html#_recovery. Maybe try deleting hdfs://master01:9000/user/accumulo/accumulo/recovery/ 8bd07d5c-710f-4072-b351-8ce09d77

Fwd: REMINDER - TAC Applications closes in 2 weeks for ACNA Montréal

2018-04-17 Thread Michael Wall
FYI, if you going to ApacheCon in Montreal and would like to pursue travel assistance Mike -- Forwarded message - From: Gavin McDonald Date: Tue, Apr 17, 2018 at 8:41 PM Subject: REMINDER - TAC Applications closes in 2 weeks for ACNA Montréal To: Hello PMCs. Please could you

Re: Question on missing RFiles

2018-05-11 Thread Michael Wall
Adam, Do you have GC logs? Can you see if those missing RFiles were removed by the GC process? That could indicate you somehow got old metadata info replayed. Also, the rfiles increment so compare the current rfile names in the srv.dir directory vs what is in the metadata table. Are the existi

Re: Question on missing RFiles

2018-05-14 Thread Michael Wall
gt;> fixed for 1.9.1... which could affect the metadata table recovery after a >> failure. >> >> On Fri, May 11, 2018 at 6:11 PM Michael Wall wrote: >> >>> Adam, >>> >>> Do you have GC logs? Can you see if those missing RFiles were removed >&

Re: Question on missing RFiles

2018-05-16 Thread Michael Wall
e to the verbosity, but we may be > tweaking the log4j settings a bit to make sure we get the log data stored > in the event this happens again. This very well could be attributed to the > recovery failure; hard to say. I'll be upgrading to 1.9.1 soon. > > On Mon, May 14, 2018

Accumulo Summit 2018 Info

2018-06-26 Thread Michael Wall
The organizers of the Accumulo Summit 2018 asked me to pass along the following info. Mike -- Join us for the Fifth Annual Accumulo Summit ! Accumulo Summit 2018 will be held on October 15th at the Sheraton Columbia Town Center Hotel

Re: benchmarking

2018-08-27 Thread Michael Wall
Hi Guy, Here are a couple links I found. Can you tell us more about your setup and what you are seeing? https://accumulo.apache.org/papers/accumulo-benchmarking-2.1.pdf https://www.youtube.com/watch?v=Ae9THpmpFpM Mike On Sat, Aug 25, 2018 at 5:09 PM guy sharon wrote: > hi, > > I've just sta

Re: benchmarking

2018-08-28 Thread Michael Wall
takes 43 seconds. Not sure if > this is reasonable or not. Seems a little slow to me. What do you think? > > BR, > Guy. > > > > > On Mon, Aug 27, 2018 at 4:43 PM Michael Wall wrote: > >> Hi Guy, >> >> Here are a couple links I found. Can you te

Re: Accumulo performance on various hardware configurations

2018-08-29 Thread Michael Wall
Guy, Can you go into specifics about how you are measuring this? Are you still using "bin/accumulo shell -u root -p secret -e "scan -t hellotable -np" | wc -l" as you mentioned earlier in the thread? As Mike Miller suggested, serializing that back to the display and then counting 6M entries is g

Re: Accumulo performance on various hardware configurations

2018-08-29 Thread Michael Wall
gt; debugging turned off and a BatchScanner with 10 threads. I redid all the > measurements and although this was 20% faster than using the shell there > was no difference once I started playing with the hardware configurations. > > Guy. > > On Wed, Aug 29, 2018 at 10:06 PM Michael W

Re: vfs classpath could not replicate

2018-09-27 Thread Michael Wall
> > java.lang.ClassNotFoundException: IO Error loading class > org.apache.accumulo.tserver.compaction.DefaultCompactionStrategy Do you have your accumulo jars in VFS? I would recommend against that, put them in ACCUMULO_HOME/lib. Those should not be reloaded between restarts and makes a lot of

Re: outstanding migrations

2018-10-11 Thread Michael Wall
Thomas, Glad you found it. Let us know if you run into other issues. Mike On Wed, Oct 10, 2018 at 3:44 PM Thomas Adam wrote: > Figured it out, found a line in the master log of which tablet server was > stuck. Stopped that tablet server and waited for the write ahead logs to > recover and tha

Re: All tablets are down

2019-02-27 Thread Michael Wall
Pranav, Having a corrupt root table and replacing with with an empty empty file means Accumulo does not not anything about the metadata table. Without the metadata table, Accumulo know nothing about the other tables. If you can do so, I suggest starting over. If you have data you need to keep,

Fwd: Travel Assistance for ApacheCon NA Las Vegas 2019 now open.

2019-05-17 Thread Michael Wall
-- Forwarded message - From: Gavin McDonald Date: Fri, May 17, 2019 at 2:30 AM Subject: Travel Assistance for ApacheCon NA Las Vegas 2019 now open. To: Hi PMCs! Please redistribute the below to your user and dev lists, feel free to also use social media to spread the word. Than

Fwd: ApacheCon EU 2019 Travel Assistance Applications now open!

2019-06-21 Thread Michael Wall
-- Forwarded message - From: Christofer Dutz Date: Fri, Jun 21, 2019 at 3:56 AM Subject: ApacheCon EU 2019 Travel Assistance Applications now open! To: Hi pmcs@!, The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for ApacheCon EU

Re: scan ignores custom Formatter

2019-07-16 Thread Michael Wall
Couple of thoughts 1 - Are you putting the jar on all the tservers and restarting everthing? 2 - Have you tried setting the formatter on the table as opposed to the scan command. Something like 'config -t mytable -s table.formatter=com.example.MyFormatter' Mike On Tue, Jul 16, 2019 at 2:50 PM m

Re: scan ignores custom Formatter

2019-07-16 Thread Michael Wall
ter` commands as alternatives. > > Unfortunately no luck yet. > > > > On Tue, Jul 16, 2019 at 1:30 PM Michael Wall wrote: > >> > >> Couple of thoughts > >> > >> 1 - Are you putting the jar on all the tservers and restarting > everthing?

Re: scan ignores custom Formatter

2019-07-24 Thread Michael Wall
Did you ever get this working? Mike On Wed, Jul 17, 2019 at 12:16 PM mhd wrk wrote: > Basically the sample code (attached) is a copy of DefaultFormatter with > some modifications to `formatEntry` > > On Tue, Jul 16, 2019 at 6:13 PM Michael Wall wrote: > >> If you are sti

Fwd: [PMCs] Launch of the 2020 ASF Community Survey

2019-12-06 Thread Michael Wall
Forwarding an email from ASF Diversity & Inclusion. See below Mike --- Hello everyone, If you have an apache.org email, you should have received an email with an invitation to take the 2020 ASF Community Survey. Please take 15 minutes to complete it. If you do

Re: [EXTERNAL EMAIL] - Re: accumulo and hdfs data locality

2021-09-10 Thread Michael Wall
If a tablet moves, the data files in HDFS do not go with it. However, during the next compaction one copy of the rfile should be written locally. Note, the metadata has a last column for each tablet, to record where the table was last hosted. On startup, Accumulo will try to assign a tablet to t

Re: [EXTERNAL EMAIL] - Re: accumulo and hdfs data locality

2021-09-10 Thread Michael Wall
#x27;s overall data. > > On Fri, Sep 10, 2021, 09:03 Michael Wall wrote: > >> If a tablet moves, the data files in HDFS do not go with it. However, >> during the next compaction one copy of the rfile should be written locally. >> >> Note, the metadata has a la

Re: exporttable content to linux local file system (not hdfs)

2021-09-16 Thread Michael Wall
I assume you are looking at https://accumulo.apache.org/1.10/examples/export.html I can think of 2 options 1 - use hadoop's distcp command to copy the table over to the other instance 2 - if you really, really want a local copy then use something like `hdfs dfs -get hdfs-path local-path` Mike O

Re: accumulo tserver rolling restart

2021-11-29 Thread Michael Wall
Is there a reason to not just stop the cluster, reset the heap and restart the cluster? That is simpler. On Mon, Nov 29, 2021 at 9:37 AM dev1 wrote: > Yes – and don’t forget to reset it back when you are done. > > > > *From:* Ligade, Shailesh [USA] > *Sent:* Monday, November 29, 2021 9:36 AM >

Re: tablets per tablet server for accumulo 1.10.0

2022-02-01 Thread Michael Wall
In my experience, merging goes faster if you compact the ranges to be merged first. On Tue, Feb 1, 2022, 07:48 Ligade, Shailesh [USA] wrote: > Thank you for explanation! > > Once ran getsplits it was clear that splits were the culprit, so I need to > do merge as well bump the threshold to higher

Re: Tablet Server Session Id Out of Range

2022-04-22 Thread Michael Wall
Hi Johnathan What version of zookeeper are you running? Sounds like you may be hitting https://issues.apache.org/jira/plugins/servlet/mobile#issue/ZOOKEEPER-1622. If so, try shutting down Accumulo, then zookeeper. Then upgrade zookeeper and restart. Mike On Fri, Apr 22, 2022, 15:30 Wonders,

Re: List of Ports used

2013-07-10 Thread Michael Wall
To see what ports are currently in use on a cluster, look for port entries and overrides in the "config" command in the shell. Something like $ACCUMULO_HOME/bin/accumulo shell -u username -e "config -np" There is also the "Networking and Security" section under http://www.accumulodata.com/ec2.ht

Re: Setting authorizations in code

2013-09-23 Thread Michael Wall
Without seeing all your code, I notice that both setAuthorizations and getScanner return null. Are you sure whatever _db is in the filter method is getting setup as you expect? On Mon, Sep 23, 2013 at 12:28 PM, Benjamin Parrish wrote: > This is on a stand-alone instance. Stepping through the co

Re: slave tserver not responding

2014-01-01 Thread Michael Wall
I don't know if it helps debugging, but I am seeing the following in tserver_shrine.log 2014-01-01 06:15:37,852 [hdfs.DFSClient] INFO : Exception in createBlockOutputStream 10.240.165.43:50010 java.io.IOException: Bad connect ack with firstBadLink as 10.240.203.36:50010 2014-01-01 06:15:37,852 [hd

Feedback requested - Accumulo Quickstart

2014-01-19 Thread Michael Wall
Hello, I am interested in feedback on a project to help new users get up and running with Accumulo. The project is available at https://github.com/mjwall/accumulo-quickstart. If the README doesn't answer everything, please let me know so I can fix it. Suggestions, bugs, comments and anything el

Re: Feedback requested - Accumulo Quickstart

2014-01-19 Thread Michael Wall
an 20, 2014 at 12:02 AM, Ted Yu wrote: > Do you plan to add description for running on hadoop 2.2 ? > > Cheers > > > On Sun, Jan 19, 2014 at 9:00 PM, Michael Wall wrote: > >> Hello, >> >> I am interested in feedback on a project to help new users get up a

Re: Feedback requested - Accumulo Quickstart

2014-01-20 Thread Michael Wall
> of the services can automatically be started. The user can immediately > start to work with Accumulo and basically ignore Hadoop and Zookeeper. > > > On Mon, Jan 20, 2014 at 12:13 AM, Michael Wall wrote: > >> Hi Ted, thanks for the reply >> >> Yes, I hav

Re: Node.js Interaction with Accumulo

2014-02-27 Thread Michael Wall
Although a little dated, there is also https://github.com/klucar/node-accumulo you could reference. I recall Jim's sticking point being the nodejs/thrift interaction which is why he wrote https://github.com/klucar/node-thrift. Cool stuff. How's the performance? Would love to see some benchmarks

Re: "NOT" operator in visibility string

2014-03-05 Thread Michael Wall
Perhaps the javadoc should be updated? http://accumulo.apache.org/1.5/apidocs/org/apache/accumulo/core/security/ColumnVisibility.html#ColumnVisibility(java.lang.String) Mike On Wed, Mar 5, 2014 at 8:16 PM, Christopher wrote: > This has been discussed for inclusion in the past. The reason it h

Re: "NOT" operator in visibility string

2014-03-05 Thread Michael Wall
i > > > On Wed, Mar 5, 2014 at 8:35 PM, Michael Wall wrote: > > Perhaps the javadoc should be updated? > > > > > http://accumulo.apache.org/1.5/apidocs/org/apache/accumulo/core/security/ColumnVisibility.html#ColumnVisibility(java.lang.String) > > > > Mike > &g

Re: Delete All Data In Table

2014-05-13 Thread Michael Wall
If you are simply trying to clean up data between unit tests, you should look at using the MiniAccumuloCluster. I heard there may be a blog article coming out soon for testing stuff. Until then, take a look at Instamo Archetype for an example usage at https://git-wip-us.apache.org/repos/asf?p=acc