[OpenIndiana-discuss] Fwd: ZFS 0+1 across disparate drives

2021-12-01 Thread jason matthews
Yes, you can use whatever drives you have but don't expect it to have consistence performance. Each mirrored vdev will be as slow as the slowest drive. I would not put a green drive in the pool. Green drives have this nasty habit of spinning down to save power and be green like kermit the

Re: [OpenIndiana-discuss] ssh to oi_151a9

2021-06-16 Thread Jason Matthews
If you are not using the Sun features in their version of ssh you can upgrade to OpenSSH current. If you have to run Sun’s ssh then consider running openssh on another port, for instance. J Sent from my iPhone > On Jun 16, 2021, at 9:27 AM, david allan finch wrote: > > Hi, > > I

Re: [OpenIndiana-discuss] raidz2 as compared to 1:1 mirrors

2021-02-21 Thread Jason Matthews
11 TB is about right. Your 2TB disks will be "smaller" by nature of reporting differences. Much of that is difference between how drive manufacturers report a megabyte as 1,000,000 bytes and computers report a megabyte 1048576 bytes. In a nutshell, in your raidz2 vdev you have eight drives.

[OpenIndiana-discuss] how to swap nvme drives

2021-02-10 Thread jason matthews
I had an NVMe drive fail. I put a new drive in, and it assumed "Slot 11" from the view of cfgadm. The new drive shows up as connected/configured in cfgadm. However, no block device shows up in iostat.  The system is on joyent_20200910T013122Z. What additional secret sauce needs to be

[OpenIndiana-discuss] 10G/40G net perf - what are you doing?

2020-11-08 Thread Jason Matthews
*So my 10G/40G network performance sucks. I have a combination of Chelsio and Intel 10 and 40G NICs. The 10G Intels do a little better. I have dug deeper into systems with Chelsio cards than Intel cards but what I found is that the receive buffer on the Chelsio card fills up and then it

Re: [OpenIndiana-discuss] Huge ZFS root pool slowdown - diagnose root cause?

2018-12-11 Thread jason matthews
On 12/11/18 10:14 AM, John D Groenveld wrote: And when its replaced, I believe the OP will need to installboot(1M) the new drive. Correct me if I'm wrong, but Illumos ZFS doesn't magically put the boot code with zpool replace. man installgrub installgrub /boot/grub/stage1 /boot/grub/stage2

Re: [OpenIndiana-discuss] Huge ZFS root pool slowdown - diagnose root cause?

2018-12-11 Thread jason matthews
This is your offending device: $ pfexec smartctl -a -d sat,12 /dev/rdsk/c2t0d0s0 | grep Raw_Read 1 Raw_Read_Error_Rate 0x000b 094 094 016Pre-fail Always - 1376259 Try removing this disk. The boot manager is in your bios. It currently points to one of your rpool

Re: [OpenIndiana-discuss] Huge ZFS root pool slowdown - diagnose root cause?

2018-12-10 Thread jason matthews
On 12/10/18 8:10 AM, Lou Picciano wrote: Machine does eventually boot, however - takes about 20 mins! Recent Hipster updates (2018-11-27) have been applied. System otherwise runs quite well. Most client data is on datapool; they remain oblivious. (To be honest, they were oblivious before

[OpenIndiana-discuss] ZFS encryption

2018-05-16 Thread jason matthews
I have read through the notes on https://github.com/openzfs/openzfs/pull/489 but I have been unable to gleam any notion of when pull 489 might be ready for prime time. Can someone closer to the project give me a best guess of when it might be upstreamed? thanks, j.

[OpenIndiana-discuss] d/l location for tamp

2018-01-10 Thread jason matthews
Can someone point me in the direction,or uhm email me,  the tamp-2.5 source tarball by tim cook from back in the day? they say nothing disappears from the internet but i routinely find that to be false... thanks, j. ___ openindiana-discuss

Re: [OpenIndiana-discuss] Duplicate devices in zpool, degraded

2018-01-09 Thread Jason Matthews
I would delete the cache file, reboot, and then re-import the volume. rm /etc/zfs/zfs.cache reboot J. Sent from my iPhone > On Jan 8, 2018, at 5:45 PM, John D Groenveld wrote: > > In message , David > Koski >

Re: [OpenIndiana-discuss] How to tell for sure what bit your OS is?

2017-05-25 Thread jason matthews
On 5/25/17 2:17 PM, Alan Coopersmith wrote: "isainfo -kv" will tell you which kernel is running. winner winner chicken dinner. isainfo is the most elegant way i know of. j. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org

Re: [OpenIndiana-discuss] dell r730xd + SATA

2017-04-29 Thread Jason Matthews
look. j. On 4/28/2017 4:29 PM, Andrew Gabriel wrote: On 28/04/2017 22:57, Nikola M wrote: On 04/28/17 09:09 PM, jason matthews wrote: Is anyone using the R730XD with its 3x port expanders successfully with SATA drives? Yes, I am aware of the conventional wisdom. I'll pass some general

Re: [OpenIndiana-discuss] dell r730xd + SATA

2017-04-28 Thread jason matthews
Nikola, I should add that when I can get a couple of dozen NVMe SSDs in a single chassis I will be more than happy to stop pushing the envelope on SAS/SATA storage. There are so few SSD SAS drives, none of which are available from distribution at this point in time, that creative solutions

Re: [OpenIndiana-discuss] dell r730xd + SATA

2017-04-28 Thread jason matthews
On 4/28/17 3:25 PM, Nikola M wrote: OMG. Again, I am aware of conventional wisdom and have provided the same information to others. On 04/28/17 11:57 PM, Nikola M wrote: I have a number of R730s working with the 2x expanders and Intel DC S37{0,1}0 SSDs. It is time to order again and the

Re: [OpenIndiana-discuss] dell r730xd + SATA

2017-04-28 Thread jason matthews
On 4/28/17 2:57 PM, Nikola M wrote: --- cut -- thanks, I am aware of the conventional wisdom. I am asking about a specific use case. BTW, since LSI is the only game in town, just about everything is SATA on LSI SAS, contrary to your sata-sata ascertain. Does anyone have any R730XD on

[OpenIndiana-discuss] dell r730xd + SATA

2017-04-28 Thread jason matthews
Is anyone using the R730XD with its 3x port expanders successfully with SATA drives? Yes, I am aware of the conventional wisdom. I have a number of R730s working with the 2x expanders and Intel DC S37{0,1}0 SSDs. It is time to order again and the 24 bay 730XD is a seductress in terms of

Re: [OpenIndiana-discuss] ZFS on Openindiana vs ZFS on oracle linux

2017-04-21 Thread jason matthews
On 4/21/17 11:36 AM, Andreas Wacknitz wrote: I can't tell. It's a specialized distribution and I am currently evaluating it because SmartOS does not work well on my HP ProLiant DL360 G7. But I am just recently started playing with it so I cannot say much about internal details yet. I would

[OpenIndiana-discuss] NSA Solaris hacks

2017-04-11 Thread jason matthews
https://www.theregister.co.uk/2017/04/11/solaris_shadow_brokers_nsa_exploits/ has anyone reviewed this for relevancy? j. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org

Re: [OpenIndiana-discuss] What to do when zfs destroy -f or -R or both doesn't destroy

2017-03-28 Thread Jason Matthews
> Re busy What about loop back mounts? Any shares of any type? Anything like that? Re failed service The local fs error maybe because the system is trying to mount a fs on top of a non-empty directory or equivalently two file systems have the same mount point.

Re: [OpenIndiana-discuss] tamp command WAS:::: mbuffer connection refused on varius ports ... what to try

2017-03-27 Thread jason matthews
On 3/27/17 1:13 PM, Jerry Kemp wrote: Off topic question. Wasn't familiar with the tamp utility you were referencing in your sample command below. After some research, I believe you are referencing this: https://blogs.oracle.com/timc/resource/tamp-2.5-source.zip

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

2017-03-27 Thread jason matthews
On 3/27/17 10:18 AM, Geoff Nordli wrote: On 2017 , | sender: | zfs send tank/dana@snap1 | tamp | mbuffer -s 128k -m 1000m -O | target_host:31337 | | receiver: | mbuffer -s 128k -m 1999m -I 31337 | tamp -d | zfs recv -vFd newtank ` My rendition: zfs send p0/vb/vm@170326_1

Re: [OpenIndiana-discuss] 800GB in 6 discs - 460GB in raidz

2017-03-24 Thread jason matthews
On 3/24/17 4:33 PM, jason matthews wrote: I lost 18TB on 192TB raw pool or about 10% and I am using way more parity disks than you are. my ratio is 1:4 you claim yours is 1:6 but we'll see when you send zpool status p0 My 1:4 ratio is not optimal so dont copy this configuration

Re: [OpenIndiana-discuss] 800GB in 6 discs - 460GB in raidz

2017-03-24 Thread jason matthews
On 3/24/17 3:43 PM, Harry Putnam wrote: I continue to have a problem understanding the output of zfs list. You may want zpool list, depending on what you trying to get. Let's see what you have done. please show us: zpool status p0 Ok, if that is correct then it means that 6 disks when

Re: [OpenIndiana-discuss] Is hipster repo slow for pkg commands

2017-03-24 Thread jason matthews
On 3/24/17 3:15 PM, Tim Mooney wrote: pkg.openindiana.org appears to be in London, so maybe it's the link to the UK that's causing things to be slower for us. i get 133ms RTT to a zayo router in london from san francisco and 134ms to pkg.openindiana.org. Given the two networks have similar

Re: [OpenIndiana-discuss] How to manage a send over ssh

2017-03-23 Thread jason matthews
On 3/23/17 4:49 PM, Timothy Coalson wrote: When you are done, your hash should look something like this: jason:$2a$16$2ynmKaAAnKZYWLF8umslZeHjkVIX6iDLsx345k59rVkBF/ 8zWdCqO:17248:: If someone can crack this hash I will buy you a beer. There's some logic to why the shadow file isn't

Re: [OpenIndiana-discuss] How to manage a send over ssh

2017-03-23 Thread jason matthews
On 3/23/17 4:19 PM, jason matthews wrote: 2a crypt_bsdf.so.1 rounds=16 this line should actually as: 2a crypt_bsdf.so.1 20 the rounds=xx is apparently just the sha libs. oh, and you may have to completely erase your hash /etc/shadow for an existing user and then reset the password

Re: [OpenIndiana-discuss] How to manage a send over ssh

2017-03-23 Thread jason matthews
On 3/23/17 2:56 PM, Timothy Coalson wrote: The main advantage with this way is that you don't leave root ssh exposed for people to try to break into, and the special user for receiving can't get higher privileges for anything other than "zfs". With the notable exception that your

Re: [OpenIndiana-discuss] How to manage a send over ssh

2017-03-23 Thread jason matthews
On 3/23/17 11:24 AM, Geoff Nordli wrote: Hi Harry. A couple of different options: 1) give your account zfs permissions (tank is the pool) zfs allow -s @adminrole clone,create,destroy,mount,promote,quota,receive,rename,reservation,rollback,send,snapshot,userprop tank zfs allow harryp

Re: [OpenIndiana-discuss] Root login

2016-12-16 Thread Jason Matthews
On 12/16/2016 4:43 PM, Jerry Kemp wrote: sed s/role model/usermod/ or s/role model/rolemod/ i swear i fixed that twice - thanks autospell. j. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org

Re: [OpenIndiana-discuss] Root login

2016-12-16 Thread Jason Matthews
role model -k type=normal root Make the sshd_config mentioned Svcadm restart ssh (or sshd whichever) Sent from my iPhone > On Dec 16, 2016, at 10:10 AM, Bob Friesenhahn > wrote: > >> On Fri, 16 Dec 2016, Richard Skelton wrote: >> >> Hi Richard, >> I the file

[OpenIndiana-discuss] illumos os tech ops job

2016-04-27 Thread jason matthews
Are there any folks on this list in the SF Bay area looking for work as a admin/sre type? we are an OI/SmartOS shop with a data center installation at 200 paul. General unix knowledge plus knowledge of ZFS is helpful. If you can dtrace your way out of a paper bag that is even better.

Re: [OpenIndiana-discuss] masquerade

2016-03-09 Thread Jason Matthews
here is an example from one my hosts that NATs addresses for outbound postback connections for a number of zones on the same machine. the data is routed over a etherstub and lands on a vnic in the rfc1918 subnet. jason@jobs011:~jason# cat /etc/ipf/ipnat.conf map net1 172.16.254.0/24 ->

Re: [OpenIndiana-discuss] very slow zpool

2016-01-01 Thread Jason Matthews
On 12/31/2015 5:02 PM, Martin Frost wrote: Thanks, Bob and Ian. Out of curiousity, how hot is the kernel? j. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] Posting inline

2015-12-14 Thread Jason Matthews
> On Dec 12, 2015, at 8:44 PM, Alan Coopersmith > wrote: > > And as annoying as both may be, is it worse than making the list so hostile > that > the very small community you have shrinks even further because no one wants to > participate at the risk of being

Re: [OpenIndiana-discuss] SSD as a dedicated swap device

2015-12-12 Thread Jason Matthews
Funny. I recommend getting more ram. Ram is cheap, compared to the past. Sent from my iPhone > On Dec 11, 2015, at 5:24 PM, Reginald Beardsley via openindiana-discuss > wrote: > > My long standing rule is swap = 8 x core. This is primarily to

Re: [OpenIndiana-discuss] ML350G6 What to do?

2015-12-10 Thread jason matthews
On 12/10/15 5:35 AM, the outsider wrote: 3. idea is to create a ZFS RAID Z2 pool with 4 or more drives RAIDZ2 on four drives, if you need any kind of performance, is silly. The red drives are still fairly slow by todays standards. Performance wise, you would be better off with a set of 2x2

Re: [OpenIndiana-discuss] Does the latest OI version allow ashift=12 for zpool creation?

2015-10-28 Thread jason matthews
a current model disk with 4k sectors to replace it. Configuring ashift sizes at pool creation time can be done in FreeBSD and (I think) in ZFSonLinux as well. Andy On Tue, 27 Oct 2015, jason matthews wrote: If your new drives are misrepresenting their sector size you can override the sector size

Re: [OpenIndiana-discuss] Broken zpool

2015-10-28 Thread jason matthews
Let me apologize in advanced for inter-mixing comments. On 10/27/15 7:44 PM, Rainer Heilke wrote: I am not trying to be a dick (it happens naturally), but if you cant afford to backup terabytes of data, then you cant afford to have terabytes of data. That is a meaningless statement, that

Re: [OpenIndiana-discuss] Support for USB3?

2015-10-28 Thread jason matthews
On 10/28/15 1:58 PM, Bob Friesenhahn wrote: Also consider eSATA since that can be supported by OpenIndiana and is commonly available on external drives. The electrical and protocol specification for esata is the same as sata. E-SATA cables I think need to be shielded. The only difference

Re: [OpenIndiana-discuss] What is the recommended way to back up root pool?

2015-10-28 Thread jason matthews
At home, I do nothing for rpools. I dont even mirror them and I havent even written out a process for recovery. I assume I can just reinstall and re-import any custom xml files for smf that i have archived. for work, i have automation to rebuild rpools but i dont back them up. Here is one

Re: [OpenIndiana-discuss] What is the recommended way to back up root pool?

2015-10-28 Thread jason matthews
never mind, zfs split doesnt work on rpools. j. On 10/28/15 5:08 PM, jason matthews wrote: zfs split may also be undocumented depending on your distribution. j. On 10/28/15 5:08 PM, jason matthews wrote: At home, I do nothing for rpools. I dont even mirror them and I havent even

Re: [OpenIndiana-discuss] What is the recommended way to back up root pool?

2015-10-28 Thread jason matthews
zfs split may also be undocumented depending on your distribution. j. On 10/28/15 5:08 PM, jason matthews wrote: At home, I do nothing for rpools. I dont even mirror them and I havent even written out a process for recovery. I assume I can just reinstall and re-import any custom xml

Re: [OpenIndiana-discuss] What is the recommended way to back up root pool?

2015-10-28 Thread Jason Matthews
Go old school. Use dd to manually mirror two or more identical drives. Apply boot blocks. Nail the boot device in Lsi or bios. J. Sent from my iPhone > On Oct 28, 2015, at 5:59 PM, Bob Friesenhahn > wrote: > >> On Wed, 28 Oct 2015, Doug Hughes wrote: >> >>

Re: [OpenIndiana-discuss] Does the latest OI version allow ashift=12 for zpool creation?

2015-10-27 Thread jason matthews
If your new drives are misrepresenting their sector size you can override the sector size, thanks to george wilson, in sd.conf. this is common for SSDs. http://wiki.illumos.org/display/illumos/List+of+sd-config-list+entries+for+Advanced-Format+drives You can gather the data for the

Re: [OpenIndiana-discuss] Broken zpool

2015-10-27 Thread jason matthews
You may want to consider restoring from backup. j. On 10/27/15 7:00 AM, Rainer Heilke wrote: Greetings. Some of you may remember that I had a couple disk failures recently. One of those disk was the mirror for all of my critical data. The problem is that, no matter what I do, I cannot get

Re: [OpenIndiana-discuss] Broken zpool

2015-10-27 Thread jason matthews
If I had a nickel for every time someone told me, "I don't have a backup." I am just going to go on a generalized rant... and then return to next steps. This is probably not the appropriate time, given your state of mind is not likely accepting this sort of advice at this point in time, to

Re: [OpenIndiana-discuss] zpool and HDD problems

2015-10-04 Thread Jason Matthews
Gary is right to suspect other issue. Is your cmos clock reporting the correct time? A battery failure could cause the loss of your disk controller setting which might lead you to believe your disks failed. J. Sent from my iPhone > On Oct 4, 2015, at 3:27 PM, Rainer Heilke

Re: [OpenIndiana-discuss] Kernel panic on hung zpool accessed via lofi

2015-09-28 Thread Jason Matthews
Sent from my iPhone > On Sep 16, 2015, at 11:49 AM, Watson, Dan wrote: > > I've noticed that drives with a labeled WWN tend to be less error prone, and > only when a driv This a distinction that only exists in your head. :) I have only 768 HGST 600gb sas drives

Re: [OpenIndiana-discuss] System will not boot, boot-archive fails

2015-09-23 Thread jason matthews
On 9/23/15 2:12 AM, Richard Patterson wrote: Any ideas? Two failed drives at the same time. Sigh. Normally the odds would be in your favor but we are talking about WD. What happens if you put in the drive one of those drives, you may have to cycle through them to find one that doesnt

Re: [OpenIndiana-discuss] System will not boot, boot-archive fails

2015-09-23 Thread jason matthews
On 9/23/15 12:10 PM, jason matthews wrote: On 9/23/15 2:12 AM, Richard Patterson wrote: Any ideas? consider the possibility you have selected the wrong drive as the faulty one. i suspect this is the case as three drives going bad simultaneously is extremely unlikely. j

Re: [OpenIndiana-discuss] System will not boot, boot-archive fails

2015-09-21 Thread jason matthews
try the following: delete the zpool cache, /etc/zfs/zpool.cache reboot the system, it should boot since it wont try to mount the backups zpool change the bootarchive time out to two minutes manually import the backups. clear the remaining services in maintenance mode that should get it going.

Re: [OpenIndiana-discuss] OT how to test a monitor

2015-09-16 Thread Jason Matthews
Short answer is it depends on the monitor but in most cases no. The price points on monitors/tvs have plummeted in recent years. My next monitor is a 65 inch 4K uhd. I have nice spot on the wall picked out. That said, you can get 32" Samsung for $200 these days. Sent from my iPhone > On

Re: [OpenIndiana-discuss] Hard shutdown now no boot

2015-08-10 Thread jason matthews
Another satisfied customer. j. On 8/10/15 12:14 PM, Harry Putnam wrote: Lou Picciano loupicci...@comcast.net writes: Harry, First, apologies. I should have provided you that explicit GRUB boot line, then stuck with you! No matter, you're further along now... I'm gonna use the Occam's

Re: [OpenIndiana-discuss] Hard shutdown now no boot

2015-08-09 Thread Jason Matthews
On 8/9/2015 1:58 PM, Harry Putnam wrote: The bios clock appears to be maintaining correct time. Not sure if that means anything in terms of cmos battery. if you have never had to change the time since the episode occurred then that i negative indicator that you lost your bios settings to

Re: [OpenIndiana-discuss] Hard shutdown now no boot

2015-08-08 Thread Jason Matthews
if you think the cmos battery is bad then the sata config might have reverted to legacy mode or compatibility mode from ahci (or vice versa). this might account seeing grub but not file systems. this needs to be addressed before proceeding. they kernel line you are looking for should look

[OpenIndiana-discuss] mask disk by wwn?

2015-07-07 Thread jason matthews
is there a mechanism to mask a disk by wwn or serial number in sd.conf or some other mechanism? i periodically have misbehaving disks that jam up the host. it would be convenient to mask them from the OS/zfs so they are not interacted with post reboot. i am looking for a feature similar to

Re: [OpenIndiana-discuss] Support for LSI-2308 SAS controller in oi_151a8

2015-07-01 Thread Jason Matthews
Hp had a similar problem on their controllers. SSDs would invoke a thermal shut down. Return the drives for hgst counter parts. Sent from my iPhone On Jul 1, 2015, at 5:16 PM, Matt Boswell matt.bosw...@medsphere.com wrote: Hi all, We bit the bullet and bought a companion storage

Re: [OpenIndiana-discuss] secure erase - confusion

2015-06-25 Thread jason matthews
Perhap Intel has implemented the security option as cell erasure on the SSDs. That might make more sense. Thoughts? j. On 6/25/15 10:24 AM, jason matthews wrote: I would like to know if: sg_format -S aka sg_format --security is equivalent to the famed secure erase ATA command

[OpenIndiana-discuss] secure erase - confusion

2015-06-25 Thread jason matthews
I would like to know if: sg_format -S aka sg_format --security is equivalent to the famed secure erase ATA command that will trigger the erasure of cells on an SSD. In looking at Intels data center tool for SSDs they describe erase as: Erase all the data on the drive by issuing a SCSI

Re: [OpenIndiana-discuss] Pool I/O

2015-05-08 Thread jason matthews
sounds like it is blocking on NFS :-) Ask Chris for a try/buy DDRdrive X1 or whatever the latest concoction is... it could be life change for you. j. On 5/8/15 11:32 AM, Joe Hetrick wrote: Today I played a bit with set sync=disabled after watching a few f/s write IOP's. I can't decide

Re: [OpenIndiana-discuss] Pool I/O

2015-05-08 Thread jason matthews
to disk in a timely fashion. J On 08 May 13:10, jason matthews wrote: sounds like it is blocking on NFS :-) Ask Chris for a try/buy DDRdrive X1 or whatever the latest concoction is... it could be life change for you. j. On 5/8/15 11:32 AM, Joe Hetrick wrote: Today I played a bit with set

Re: [OpenIndiana-discuss] ashift 13?

2015-04-08 Thread Jason Matthews
On 4/7/2015 2:36 PM, Jason Matthews wrote: The results are in. 4k sectors consume 302G for this data set. 512b 202GB 4KB302GB 8KB474GB It seems that George Wilsons modification to the sd driver to let you nail the sector size only works in one direction. You can only specify

Re: [OpenIndiana-discuss] ashift 13?

2015-04-08 Thread Jason Matthews
Yes. Sent from my iPhone On Apr 8, 2015, at 2:31 AM, James li...@xdrv.co.uk wrote: On 08/04/2015 08:21, Jason Matthews wrote: Are there inefficiencies that creep into LZ4 with larger block sizes some how? Are you using zfs recordsize=8k? (As often recommended with Postgresql

Re: [OpenIndiana-discuss] ashift 13?

2015-04-08 Thread Jason Matthews
I am going to try again with 128k. Should know something in a few hours. Sent from my iPhone On Apr 8, 2015, at 2:31 AM, James li...@xdrv.co.uk wrote: On 08/04/2015 08:21, Jason Matthews wrote: Are there inefficiencies that creep into LZ4 with larger block sizes some how? Are you

Re: [OpenIndiana-discuss] ashift 13?

2015-04-08 Thread jason matthews
cross posting to zfs The data seems to indicate that something strange is happening between the compression algorithms and sector sizes 512 bytes. ZFS reports virtually the same compression ratios for either ashift=9 or ashift=12 zpools, but the number of data blocks consumed varies

[OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
http://wiki.illumos.org/display/illumos/List+of+sd-config-list+entries+for+Advanced-Format+drives There are number of drives listed in the above document as being 8kb sector devices. Is this right? ashfit=13? I set a system up on dc s3700 with a physical-block-size of 8192 and most of the

Re: [OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
On 4/7/2015 11:07 AM, Jim Klimov wrote: As for inflation - whenever you have smaller zfs allocations, such as those tails from blocks sized not power of 2 thanks to compression, they become a complete minimal recordsize block such as 4k or 8k as native to your drives, with trailing

Re: [OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
On 4/7/2015 12:53 PM, Jim Klimov wrote: Also, how did you build the slave? Binary file copy? Zfs send? Import from sql/dump files? Are compression/copies/recordsize etc. settings the same on two dataset contents? zfs send -Ri, using a series of incrementals until i got the two systems

Re: [OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
Well, the inflation is definitely caused by using 8k sectors. Sending that same snapshot back to a pool configured for 512b reduces its utilization to 200gb data/zones/shard035b.apsalar.com/postgresused 202G - That is frustrating. I just launched 64 slaves with pools set

Re: [OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
On 4/7/2015 12:50 PM, Jim Klimov wrote: What layout do you have? The inflation losses are much more noticeable on raidzN than on mirrors for example (e.g. for each miniature file, tail or metadata block that used 512b*3 on a raidz2, you now use 8k*3 for example). There is also padding

Re: [OpenIndiana-discuss] ashift 13?

2015-04-07 Thread Jason Matthews
On 4/7/2015 1:13 PM, Jason Matthews wrote: I wonder what 4k write sizes look like. Let's find out. The results are in. 4k sectors consume 302G for this data set. 512b 202GB 4KB302GB 8KB474GB shit, what do 256byte sectors look like. Maybe I can compress the dataset into nothing

[OpenIndiana-discuss] hadoop+jcuda

2015-02-03 Thread jason matthews
Hello world, has anyone tried running hadoop+jcuda for gpu acceleration on their hadoop cluster on any illumos derived OS? I am probably one of like eight people running such a cluster at scale, but it never hurts to ask. I am interested to know if it works, meaning all the drive train

[OpenIndiana-discuss] LX Branded zones

2015-01-23 Thread jason matthews
SmartOS has restored LX zones. GD championed rejecting them in https://www.illumos.org/issues/104 Will LX Branded zones be making a come back in future OI releases? I may end up having to support something like Vertica where we are performance mindful. I do not want the risk a diverging OS

Re: [OpenIndiana-discuss] LX Branded zones

2015-01-23 Thread jason matthews
On 1/23/15 2:30 PM, James Carlson wrote: But, hey, if you think you can do it and make it useful, then there's no real reason to solicit any opinions. Start coding it and prove me wrong. ;-} Or boot SmartOS and call it a day - which is probably want I am going to do to determine whether it

Re: [OpenIndiana-discuss] OI installation on Intel NUC...

2015-01-14 Thread jason matthews
I had a similar problem on intel sr2625urlx systems and ended up just doing the text install. i didnt revisit the issue to see if i could later install the gui and patch it up. good luck. j. On 1/14/15 1:08 PM, J Marc Edwards wrote: I have created my USB boot drive for OI and have

Re: [OpenIndiana-discuss] destroy all but specific snapshot

2014-09-30 Thread Jason Matthews
Yah, the paranoid part of my reptilian brain tells me not to issue a destroy command on a resource I want to keep. That said, it should be fine. Sent from my iPhone On Sep 30, 2014, at 6:53 PM, Harry Putnam rea...@newsguy.com wrote: Tim Aslat t...@spyderweb.com.au writes: Simplest

Re: [OpenIndiana-discuss] Bash bug issue

2014-09-29 Thread Jason Matthews
paraphrasing Joshua from WarGames, bash is a strange game where the only winning move is not to play. J. Sent from my iPhone On Sep 29, 2014, at 2:43 AM, Udo Grabowski (IMK) udo.grabow...@kit.edu wrote: As predicted, there's more bash horror (Score 11):

Re: [OpenIndiana-discuss] What Do I Have To Install To Get A GUI ?

2014-07-16 Thread jason matthews
On Jul 15, 2014, at 8:58 PM, Alan Coopersmith alan.coopersm...@oracle.com wrote: Things work much better if you use the GUI installer to install systems on which you want to run a GUI. This probably stems from some bugs in the GUI installer. I have systems where OI151a1 and possibly a7

Re: [OpenIndiana-discuss] a question of oi OS on ssd

2014-07-08 Thread Jason Matthews
No problems. Sent from my iPhone On Jul 8, 2014, at 6:59 AM, Harry Putnam rea...@newsguy.com wrote: Just checking if I will be able to install oi 151_9 on a pair of SSD mirrored? I know the routine to establish a mirrored rpool.. just checking that there aren't some major problems if

Re: [OpenIndiana-discuss] Static IP problem

2014-07-07 Thread jason matthews
On Jul 7, 2014, at 1:13 PM, James Carlson carls...@workingcode.com wrote: I don't know if things have changed in the 5 years or so since I actively worked on that code, but at least back then it wasn't possible to do a restart on the network/physical:default service. It was just a no-op.

[OpenIndiana-discuss] crossbow, sniffing, vlans

2014-07-07 Thread jason matthews
i am rather found of solving problems with tcpdump but i have discovered that crossbow VLANs break ether sniffering. i normally make a VNIC and assign to a VLAN such as: dladm create-vnic -l aggr0 -v 300 net0 this totally breaks iftop and tcpdump - however, snoop works. should i be creating

[OpenIndiana-discuss] smart command transport

2014-06-11 Thread jason matthews
i want to set a value of 0x4000 in word 106 of an intel dc s3700. what is the best way to go about doing this? smartmontools, as best i can tell, is basically a wrapper around SCT commands. it doesn’t seem to offer the ability to set values at the word level. am i missing something? is

Re: [OpenIndiana-discuss] smart command transport

2014-06-11 Thread jason matthews
On Jun 11, 2014, at 3:48 PM, Eric D. Mudama edmud...@bounceswoosh.org wrote: It should still work just fine with 512B IO since the logical sector size didn't change, however, this is the proper way to report that a file system *should* use 4k alignment if possible. Perhaps it should, but

Re: [OpenIndiana-discuss] Shopping for an all-in-one server

2014-06-02 Thread jason matthews
On Jun 2, 2014, at 12:38 AM, Jim Klimov jimkli...@cos.ru wrote: The box should be a reliable rackable server with remote management, substantial ECC RAM for efficient ZFS and VM needs (128-256gb likely, possibly more), CPUs with all those VT-* bits needed for illumos-kvm and a massive

Re: [OpenIndiana-discuss] fuiture small expansion of raidz1 possible?

2014-02-11 Thread jason matthews
On Feb 11, 2014, at 1:12 AM, Hans J. Albertsson hans.j.alberts...@branneriet.se wrote: Suppose I set up a raidz1 of N disks now, and fill it up, and suddenly I realize I'm going to need more space, but not enough to warrant setting up a new raidz1 of another N or more disks, it's just a

Re: [OpenIndiana-discuss] iostat - sum of the parts

2014-02-11 Thread jason matthews
the delta come from? j. On Feb 10, 2014, at 6:36 PM, Joshua M. Clulow j...@sysmgr.org wrote: On 10 February 2014 18:02, jason matthews ja...@broken.net wrote: my question is why do the numbers for the zpool not resemble the sum of the parts? for example busy reports 56% for the pool but no device

[OpenIndiana-discuss] iostat - sum of the parts

2014-02-10 Thread jason matthews
I have asked this question before but I am going to try to rephrase it. when i look at the output from iostat -nMxCz 1 i see something that looks like following on my shinny new servers running 151a9. I was previously rev-locked on 151a1. my question is why do the numbers for the zpool not

Re: [OpenIndiana-discuss] 151a8 boot problems

2014-02-03 Thread jason matthews
why dvd and not usb? thanks, j. On Feb 3, 2014, at 12:55 PM, Stefan Müller-Wilken stefan.mueller-wil...@acando.de wrote: Hi Predrag, you mean simply use installgrub from the DVD? Or copy the files 'stage1' and 'stage2' to my HD's /boot/grub? Cheers Stefan

Re: [OpenIndiana-discuss] No login prompt when updating 151a8 - 151a9

2014-01-23 Thread Jason Matthews
could it be some byzantine disk failure keeping your zpools from importing? try deleting /etc/zfs/zfs.cache in single user and rebooting. if that boots u likely have a storage problem Sent from Jasons' hand held On Jan 22, 2014, at 11:57 PM, Stefan Müller-Wilken

Re: [OpenIndiana-discuss] [zfs] mask pci-e errors

2014-01-14 Thread jason matthews
On Jan 14, 2014, at 4:12 AM, Rich rerc...@pha.jhu.edu wrote: What's the power draw on the X1 + 910 + HBAs? I wonder if you're trying to suck more power from the PCIe slots than is being provided, at peak, leading to...exciting results. that is an interesting idea but i think i am okay

Re: [OpenIndiana-discuss] [zfs] mask pci-e errors

2014-01-14 Thread jason matthews
On Jan 14, 2014, at 4:27 PM, Garrett D'Amore garr...@damore.org wrote: Thanks for the response. I'm surprised to see *both* the X1 and the 910, in particular. I imagine the X1 is your SLOG, in which case you are probably using the 910 for L2ARC? If so, why not just have that on normal

[OpenIndiana-discuss] mask pci-e errors

2014-01-13 Thread jason matthews
I have 40 identically configured systems that catch the pci-e error below. It seems that about every six months plus or minus, they go through a cycle where they generate this error usually all forty within about three weeks and they are good for months. Bad juju. The systems are Intel

Re: [OpenIndiana-discuss] [zfs] mask pci-e errors

2014-01-13 Thread jason matthews
On Jan 13, 2014, at 5:50 PM, Richard Elling richard.ell...@gmail.com wrote: That server has a number of options for active and passive PCIe risers and not all slots are created equal. Depending on the riser, you might have to change slot configurations to clear. It is possible to look at

Re: [OpenIndiana-discuss] Offtopic question to old SPARC users

2013-11-22 Thread jason matthews
i seem to recall that there are solaris 8 branded zones. if memory serves from one of the opensolaris conferences you can just untar your current setup in zone and boot it. pick up a niagra or something from ebay -- less power more juice low cost. j. On Nov 22, 2013, at 7:40 PM, Reginald

Re: [OpenIndiana-discuss] 10GigE vs Infiniband vs SCSI Target ...

2013-11-20 Thread jason matthews
On Nov 18, 2013, at 4:35 AM, Edward Ned Harvey (openindiana) openindi...@nedharvey.com wrote: I also recently discovered Linux has something called SCST, a driver of sorts, that turns some linux HBA into a scsi target. Does openindiana have something similar? i think the way the question

Re: [OpenIndiana-discuss] CIFS approach to valid users etc.

2013-11-20 Thread jason matthews
On Nov 20, 2013, at 7:48 AM, Predrag Zecevic [Unix Systems Administrator] predrag.zece...@2e-systems.com wrote: * How can I set access control on a user basis, e.g. set a share read only for a group, read write for another etc. idmap user mapping (first you need to define unix groups). -

Re: [OpenIndiana-discuss] OI151a8 free space reporting

2013-11-13 Thread jason matthews
zfs list is reporting the number you are interested in. zpool list essentially reports raw data which isn't particularly useful for capacity planning. thanks, j. On Nov 13, 2013, at 4:02 PM, w...@vandenberge.us wrote: Hi, I just rolled my first a8 server into testing. This is a server

Re: [OpenIndiana-discuss] removing a disk after a replace

2013-11-06 Thread jason matthews
zpool remove nas c8t50014EE6561DDB4Cd0p0 did that not work? j. On Nov 6, 2013, at 2:39 PM, Clement BRIZARD clem...@brizou.fr wrote: Hello, I have a little problem after I replaced a disk from my pool, the resilvered was ok (somme errrors on 2 files but not important ones so that's

[OpenIndiana-discuss] lsi 3008

2013-11-04 Thread jason matthews
does anyone know if the new lsi 3008 chip (9600-8i) has a chance of being compatible with the mpt_sas driver? i am interested in giving this card a whirl as i suspect it can keep up better with SSDs as primary storage than the 9207-8i. i guess i will be the guinea pig if no one has an idea….

  1   2   3   >