Re: [PATCH RESEND v2 2/2] blk-mq: Avoid memory reclaim when remapping queues

2016-12-14 Thread Jens Axboe
simplest fix for this is to make allocations in this path > non-reclaimable, with GFP_NOIO. With this patch, We couldn't hit the > issue anymore. This looks fine. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message

Re: [PATCH RESEND v2 1/2] blk-mq: Fix failed allocation path when mapping queues

2016-12-14 Thread Jens Axboe
); > hctx->tags = set->tags[i]; > - WARN_ON(!hctx->tags); > + BUG_ON(!hctx->tags); No BUG_ON(), please, it's not necessary to take down the machine if this fails. It might be game over for that machine, if the driver is hosting the data or root

Re: [PATCH 00/12] block: cleanup direct access to bvec table

2016-11-22 Thread Jens Axboe
ose. I've added the series, except 6-8, the dm parts. I updated some of the descriptions/subjects to read a little better. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo

Re: [PATCH 1/2] nvme: untangle 0 and BLK_MQ_RQ_QUEUE_OK

2016-11-15 Thread Jens Axboe
On 11/15/2016 12:11 PM, Omar Sandoval wrote: From: Omar Sandoval <osan...@fb.com> Let's not depend on any of the BLK_MQ_RQ_QUEUE_* constants having specific values. No functional change. Thanks Omar, applied both for 4.10. -- Jens Axboe -- To unsubscribe from this list: send th

Re: [PATCH] blk-mq drivers: untangle 0 and BLK_MQ_RQ_QUEUE_OK

2016-11-14 Thread Jens Axboe
ree to apply or not if it's too intrusive. I think we should clean it up. But you should split this patch in two - one for NVMe, and one for SCSI. And it should be against for-4.10/block, the nvme parts don't apply without fuzz. -- Jens Axboe -- To unsubscribe from this list: send the line

Re: [PATCH] sd_zbc: Force use of READ16/WRITE16

2016-11-14 Thread Jens Axboe
E16 commands anyway, make sure that use_16_for_rw is set. Added to the 4.10 branch, thanks. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] hpsa: scsi-mq support

2016-11-12 Thread Jens Axboe
ole point of multiple submission queues. Trying to make up some imaginary 1:1 mapping between submission and completion queues is nonsensical, when it doesn't exist. We still should benefit from scsi-mq, though. Sure, but with 1 submission queue. -- Jens Axboe -- To unsubscribe from this list: s

Re: Reduced latency is killing performance

2016-11-10 Thread Jens Axboe
of these sections is a single job. For some reason we are not merging as well as we should, that's the reason for the performance loss. In fact, we're not merging at all. That's not IO scheduling. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" i

Re: Reduced latency is killing performance

2016-11-10 Thread Jens Axboe
November 3 at 10 AM such that you can publish these? I don't think it's related to this thread, but yes, that would be great. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo inf

Re: [PATCH] megaraid_sas: fix macro MEGASAS_IS_LOGICAL to avoid regression caused by commit 1e793f6fc0db920400574211c48f9157a37e3945

2016-11-09 Thread Jens Axboe
was exposing lot of non-existing SCSI devices(all SCSI commands to channels-1,2,3 was returned as SUCCESS-DID_OK by driver). Fixes: 1e793f6fc0db920400574211c48f9157a37e3945 Reported-by: Jens Axboe <ax...@kernel.dk> CC: sta...@vger.kernel.org Signed-off-by: Kashyap Desai <kashyap.de...@bro

Re: [REGRESSION] 4.9-rc4+ doesn't boot on my test box

2016-11-08 Thread Jens Axboe
On 11/08/2016 05:20 PM, Kashyap Desai wrote: -Original Message- From: Martin K. Petersen [mailto:martin.peter...@oracle.com] Sent: Wednesday, November 09, 2016 4:45 AM To: Jens Axboe Cc: linux-scsi; Kashyap Desai; Martin K. Petersen Subject: Re: [REGRESSION] 4.9-rc4+ doesn't boot on my

[REGRESSION] 4.9-rc4+ doesn't boot on my test box

2016-11-08 Thread Jens Axboe
vision: 3.20 [ 10.515186] sr 5:0:0:0: Attached scsi generic sg1 type 5 -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v5 0/14] Fix race conditions related to stopping block layer queues

2016-11-02 Thread Jens Axboe
the block tree, but they can go through the SCSI tree as well. Let me know what folks think. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH 1/3] blk-mq: export blk_mq_map_queues

2016-11-01 Thread Jens Axboe
PCIe MSIx vectors > Christoph> or use the default. > > Jens, any objection to me funneling this change through the SCSI tree? No, that's fine, you can add my reviewed-by. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body

Re: Device or HBA level QD throttling creates randomness in sequetial workload

2016-10-31 Thread Jens Axboe
est * immediately, even if we have more pending. */ -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v4 0/12] Fix race conditions related to stopping block layer queues

2016-10-26 Thread Jens Axboe
the Red Hat SRP and NVMe test suites. This looks pretty good, I'll run some testing on it tomorrow and do a full review, hopefully we can get it applied sooner rather than later for the next series. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux

Re: [PATCH v6 1/3] block: Add iocontext priority to request

2016-10-19 Thread Jens Axboe
it, I can route this through libata/for-4.10, or this can be applied to block and libata tree can pull from it. I'm fine with that, add my Reviewed-by and funnel it through the libata tree. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the b

Re: [PATCH v8 0/7] ZBC / Zoned block device support

2016-10-18 Thread Jens Axboe
On 10/18/2016 07:53 PM, Martin K. Petersen wrote: "Jens" == Jens Axboe <ax...@kernel.dk> writes: Jens> I already queued up the other bits, if it's fine with you I'll add Jens> 6/7 as well. Sure. Feel free to add by Acked-by:. Thanks, added and committed the sd bit. I'

Re: [PATCH v8 0/7] ZBC / Zoned block device support

2016-10-18 Thread Jens Axboe
On 10/18/2016 06:46 PM, Martin K. Petersen wrote: "Jens" == Jens Axboe <ax...@kernel.dk> writes: Jens> This is starting to look mergeable to me. Yup. Jens> Any objections in getting this applied for 4.10? Looks like 6/7 Jens> should go through the SCSI tree, but I ca

Re: [PATCH v8 0/7] ZBC / Zoned block device support

2016-10-18 Thread Jens Axboe
Looks like 6/7 should go through the SCSI tree, but I can queue up the rest. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v4 1/4] block: Add iocontext priority to request

2016-10-13 Thread Jens Axboe
On 10/13/2016 02:59 PM, Dan Williams wrote: On Thu, Oct 13, 2016 at 1:24 PM, Jens Axboe <ax...@kernel.dk> wrote: On 10/13/2016 02:19 PM, Dan Williams wrote: On Thu, Oct 13, 2016 at 1:09 PM, Jens Axboe <ax...@kernel.dk> wrote: On 10/13/2016 02:06 PM, Dan Williams wrote: On

Re: [PATCH v4 1/4] block: Add iocontext priority to request

2016-10-13 Thread Jens Axboe
On 10/13/2016 02:19 PM, Dan Williams wrote: On Thu, Oct 13, 2016 at 1:09 PM, Jens Axboe <ax...@kernel.dk> wrote: On 10/13/2016 02:06 PM, Dan Williams wrote: On Thu, Oct 13, 2016 at 12:53 PM, Adam Manzanares <adam.manzana...@hgst.com> wrote: Patch adds an association between ioco

Re: [PATCH v4 1/4] block: Add iocontext priority to request

2016-10-13 Thread Jens Axboe
to rewrite the commit message though. A good commit message should explain WHY the change is made, not detail the code implementation of it. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More m

Re: Should queue_max_hw_sectors() always be <= max_dev_sectors?

2016-08-30 Thread Jens Axboe
posing this weird world view on others. We export max_segments and max_segments_size, which are basically a window into what the DMA engine can do. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More maj

Re: Should queue_max_hw_sectors() always be <= max_dev_sectors?

2016-08-30 Thread Jens Axboe
_sectors (including sysfs) really want is the lesser of limits.max_hw_sectors and limits.max_dev_sectors. It should be the maximum supported to the device, which is the minimum of any limitations in that path. So I'd say your change is correct. -- Jens Axboe -- To unsubscribe from this

Re: Oops when completing request on the wrong queue

2016-08-29 Thread Jens Axboe
On 08/29/2016 12:06 PM, Gabriel Krisman Bertazi wrote: Jens Axboe <ax...@kernel.dk> writes: Can you try this patch? It's not perfect, but I'll be interested if it makes a difference for you. Hi Jens, Sorry for the delay. I just got back to this and have been running your patch

Re: Oops when completing request on the wrong queue

2016-08-24 Thread Jens Axboe
On 08/24/2016 12:34 PM, Jens Axboe wrote: On 08/23/2016 03:14 PM, Jens Axboe wrote: On 08/23/2016 03:11 PM, Jens Axboe wrote: On 08/23/2016 02:54 PM, Gabriel Krisman Bertazi wrote: Gabriel Krisman Bertazi <kris...@linux.vnet.ibm.com> writes: Can you share what you ran to online/offlin

Re: Oops when completing request on the wrong queue

2016-08-24 Thread Jens Axboe
On 08/23/2016 03:14 PM, Jens Axboe wrote: On 08/23/2016 03:11 PM, Jens Axboe wrote: On 08/23/2016 02:54 PM, Gabriel Krisman Bertazi wrote: Gabriel Krisman Bertazi <kris...@linux.vnet.ibm.com> writes: Can you share what you ran to online/offline CPUs? I can't reproduce this her

Re: Oops when completing request on the wrong queue

2016-08-23 Thread Jens Axboe
On 08/23/2016 03:11 PM, Jens Axboe wrote: On 08/23/2016 02:54 PM, Gabriel Krisman Bertazi wrote: Gabriel Krisman Bertazi <kris...@linux.vnet.ibm.com> writes: Can you share what you ran to online/offline CPUs? I can't reproduce this here. I was using the ppc64_cpu tool, which should

Re: Oops when completing request on the wrong queue

2016-08-23 Thread Jens Axboe
loaded. My bash script is different than yours, I'll try that and see if it helps here. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Oops when completing request on the wrong queue

2016-08-19 Thread Jens Axboe
On 08/19/2016 08:13 AM, Jens Axboe wrote: On 08/19/2016 07:28 AM, Gabriel Krisman Bertazi wrote: Gabriel Krisman Bertazi <kris...@linux.vnet.ibm.com> writes: We, IBM, have been experiencing eventual Oops when stressing IO at the same time we add/remove processors. The Oops happens in t

Re: Oops when completing request on the wrong queue

2016-08-19 Thread Jens Axboe
looks like a blk-mq core bug. Do you have a trace of a BUG() triggering in nvme_queue_rq(), when req->tag != nvmeq->tags? I don't immediately see how this could happen, the freezing should protect us from this, unless it's broken somehow. I'll take a look at this. -- Jens Axboe -- To un

Re: [PATCH 4/6] block: Add 'zoned' sysfs queue attribute

2016-07-25 Thread Jens Axboe
rovide a real interface, through a library. Don't expose tons of zones through sysfs, and expect applications to parse that. That's silly. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More

Re: [PATCH 4/6] block: Add 'zoned' sysfs queue attribute

2016-07-25 Thread Jens Axboe
sysfs. I remember from your presentations that reading the zone information is slow. Is 10K zones a typical value or a worst case value? Just kill the sysfs file, it's useless for many zones. Either have the application use some library to provide the information, or use bsg and similar to g

Re: block: don't check request size in blk_cloned_rq_check_limits()

2016-06-15 Thread Jens Axboe
for you and that it just happens to work without. That's not how you fix problems. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [Lsf] [LSF/MM TOPIC] block-mq issues with FC

2016-04-12 Thread Jens Axboe
for improvement in the cpu mapping code. However, on the original complaint, it's by design (or, working as intended) - this was done to keep the layout symmetrical. It's been discussed on the mailing lists before. We can have a discussion whether we should change this or not, of course. -- Jens Axboe

Re: [PATCH] mpt3sas: Don't overreach ioc->reply_post[] during initialization

2016-03-22 Thread Jens Axboe
a Fix this by pulling the value at the beginning of the loop. Signed-off-by: Calvin Owens <calvinow...@fb.com> Looks good to me. Reviewed-by: Jens Axboe <ax...@fb.com> -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message

Re: [PATCH 0/7] Runtime PM support for AHCI host controller driver

2016-02-19 Thread Jens Axboe
On 02/18/2016 09:40 AM, Tejun Heo wrote: Hello, Patchset looks good to me. Once Jens acks the first patch, I'll apply the whole series to libata/for-4.6 w/ the field initialization updated. You can add my acked-by to that one, looks good to me. -- Jens Axboe -- To unsubscribe from

Re: [PATCH] bio: return EINTR if copying to user space got interrupted

2016-02-12 Thread Jens Axboe
ned. This can be reproduced by issuing SG_IO ioctl()s in one thread while constantly sending signals to it. Good catch, fix looks good to me. Applied for 4.5. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a mess

Re: complete boot failure in 4.5-rc1 caused by nvme: make SG_IO support optional

2016-02-09 Thread Jens Axboe
On Feb 9, 2016, at 5:50 AM, Christoph Hellwig <h...@lst.de> wrote: > > Jens, > > do you want a 'default y' patch or just a better description? I'd be > happy to send either one. A better description -- Jens Axboe -- To unsubscribe from this list: send the line &q

Re: complete boot failure in 4.5-rc1 caused by nvme: make SG_IO support optional

2016-02-09 Thread Jens Axboe
mount-by-id on those distros. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: complete boot failure in 4.5-rc1 caused by nvme: make SG_IO support optional

2016-02-09 Thread Jens Axboe
rrent series. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: complete boot failure in 4.5-rc1 caused by nvme: make SG_IO support optional

2016-02-08 Thread Jens Axboe
, if the only known case is suse. If anything, let's make the description better. It's trying to be funny, it'd be better if it was descriptive and covered this case as well. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message

Re: [PATCH RESEND] csiostor:Fix locking issues in the function csio_scsim_cleanup_io_lnode

2015-12-29 Thread Jens Axboe
stead. Nick, I've said this before and I'll say this again. Stop sending me patches. They are all untested and broken, you are wasting peoples time. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.ke

Re: kernel BUG at drivers/scsi/scsi_lib.c:1096!

2015-12-04 Thread Jens Axboe
fore that, so I hit this twice today. Update to the tree as-of yesterday (or today) and it should work. 25364a9e54fb8296 doesn't include the latest block fixes that were sent in yesterday, that should fix it. You need commit a88d32af18b8 or newer. -- Jens Axboe -- To unsubscribe from thi

Re: [PATCH 2/2] SCSI: Fix NULL pointer dereference in runtime PM

2015-12-03 Thread Jens Axboe
id=101371 More discussion can be found from below link. http://marc.info/?l=linux-scsi=144163730531875=2 Added for 4.4, thanks. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majo

Re: QUEUE_FLAG_NO_SG_MERGE and non-block-mq

2015-11-27 Thread Jens Axboe
K iops is on the slow side, though. It's pointless to iterate the sg list if we don't have to. I can try and run a few tests next week. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordo

Re: kernel BUG at drivers/scsi/scsi_lib.c:1096!

2015-11-25 Thread Jens Axboe
lready, so how is the above making it any different? In general, NOMERGE being set or not should not make a difference. It's only a hint that we need not check further if we should be merging on this request, since we already tried it once, found we'd exceed various limits, then set NOMERGE

Re: kernel BUG at drivers/scsi/scsi_lib.c:1096!

2015-11-25 Thread Jens Axboe
On 11/25/2015 12:10 PM, Hannes Reinecke wrote: On 11/25/2015 06:56 PM, Jens Axboe wrote: On 11/25/2015 02:04 AM, Hannes Reinecke wrote: On 11/20/2015 04:28 PM, Ewan Milne wrote: On Fri, 2015-11-20 at 15:55 +0100, Hannes Reinecke wrote: Can't we have a joint effort here? I've been spending

Re: [PATCH 1/3] badblocks: Add core badblock management code

2015-11-24 Thread Jens Axboe
to manipulate the data. The only changes in this copy of the code are ones to generalize function/variable names from md-specific ones. Also add init and free functions. Split this into a .c file with the code. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux

Re: [PATCH, RFC] blk-mq: use a delayed work item for timeouts

2015-10-12 Thread Jens Axboe
On 10/12/2015 02:22 PM, Christoph Hellwig wrote: On Mon, Oct 12, 2015 at 02:08:04PM -0600, Jens Axboe wrote: No that's definitely fine with me, imho most error handling callbacks should be in process context for ease of use in the driver. Took a closer look. The patch looks incomplete

Re: [PATCH, RFC] blk-mq: use a delayed work item for timeouts

2015-10-12 Thread Jens Axboe
most error handling callbacks should be in process context for ease of use in the driver. -- Jens Axboe -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org

Re: [PATCH, RFC] blk-mq: use a delayed work item for timeouts

2015-10-12 Thread Jens Axboe
On 10/12/2015 01:34 PM, Jens Axboe wrote: On 10/12/2015 01:29 PM, Christoph Hellwig wrote: For some pending NVMe work I'd really love to be able to get my timeouts from process context. So far it seems only SCSI and NVMe use the blk-mq timeout handler, and both don't seem to be particularly

Re: Persistent Reservation API V2

2015-08-18 Thread Jens Axboe
On 08/17/2015 01:13 PM, Christoph Hellwig wrote: Does this look fine to you Jens? I'd love to get this API into 4.3 so I can submit the NFS SCSI layout patches that depend on it for 4.4. I'll take a look at this today. -- Jens Axboe -- To unsubscribe from this list: send the line

Re: [PATCH] fix host max depth checking for the 'queue_depth' sysfs interface

2015-07-14 Thread Jens Axboe
in the host anyway. Fully agreed. I would vote for making the host template read-only and modify all drivers to use the shost setting. Indeed, that would be a much saner choice. The settings in a (effectively already) read-only host template seems like somewhat of a relic. -- Jens Axboe

[PATCH] fix host max depth checking for the 'queue_depth' sysfs interface

2015-07-13 Thread Jens Axboe
setting of queue depth, returning EINVAL for all settings but '1'. And once it's set to 1, there's no way to go back up. Cc: sta...@kernel.org Fixes: 1e6f2416044c0 scsi: don't allow setting of queue_depth bigger than can_queue Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/scsi_sysfs.c

Re: [PATCH 0/6] Fixes for memory corruption in mpt2sas

2015-07-02 Thread Jens Axboe
it seems to have eliminated them. Guys, can someone outside of FB please review this? We're hitting random memory corruptions without these fixes. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More

Re: [PATCH, RFC] scsi: use host wide tags by default

2015-04-17 Thread Jens Axboe
On 04/17/2015 03:57 PM, James Bottomley wrote: On Fri, 2015-04-17 at 15:47 -0600, Jens Axboe wrote: On 04/17/2015 03:46 PM, James Bottomley wrote: On Fri, 2015-04-17 at 15:44 -0600, Jens Axboe wrote: On 04/17/2015 03:42 PM, James Bottomley wrote: @@ -662,32 +662,14 @@ void

Re: [PATCH, RFC] scsi: use host wide tags by default

2015-04-17 Thread Jens Axboe
, and this ensures we get better coverage of over tagging setup over different configs. Ack! This is great, and makes my life easier... -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info

Re: [PATCH, RFC] scsi: use host wide tags by default

2015-04-17 Thread Jens Axboe
to be done as two byte stores on some architectures). It's not in a hot path (by any stretch), so doesn't really matter... -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http

Re: [PATCH, RFC] scsi: use host wide tags by default

2015-04-17 Thread Jens Axboe
On 04/17/2015 03:46 PM, James Bottomley wrote: On Fri, 2015-04-17 at 15:44 -0600, Jens Axboe wrote: On 04/17/2015 03:42 PM, James Bottomley wrote: @@ -662,32 +662,14 @@ void scsi_finish_command(struct scsi_cmnd *cmd) */ int scsi_change_queue_depth(struct scsi_device *sdev, int depth

Re: [PATCH, RFC] scsi: use host wide tags by default

2015-04-17 Thread Jens Axboe
On 04/17/2015 04:20 PM, James Bottomley wrote: On Fri, 2015-04-17 at 16:07 -0600, Jens Axboe wrote: On 04/17/2015 03:57 PM, James Bottomley wrote: On Fri, 2015-04-17 at 15:47 -0600, Jens Axboe wrote: On 04/17/2015 03:46 PM, James Bottomley wrote: On Fri, 2015-04-17 at 15:44 -0600, Jens Axboe

Re: [PATCH 6/7] mpt2sas: store scsi io tracker data in the scsi command / request

2015-04-07 Thread Jens Axboe
On 04/05/2015 10:03 AM, Christoph Hellwig wrote: On Fri, Apr 03, 2015 at 09:58:22AM -0600, Jens Axboe wrote: +struct scsiio_tracker * +mpt2sas_get_st_from_smid(struct MPT2SAS_ADAPTER *ioc, u16 smid) +{ + if (shost_use_blk_mq(ioc-shost)) { + struct scsi_cmnd *scmd

[PATCH 6/6] mpt3sas: store scsi io tracker data in the scsi request

2015-04-07 Thread Jens Axboe
IOPS, this effectively cuts the locking time in half. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt3sas/mpt3sas_base.c | 173 +-- drivers/scsi/mpt3sas/mpt3sas_base.h | 2 + drivers/scsi/mpt3sas/mpt3sas_scsih.c | 69 +++--- 3 files changed

[PATCH 5/6] mpt3sas: get rid of MPI2_FUNCTION_SCSI_TASK_MGMT

2015-04-07 Thread Jens Axboe
This involves a lot of nasty lookup of a specific running command, across the host. If anybody is using this code, it should be moved to proper error handling instead. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt3sas/mpt3sas_ctl.c | 130 +++-- 1

[PATCH 4/6] mpt2sas: store scsi io tracker data in the scsi request

2015-04-07 Thread Jens Axboe
IOPS, this effectively cuts the locking time in half. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt2sas/mpt2sas_base.c | 187 --- drivers/scsi/mpt2sas/mpt2sas_base.h | 3 + drivers/scsi/mpt2sas/mpt2sas_scsih.c | 87 3 files changed

[PATCH 1/6] scsi: add host template init/exit_command hooks

2015-04-07 Thread Jens Axboe
, we can't pass in a reliable request index, since we don't have one... Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/scsi.c | 9 + drivers/scsi/scsi_lib.c | 16 include/scsi/scsi_host.h | 6 +- 3 files changed, 30 insertions(+), 1 deletion(-) diff

[PATCH 3/6] mpt2sas: get rid of MPI2_FUNCTION_SCSI_TASK_MGMT

2015-04-07 Thread Jens Axboe
This involves a lot of nasty lookup of a specific running command, across the host. If anybody is using this code, it should be moved to proper error handling instead. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt2sas/mpt2sas_ctl.c | 126 +++-- 1

[PATCH 2/6] scsi: ensure that a request is valid when returning it from scsi_find_tag()

2015-04-07 Thread Jens Axboe
For the scsi-mq case, ensure that the request has been started before returning it from scsi_find_tag(). This is akin to the -special check for the non-mq case, it ensures that the request has been setup and issued. Signed-off-by: Jens Axboe ax...@fb.com --- include/scsi/scsi_tcq.h | 11

[PATCH RFC v2] mpt2/mpt3sas lock reduction for scsi-mq

2015-04-07 Thread Jens Axboe
Hi, This is v2 of the series. Generally addressed Christoph's review comments, but more specifically, changes since v1: - Kill the MPI2_FUNCTION_SCSI_TASK_MGMT support, which in turn enabled me to drop the SCSI/blk iter patches and the smid work-around for scsi-mq in mpt2/3 for bumping to

Re: [PATCH 6/7] mpt2sas: store scsi io tracker data in the scsi command / request

2015-04-07 Thread Jens Axboe
On 04/07/2015 10:18 AM, Christoph Hellwig wrote: On Tue, Apr 07, 2015 at 10:13:23AM -0600, Jens Axboe wrote: The mq case will also work for the !mq case when you call scsi_host_find_tag and scsi_cmd_priv. In general all the mq-specific codepathes you add should become the default and only one

[PATCH 2/7] blk-mq: add helper to iterate all busy tags on all hardware queues

2015-04-03 Thread Jens Axboe
The current iter helper function deals with a hardware queue. Some callers want to access all queues, like the internal blk-mq timeout handling does. So add a helper for that. Signed-off-by: Jens Axboe ax...@fb.com --- block/blk-mq.c | 35 +++ include

[PATCH 1/7] blk-mq: allow the callback to blk_mq_tag_busy_iter() to stop looping

2015-04-03 Thread Jens Axboe
of the search. Update current callers (blk-mq timeout and NVMe IO cancel). Signed-off-by: Jens Axboe ax...@fb.com --- block/blk-mq-tag.c| 6 -- block/blk-mq.c| 10 ++ drivers/block/nvme-core.c | 7 --- include/linux/blk-mq.h| 2 +- 4 files changed, 15

[PATCH 6/7] mpt2sas: store scsi io tracker data in the scsi command / request

2015-04-03 Thread Jens Axboe
IOPS, this effectively cuts the locking time in half. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt2sas/mpt2sas_base.c | 194 +-- drivers/scsi/mpt2sas/mpt2sas_base.h | 3 + drivers/scsi/mpt2sas/mpt2sas_ctl.c | 119 - drivers

[PATCH 7/7] mpt3sas: store scsi io tracker data in the scsi command / request

2015-04-03 Thread Jens Axboe
IOPS, this effectively cuts the locking time in half. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/mpt3sas/mpt3sas_base.c | 180 +-- drivers/scsi/mpt3sas/mpt3sas_base.h | 2 + drivers/scsi/mpt3sas/mpt3sas_ctl.c | 119 ++- drivers

[PATCH RFC] mpt2/mpt3sas lock reduction for scsi-mq

2015-04-03 Thread Jens Axboe
have to store and manage this tracker structure separately. In some testing on mpt2sas, this roughly cuts the locking time in half at just 100K IOPS. Compared to scsi-mq not being enabled, the locking time with the patchset is reduced from ~47% to just ~4%. -- Jens Axboe -- To unsubscribe from

[PATCH 5/7] scsi: add host template init/exit_command hooks

2015-04-03 Thread Jens Axboe
If a LLD has hardware commands in the request pdu, then we need some helper hooks to help the driver initialize state at load time, and potentially to tear down state at rmmod time. Add a host template -init_command() and -exit_command() hook to help with that. Signed-off-by: Jens Axboe ax

[PATCH 3/7] scsi: add scsi-mq helpers to retrieve pdu and check started state

2015-04-03 Thread Jens Axboe
scsi_mq_scmd_to_pdu() returns the LLD pdu associated with a struct scsi_cmnd. scsi_mq_scmd_start() returns whether or not a given scsi command has been started or not. Signed-off-by: Jens Axboe ax...@fb.com --- include/scsi/scsi_cmnd.h | 11 +++ 1 file changed, 11 insertions(+) diff

[PATCH 4/7] scsi: add scsi-mq helper for iterating over busy commands

2015-04-03 Thread Jens Axboe
This is basically just a wrapper around blk_mq_queue_busy_iter(), so that LLDs don't have to deal with or worry about blk-mq hardware queues. Signed-off-by: Jens Axboe ax...@fb.com --- drivers/scsi/scsi_lib.c| 25 + include/scsi/scsi_device.h | 3 +++ 2 files changed

Re: [PATCH 0/7] dm: add full blk-mq support to request-based DM

2015-03-13 Thread Jens Axboe
and expose in per-device ro sysfs attr Applied patch 1 to current tree, marked for stable. 2-4 are applied for 4.1, in for-4.1/core. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info

Re: [PATCH] blk-mq: fix double-free in error path

2015-02-11 Thread Jens Axboe
blk_mq_bitmap bt-bs = kzalloc(BT_WAIT_QUEUES * sizeof(*bt-bs), GFP_KERNEL); if (!bt-bs) { kfree(bt-map); + bt-map = NULL; return -ENOMEM; } Thanks Tony, applied. -- Jens Axboe -- To unsubscribe from this list: send the line

Re: Another (ESP?) scsi blk-mq problem on sparc64

2015-01-29 Thread Jens Axboe
of it... Does the attached work? -- Jens Axboe diff --git a/block/blk-mq-cpumap.c b/block/blk-mq-cpumap.c index 5f13f4d0bcce..527d315dc1a5 100644 --- a/block/blk-mq-cpumap.c +++ b/block/blk-mq-cpumap.c @@ -88,10 +88,11 @@ int blk_mq_update_queue_map(unsigned int *map, unsigned int nr_queues

Re: [PATCH] block: Add discard flag to blkdev_issue_zeroout() function

2015-01-21 Thread Jens Axboe
, thanks. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] scsi: -queue_rq can't sleep

2015-01-09 Thread Jens Axboe
On 01/09/2015 04:51 AM, Christoph Hellwig wrote: Any chance to get a review / ack for this one? You can my reviewed-by, looks fine to me. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo

Re: scsi: non atomic allocation in mempool_alloc in atomic context

2015-01-05 Thread Jens Axboe
the run to a specific workqueue, we'll disable preempt in the current path before -queue_rq() is called. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo

Re: scsi: non atomic allocation in mempool_alloc in atomic context

2015-01-05 Thread Jens Axboe
On 01/05/2015 12:32 PM, Christoph Hellwig wrote: On Mon, Jan 05, 2015 at 12:00:58PM -0700, Jens Axboe wrote: That's not quite true, the only guarantee is that it WILL execute on the CPU (or CPUs) that are set in the mask. So unless it ends up offloading the run to a specific workqueue, we'll

Re: [PATCH 0/4] Fix performance burning or extracting audio etc. from multiple optical drives.

2014-11-25 Thread Jens Axboe
. Please resend (dropping paride), and add proper subject and commit message. Patches 2-4 have identical subjects, and no commit message... -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info

Re: [PATCH 0/4] Fix performance burning or extracting audio etc. from multiple optical drives.

2014-11-25 Thread Jens Axboe
On 11/25/2014 09:32 AM, Christoph Hellwig wrote: On Tue, Nov 25, 2014 at 09:30:19AM -0700, Jens Axboe wrote: On 11/25/2014 09:26 AM, Christoph Hellwig wrote: This looks reasonable to me. Jens, do you want to takes this through the block tree? Acked-by: Christoph Hellwig h...@lst.de Yeah I

Re: [PATCH] blk-mq: handle the single queue case in blk_mq_hctx_next_cpu

2014-11-24 Thread Jens Axboe
On 11/24/2014 01:27 AM, Christoph Hellwig wrote: Don't duplicate the code to handle the not cpu bounce case in the caller, do it inside blk_mq_hctx_next_cpu instead. Thanks, applied. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-24 Thread Jens Axboe
. And perhaps we can't just modify num_possible_cpus(), we'd need num_*_cpus() for the other bitmaps, too. That might be breaking other things... Meelis, can you try the attached? -- Jens Axboe diff --git a/block/blk-mq-cpumap.c b/block/blk-mq-cpumap.c index 1065d7c65fa1..15da9cc08f64 100644

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-24 Thread Jens Axboe
On 11/24/2014 09:22 AM, Paul E. McKenney wrote: On Mon, Nov 24, 2014 at 08:35:46AM -0700, Jens Axboe wrote: On 11/24/2014 01:21 AM, Christoph Hellwig wrote: On Fri, Nov 21, 2014 at 02:56:00PM -0500, David Miller wrote: I would suggest looking into the possibility that we allocate the memory

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-24 Thread Jens Axboe
On 11/24/2014 10:31 AM, Paul E. McKenney wrote: On Mon, Nov 24, 2014 at 10:16:15AM -0700, Jens Axboe wrote: On 11/24/2014 09:22 AM, Paul E. McKenney wrote: On Mon, Nov 24, 2014 at 08:35:46AM -0700, Jens Axboe wrote: On 11/24/2014 01:21 AM, Christoph Hellwig wrote: On Fri, Nov 21, 2014 at 02

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-24 Thread Jens Axboe
On 11/24/2014 02:56 PM, David Miller wrote: From: Jens Axboe ax...@kernel.dk Date: Mon, 24 Nov 2014 10:16:15 -0700 How about this one? The num in num_possible_cpus() means a count, as in how many are there. It doesn't mean largest ID of members of set X, which is what you are asking

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-24 Thread Jens Axboe
On 11/24/2014 03:09 PM, David Miller wrote: From: Jens Axboe ax...@kernel.dk Date: Mon, 24 Nov 2014 15:01:55 -0700 I'll just updated blk-mq to use nr_cpu_ids and be done with it. Wow, a grep on nr_cpu_ids gets a lot of hits on people allocating just these kinds of tables :) Yep! It'd

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-15 Thread Jens Axboe
verify that the map that is being used above has indeed been setup. Unless Christoph has any ideas on what is going on here? -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-14 Thread Jens Axboe
probably be better to shove this debug stuff into the map building code instead, ala attached. -- Jens Axboe diff --git a/block/blk-mq-cpumap.c b/block/blk-mq-cpumap.c index 1065d7c65fa1..9200e2aee746 100644 --- a/block/blk-mq-cpumap.c +++ b/block/blk-mq-cpumap.c @@ -81,6 +81,9 @@ int

Re: Another (ESP?) scsi blk-mq problem on sparc64

2014-11-14 Thread Jens Axboe
this looks like this might be the issue. On a scsi-mq disabled boot, you have 4 CPUs, but how are they numbered? We might need Christophs debug patch on top this to fully know... -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord

Re: tag handling refactor V2

2014-11-10 Thread Jens Axboe
, nice cleanup and the diffstat is excellent :-) -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] scsi: Fix more error handling in SCSI_IOCTL_SEND_COMMAND

2014-11-10 Thread Jens Axboe
, good catch. Might be an idea to have blk_put_request() do warn-and-return check on error pointers being passed in, just in case. -- Jens Axboe -- To unsubscribe from this list: send the line unsubscribe linux-scsi in the body of a message to majord...@vger.kernel.org More majordomo info at http

Re: absurdly high optimal_io_size on Seagate SAS disk

2014-11-06 Thread Jens Axboe
is the largest Chris conceivable reasonable value). The problem is that finding that is not easy and it too will be a moving target. Didn't check, but assuming the value is the upper 24 bits of 32. If so, might not hurt to check for as 0xfe00 as an invalid value. -- Jens Axboe -- To unsubscribe from

<    1   2   3   4   5   6   7   >