On Thu, Apr 30, 2020 at 6:40 PM Fotis Xenakis <[email protected]> wrote:

> Stock QEMU still does not have DAX support so I used one from
>> https://gitlab.com/virtio-fs/qemu/-/commits/virtio-dev (shall I be using
>> this?) to test the DAX logic.
>>
> The branch you mention is under active development and will *not* work
> with my current patches. Those are based upon the more stable virtio-fs
> <https://gitlab.com/virtio-fs/qemu/-/tree/virtio-fs> branch.
>
> BTW is there a way to make virtiofsd daemon not to terminate every time
>> after single OSv run?
>>
> I am not aware of a way to make make virtiofsd not terminate every time,
> it would sure be nice not having to restart it all the time though...
>
> As  I understand this is a temporary solution until we integrate DAX logic
>> with page cache, right? Eventually, pages mapped with FUSE_SETUPMAPPING
>> should stay in page cache until a file gets unmapped? Right now we copy
>> data from DAX window but eventually, we would like not to which is the
>> whole point of DAX, right?
>>
> That would be ideal, but I can't see how we could avoid the copy to the
> user buffers, while retaining proper read() semantics(?). We might be able
> to do it in the case of mmap() though (my only concern is that the DAX
> window is device memory, but that doesn't seem to be a problem.
>
Yes we cannot avoid it in virtiofs_read() which btw may not make sense to
use DAX in long term over regular FUSE_READ.
For mmap() I agree. I could be as simple (probably not as simple) as what
we do in ROFS (see rofs_map_cached_page()).

>
> Not right now but going forward as we design integration with page cache
>> we should think of a way to have a simple read-ahead cache in virtio fs
>> just like ROFS has so we can optimize reading even if there is no DAX
>> enabled. In other words, eventually, page cache should either point to
>> pages from DAX window (if DAX on) or to pages in a local cache where we
>> would keep data read using regular FUSE_READ. Ideally we should refactor
>> the read-ahead/around cache in ROFS to make it more generic and usable with
>> virtiofs.
>>
>> But all that is the future.
>>
>
>  I totally agree, with both points!
>
> Τη Τετάρτη, 29 Απριλίου 2020 - 8:30:25 μ.μ. UTC+3, ο χρήστης Waldek
> Kozaczuk έγραψε:
>>
>> Let me start with the results of my testing this patch. First I tried
>> with stock QEMU 5.0 just to verify that non-DAX logic still works. In
>> general, it does, however, I encountered that protocol mismatch error which
>> I reported in my other email.
>>
>> Stock QEMU still does not have DAX support so I used one from
>> https://gitlab.com/virtio-fs/qemu/-/commits/virtio-dev (shall I be using
>> this?) to test the DAX logic.
>>
>
>> When I ran a simple example I got this:
>>
>> #In another window
>> ./build/virtiofsd --socket-path=/tmp/vhostqemu -o source=~/projects/osv/
>> apps/native-example -o cache=always -d
>>
>> # Main
>> /home/wkozaczuk/projects/qemu/build/x86_64-softmmu/qemu-system-x86_64 \
>> -m 4G \
>> -smp 4 \
>> -vnc :1 \
>> -gdb tcp::1234,server,nowait \
>> -kernel /home/wkozaczuk/projects/osv/build/last/kernel.elf \
>> -append "$1" \
>> -device virtio-blk-pci,id=blk0,drive=hd0,scsi=off \
>> -drive
>> file=/home/wkozaczuk/projects/osv/build/last/usr.img,if=none,id=hd0,cache=none,aio=native
>> \
>> -netdev user,id=un0,net=192.168.122.0/24,host=192.168.122.1 \
>> -device virtio-net-pci,netdev=un0 \
>> -device virtio-rng-pci \
>> -enable-kvm \
>> -cpu host,+x2apic \
>> -chardev stdio,mux=on,id=stdio,signal=off \
>> -mon chardev=stdio,mode=readline \
>> -device isa-serial,chardev=stdio \
>> -chardev socket,id=char0,path=/tmp/vhostqemu \
>> -device
>> vhost-user-fs-pci,queue-size=1024,chardev=char0,tag=myfs,cache-size=64M \
>> -object memory-backend-file,id=mem,size=4G,mem-path=/dev/shm,share=on
>> -numa node,memdev=mem #do we need that line?
>>
>> OSv v0.54.0-179-g2f92fc91
>> 4 CPUs detected
>> Firmware vendor: SeaBIOS
>> bsd: initializing - done
>> VFS: mounting ramfs at /
>> VFS: mounting devfs at /dev
>> net: initializing - done
>> vga: Add VGA device instance
>> eth0: ethernet address: 52:54:00:12:34:56
>> virtio-blk: Add blk device instances 0 as vblk0, devsize=6470656
>> random: virtio-rng registered as a source.
>> virtio-fs: Detected device with tag: [myfs] and num_queues: 1
>> virtio-fs: Detected DAX window with length 67108864
>> virtio-fs: Add device instance 0 as [virtiofs1]
>> random: intel drng, rdrand registered as a source.
>> random: <Software, Yarrow> initialized
>> VFS: unmounting /dev
>> VFS: mounting rofs at /rofs
>> VFS: mounting devfs at /dev
>> VFS: mounting procfs at /proc
>> VFS: mounting sysfs at /sys
>> VFS: mounting ramfs at /tmp
>> VFS: mounting virtiofs at /virtiofs
>> [virtiofs] Initialized fuse filesystem with version major: 7, minor: 31
>> [I/43 dhcp]: Broadcasting DHCPDISCOVER message with xid: [1369429892]
>> [I/43 dhcp]: Waiting for IP...
>> [I/55 dhcp]: Received DHCPOFFER message from DHCP server: 192.168.122.1
>> regarding offerred IP address: 192.168.122.15
>> [I/55 dhcp]: Broadcasting DHCPREQUEST message with xid: [1369429892] to
>> SELECT offered IP: 192.168.122.15
>> [I/55 dhcp]: Received DHCPACK message from DHCP server: 192.168.122.1
>> regarding offerred IP address: 192.168.122.15
>> [I/55 dhcp]: Server acknowledged IP 192.168.122.15 for interface eth0
>> with time to lease in seconds: 86400
>> eth0: 192.168.122.15
>> [I/55 dhcp]: Configuring eth0: ip 192.168.122.15 subnet mask
>> 255.255.255.0 gateway 192.168.122.1 MTU 1500
>> Booted up in 145.94 ms
>> Cmdline: /virtiofs/hello
>> [virtiofs] inode 1, lookup found inode 2 for hello!
>> [virtiofs] inode 1, lookup found inode 2 for hello!
>> [virtiofs] inode 2, opened
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=64, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+40 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 64 bytes at offset 0
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=120, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+78 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 64
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=176, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+b0 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 120
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=232, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+e8 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 176
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=288, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+120 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 232
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=344, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+158 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 288
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=400, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+190 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 344
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=456, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1c8 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 400
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=512, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+200 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 456
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=568, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+238 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 512
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=624, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+270 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 568
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=680, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+2a8 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 624
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=736, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+2e0 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 680
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=792, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+318 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 56 bytes at offset 736
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=2421,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+975 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 282 bytes at offset 14427
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4096,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1000 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 4096 bytes at offset 12288
>> [virtiofs] inode 2, setting up mapping (foffset=0, len=4096, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1000 from 0
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 4096 bytes at offset 0
>> [virtiofs] inode 2, setting up mapping (foffset=8192, len=4096, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1000 from 2000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 4096 bytes at offset 8192
>> [virtiofs] inode 2, setting up mapping (foffset=12288, len=4408,
>> moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1138 from 3000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 1984 bytes at offset 14712
>> [virtiofs] inode 2, setting up mapping (foffset=4096, len=4096, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1000 from 1000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 4096 bytes at offset 4096
>> [virtiofs] inode 2, setting up mapping (foffset=8192, len=4096, moffset=0)
>> vhost_user_fs_slave_map: map failed err 19 [0] 0+1000 from 2000
>> [virtiofs] inode 2, mapping setup failed
>> [virtiofs] inode 2, reading 4096 bytes at offset 8192
>> Hello from C code
>> random: device unblocked.
>> [virtiofs] inode 2, closed
>> [I/0 dhcp]: Unicasting DHCPRELEASE message with xid: [2037604332] from
>> client: 192.168.122.15 to server: 192.168.122.1
>> VFS: unmounting /dev
>> VFS: unmounting /proc
>> VFS: unmounting /
>> ROFS: spent 0.88 ms reading from disk
>> ROFS: read 31 512-byte blocks from disk
>> ROFS: allocated 28 512-byte blocks of cache memory
>> ROFS: hit ratio is 90.91%
>> Powering off.
>>
>> # --- from virtiofs daemon
>> [9219297364154] [ID: 00028096] virtio_session_mount: Waiting for
>> vhost-user socket connection...
>> [9249162235652] [ID: 00028096] virtio_session_mount: Received vhost-user
>> socket connection
>> [9249164340260] [ID: 00000001] virtio_loop: Entry
>> [9249164372505] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184550001] [ID: 00000001] virtio_loop: Got VU event
>> [9249184589992] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184611833] [ID: 00000001] virtio_loop: Got VU event
>> [9249184625473] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184641865] [ID: 00000001] virtio_loop: Got VU event
>> [9249184651170] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184655179] [ID: 00000001] virtio_loop: Got VU event
>> [9249184664978] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184689289] [ID: 00000001] virtio_loop: Got VU event
>> [9249184700075] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184711125] [ID: 00000001] virtio_loop: Got VU event
>> [9249184716746] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184720836] [ID: 00000001] virtio_loop: Got VU event
>> [9249184731893] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184745853] [ID: 00000001] virtio_loop: Got VU event
>> [9249184752940] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249184758110] [ID: 00000001] virtio_loop: Got VU event
>> [9249184764199] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364236204] [ID: 00000001] virtio_loop: Got VU event
>> [9249364265160] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364273732] [ID: 00000001] virtio_loop: Got VU event
>> [9249364285075] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364290786] [ID: 00000001] virtio_loop: Got VU event
>> [9249364297956] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364303844] [ID: 00000001] virtio_loop: Got VU event
>> [9249364328100] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364343703] [ID: 00000001] virtio_loop: Got VU event
>> [9249364353594] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364360048] [ID: 00000001] virtio_loop: Got VU event
>> [9249364367820] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364373924] [ID: 00000001] virtio_loop: Got VU event
>> [9249364391839] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364398187] [ID: 00000001] virtio_loop: Got VU event
>> [9249364407842] [ID: 00000001] fv_queue_set_started: qidx=0 started=1
>> [9249364464882] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364474399] [ID: 00000001] virtio_loop: Got VU event
>> [9249364481756] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364485904] [ID: 00000001] virtio_loop: Got VU event
>> [9249364492800] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364497196] [ID: 00000001] virtio_loop: Got VU event
>> [9249364508482] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364515407] [ID: 00000001] virtio_loop: Got VU event
>> [9249364524257] [ID: 00000001] fv_queue_set_started: qidx=1 started=1
>> [9249364573934] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364585011] [ID: 00000001] virtio_loop: Got VU event
>> [9249364600006] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364625104] [ID: 00000001] virtio_loop: Got VU event
>> [9249364654277] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364688094] [ID: 00000001] virtio_loop: Got VU event
>> [9249364702845] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249364710061] [ID: 00000001] virtio_loop: Got VU event
>> [9249364723919] [ID: 00000001] virtio_loop: Waiting for VU event
>> [9249366067416] [ID: 00000005] fv_queue_thread: Start for queue 1 kick_fd
>> 12
>> [9249366082934] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249366077326] [ID: 00000003] fv_queue_thread: Start for queue 0 kick_fd
>> 9
>> [9249366090195] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249366093393] [ID: 00000003] fv_queue_thread: Waiting for Queue 0 event
>> [9249366101372] [ID: 00000003] fv_queue_thread: Got queue event on Queue 0
>> [9249366102360] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 0 out: 0
>> [9249366110558] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249366112383] [ID: 00000003] fv_queue_thread: Queue 0 gave evalue: 1
>> available: in: 0 out: 0
>> [9249366118974] [ID: 00000003] fv_queue_thread: Waiting for Queue 0 event
>> [9249374892326] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249374904012] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 80 out: 56
>> [9249374934131] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249374952478] [ID: 00000009] fv_queue_worker: elem 0: with 2 out desc
>> of length 56 bad_in_num=0 bad_out_num=0
>> [9249374973101] [ID: 00000009] unique: 1, opcode: INIT (26), nodeid: 1,
>> insize: 56, pid: 0
>> [9249374978513] [ID: 00000009] INIT: 7.31
>> [9249374981936] [ID: 00000009] flags=0x00000000
>> [9249374986298] [ID: 00000009] max_readahead=0x00001000
>> [9249374990203] [ID: 00000009]    INIT: 7.31
>> [9249374993468] [ID: 00000009]    flags=0x00000020
>> [9249374996481] [ID: 00000009]    max_readahead=0x00001000
>> [9249374999609] [ID: 00000009]    max_write=0x00020000
>> [9249375002781] [ID: 00000009]    max_background=0
>> [9249375005895] [ID: 00000009]    congestion_threshold=0
>> [9249375008949] [ID: 00000009]    time_gran=1
>> [9249375011950] [ID: 00000009]    map_alignment=0
>> [9249375015234] [ID: 00000009]    unique: 1, success, outsize: 80
>> [9249375018746] [ID: 00000009] virtio_send_msg: elem 0: with 2 in desc of
>> length 80
>> [9249388628910] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249388645266] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 46
>> [9249388654201] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249388676022] [ID: 00000013] fv_queue_worker: elem 0: with 2 out desc
>> of length 46 bad_in_num=0 bad_out_num=0
>> [9249388698563] [ID: 00000013] unique: 2, opcode: LOOKUP (1), nodeid: 1,
>> insize: 46, pid: 0
>> [9249388704802] [ID: 00000013] lo_lookup(parent=1, name=hello)
>> [9249388742711] [ID: 00000013]   1/hello -> 2 (version_table[0]=0)
>> [9249388747683] [ID: 00000013]    unique: 2, success, outsize: 144
>> [9249388751520] [ID: 00000013] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249389594247] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249389602640] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 46
>> [9249389612928] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249389643953] [ID: 00000122] fv_queue_worker: elem 0: with 2 out desc
>> of length 46 bad_in_num=0 bad_out_num=0
>> [9249389658227] [ID: 00000122] unique: 3, opcode: LOOKUP (1), nodeid: 1,
>> insize: 46, pid: 0
>> [9249389663078] [ID: 00000122] lo_lookup(parent=1, name=hello)
>> [9249389676746] [ID: 00000122]   1/hello -> 2 (version_table[0]=0)
>> [9249389680957] [ID: 00000122]    unique: 3, success, outsize: 144
>> [9249389684394] [ID: 00000122] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249390464470] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249390470787] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 32 out: 48
>> [9249390480181] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249390497618] [ID: 00000011] fv_queue_worker: elem 0: with 2 out desc
>> of length 48 bad_in_num=0 bad_out_num=0
>> [9249390511576] [ID: 00000011] unique: 4, opcode: OPEN (14), nodeid: 2,
>> insize: 48, pid: 0
>> [9249390517684] [ID: 00000011] lo_open(ino=2, flags=0)
>> [9249390539984] [ID: 00000011]    unique: 4, success, outsize: 32
>> [9249390544506] [ID: 00000011] virtio_send_msg: elem 0: with 2 in desc of
>> length 32
>> [9249391978294] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249391984602] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249391993855] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249392005767] [ID: 00000015] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249392017220] [ID: 00000015] unique: 5, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249392021582] [ID: 00000015] lo_setupmapping(ino=2,
>> fi=0x0x7fc47fffec60, foffset=0, len=64, moffset=0, flags=0)
>> [9249392105560] [ID: 00000015] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249392121208] [ID: 00000015]    unique: 5, error: -22 (Invalid
>> argument), outsize: 16
>> [9249392125024] [ID: 00000015] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249393460800] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249393471742] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 80 out: 80
>> [9249393483093] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249393500057] [ID: 00000129] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249393512842] [ID: 00000129] unique: 6, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249393518827] [ID: 00000129] lo_read(ino=2, size=64, off=0)
>> [9249393523326] [ID: 00000129] virtio_send_data_iov: count=1 len=64
>> iov_len=16
>> [9249393527829] [ID: 00000129] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 80
>> [9249393532868] [ID: 00000129] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=64
>> [9249393540554] [ID: 00000129] virtio_send_data_iov: preadv ret=64 len=64
>> [9249394566540] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249394574279] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249394586046] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249394599505] [ID: 00000017] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249394612392] [ID: 00000017] unique: 7, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249394617078] [ID: 00000017] lo_setupmapping(ino=2,
>> fi=0x0x7fc47effcc60, foffset=0, len=120, moffset=0, flags=0)
>> [9249394670847] [ID: 00000017] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249394677377] [ID: 00000017]    unique: 7, error: -22 (Invalid
>> argument), outsize: 16
>> [9249394681457] [ID: 00000017] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249396052993] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249396060605] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249396070277] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249396079960] [ID: 00000112] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249396090280] [ID: 00000112] unique: 8, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249396093654] [ID: 00000112] lo_read(ino=2, size=56, off=64)
>> [9249396096462] [ID: 00000112] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249396099045] [ID: 00000112] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249396101787] [ID: 00000112] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249396108136] [ID: 00000112] virtio_send_data_iov: preadv ret=56 len=56
>> [9249397164852] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249397173531] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249397182093] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249397201306] [ID: 00000019] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249397214127] [ID: 00000019] unique: 9, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249397217527] [ID: 00000019] lo_setupmapping(ino=2,
>> fi=0x0x7fc47dffac60, foffset=0, len=176, moffset=0, flags=0)
>> [9249397435430] [ID: 00000019] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249397441524] [ID: 00000019]    unique: 9, error: -22 (Invalid
>> argument), outsize: 16
>> [9249397454078] [ID: 00000019] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249398867198] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249398875435] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249398883776] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249398902017] [ID: 00000127] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249398914633] [ID: 00000127] unique: 10, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249398919140] [ID: 00000127] lo_read(ino=2, size=56, off=120)
>> [9249398922546] [ID: 00000127] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249398925731] [ID: 00000127] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249398928997] [ID: 00000127] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249398934407] [ID: 00000127] virtio_send_data_iov: preadv ret=56 len=56
>> [9249399907784] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249399916384] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249399925085] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249399936672] [ID: 00000125] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249399948784] [ID: 00000125] unique: 11, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249399952702] [ID: 00000125] lo_setupmapping(ino=2,
>> fi=0x0x7fc42a7a3c60, foffset=0, len=232, moffset=0, flags=0)
>> [9249400057859] [ID: 00000125] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249400063163] [ID: 00000125]    unique: 11, error: -22 (Invalid
>> argument), outsize: 16
>> [9249400066644] [ID: 00000125] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249401401872] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249401413855] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249401429460] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249401448982] [ID: 00000021] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249401463655] [ID: 00000021] unique: 12, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249401471468] [ID: 00000021] lo_read(ino=2, size=56, off=176)
>> [9249401476605] [ID: 00000021] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249401481259] [ID: 00000021] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249401485284] [ID: 00000021] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249401492772] [ID: 00000021] virtio_send_data_iov: preadv ret=56 len=56
>> [9249402674616] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249402685068] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249402693532] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249402706746] [ID: 00000124] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249402719429] [ID: 00000124] unique: 13, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249402723771] [ID: 00000124] lo_setupmapping(ino=2,
>> fi=0x0x7fc42b7a5c60, foffset=0, len=288, moffset=0, flags=0)
>> [9249402786159] [ID: 00000124] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249402792708] [ID: 00000124]    unique: 13, error: -22 (Invalid
>> argument), outsize: 16
>> [9249402796575] [ID: 00000124] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249404278683] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249404287324] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249404295093] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249404303042] [ID: 00000025] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249404312989] [ID: 00000025] unique: 14, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249404318560] [ID: 00000025] lo_read(ino=2, size=56, off=232)
>> [9249404322486] [ID: 00000025] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249404326525] [ID: 00000025] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249404329419] [ID: 00000025] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249404334827] [ID: 00000025] virtio_send_data_iov: preadv ret=56 len=56
>> [9249405432252] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249405438333] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249405447219] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249405454613] [ID: 00000131] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249405472306] [ID: 00000131] unique: 15, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249405476323] [ID: 00000131] lo_setupmapping(ino=2,
>> fi=0x0x7fc427f9ec60, foffset=0, len=344, moffset=0, flags=0)
>> [9249405525957] [ID: 00000131] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249405535271] [ID: 00000131]    unique: 15, error: -22 (Invalid
>> argument), outsize: 16
>> [9249405539101] [ID: 00000131] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249406879761] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249406887945] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249406895289] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249406914015] [ID: 00000023] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249406930268] [ID: 00000023] unique: 16, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249406938332] [ID: 00000023] lo_read(ino=2, size=56, off=288)
>> [9249406943668] [ID: 00000023] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249406948359] [ID: 00000023] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249406953179] [ID: 00000023] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249406960758] [ID: 00000023] virtio_send_data_iov: preadv ret=56 len=56
>> [9249407984132] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249407988447] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249407994289] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249408009393] [ID: 00000027] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249408030468] [ID: 00000027] unique: 17, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249408035255] [ID: 00000027] lo_setupmapping(ino=2,
>> fi=0x0x7fc474ff8c60, foffset=0, len=400, moffset=0, flags=0)
>> [9249408080642] [ID: 00000027] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249408085935] [ID: 00000027]    unique: 17, error: -22 (Invalid
>> argument), outsize: 16
>> [9249408089673] [ID: 00000027] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249409434730] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249409443594] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249409451642] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249409460710] [ID: 00000029] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249409470596] [ID: 00000029] unique: 18, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249409475258] [ID: 00000029] lo_read(ino=2, size=56, off=344)
>> [9249409478934] [ID: 00000029] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249409483191] [ID: 00000029] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249409486073] [ID: 00000029] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249409491600] [ID: 00000029] virtio_send_data_iov: preadv ret=56 len=56
>> [9249410515108] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249410520635] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249410526005] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249410542743] [ID: 00000030] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249410552967] [ID: 00000030] unique: 19, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249410558956] [ID: 00000030] lo_setupmapping(ino=2,
>> fi=0x0x7fc45e7fbc60, foffset=0, len=456, moffset=0, flags=0)
>> [9249410604244] [ID: 00000030] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249410610355] [ID: 00000030]    unique: 19, error: -22 (Invalid
>> argument), outsize: 16
>> [9249410614587] [ID: 00000030] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249411963400] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249411973593] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249411981221] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249412001349] [ID: 00000032] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249412031262] [ID: 00000032] unique: 20, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249412037867] [ID: 00000032] lo_read(ino=2, size=56, off=400)
>> [9249412051745] [ID: 00000032] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249412058841] [ID: 00000032] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249412065563] [ID: 00000032] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249412073262] [ID: 00000032] virtio_send_data_iov: preadv ret=56 len=56
>> [9249413213652] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249413223919] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249413231981] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249413251947] [ID: 00000034] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249413264355] [ID: 00000034] unique: 21, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249413268787] [ID: 00000034] lo_setupmapping(ino=2,
>> fi=0x0x7fc45cff8c60, foffset=0, len=512, moffset=0, flags=0)
>> [9249413341678] [ID: 00000034] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249413354571] [ID: 00000034]    unique: 21, error: -22 (Invalid
>> argument), outsize: 16
>> [9249413361446] [ID: 00000034] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249414705309] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249414714816] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249414722988] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249414740195] [ID: 00000036] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249414758729] [ID: 00000036] unique: 22, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249414765835] [ID: 00000036] lo_read(ino=2, size=56, off=456)
>> [9249414771786] [ID: 00000036] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249414777754] [ID: 00000036] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249414782104] [ID: 00000036] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249414797471] [ID: 00000036] virtio_send_data_iov: preadv ret=56 len=56
>> [9249415831266] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249415838956] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249415846458] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249415856280] [ID: 00000038] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249415870991] [ID: 00000038] unique: 23, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249415875928] [ID: 00000038] lo_setupmapping(ino=2,
>> fi=0x0x7fc4567fbc60, foffset=0, len=568, moffset=0, flags=0)
>> [9249415933471] [ID: 00000038] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249415943171] [ID: 00000038]    unique: 23, error: -22 (Invalid
>> argument), outsize: 16
>> [9249415947035] [ID: 00000038] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249417573765] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249417582689] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249417594057] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249417608220] [ID: 00000040] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249417621683] [ID: 00000040] unique: 24, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249417626295] [ID: 00000040] lo_read(ino=2, size=56, off=512)
>> [9249417630112] [ID: 00000040] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249417633690] [ID: 00000040] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249417637063] [ID: 00000040] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249417642654] [ID: 00000040] virtio_send_data_iov: preadv ret=56 len=56
>> [9249418678590] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249418689608] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249418701287] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249418713968] [ID: 00000044] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249418726583] [ID: 00000044] unique: 25, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249418731564] [ID: 00000044] lo_setupmapping(ino=2,
>> fi=0x0x7fc4537f5c60, foffset=0, len=624, moffset=0, flags=0)
>> [9249418785917] [ID: 00000044] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249418791436] [ID: 00000044]    unique: 25, error: -22 (Invalid
>> argument), outsize: 16
>> [9249418797053] [ID: 00000044] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249420150574] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249420161560] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249420178264] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249420195968] [ID: 00000048] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249420208740] [ID: 00000048] unique: 26, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249420214504] [ID: 00000048] lo_read(ino=2, size=56, off=568)
>> [9249420218730] [ID: 00000048] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249420222815] [ID: 00000048] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249420227093] [ID: 00000048] virtio_send_data_iov: after skip
>> skip_size=0 in_sg_cpy_count=1 in_sg_left=56
>> [9249420233726] [ID: 00000048] virtio_send_data_iov: preadv ret=56 len=56
>> [9249421278721] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249421289524] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 144 out: 80
>> [9249421301503] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249421311683] [ID: 00000050] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249421324004] [ID: 00000050] unique: 27, opcode: SETUPMAPPING (48),
>> nodeid: 2, insize: 80, pid: 0
>> [9249421329441] [ID: 00000050] lo_setupmapping(ino=2,
>> fi=0x0x7fc4507efc60, foffset=0, len=680, moffset=0, flags=0)
>> [9249421393017] [ID: 00000050] lo_setupmapping: map over virtio failed
>> (ino=2fd=0 moffset=0x0)
>> [9249421398311] [ID: 00000050]    unique: 27, error: -22 (Invalid
>> argument), outsize: 16
>> [9249421402197] [ID: 00000050] virtio_send_msg: elem 0: with 2 in desc of
>> length 144
>> [9249422866367] [ID: 00000005] fv_queue_thread: Got queue event on Queue 1
>> [9249422876294] [ID: 00000005] fv_queue_thread: Queue 1 gave evalue: 1
>> available: in: 72 out: 80
>> [9249422887417] [ID: 00000005] fv_queue_thread: Waiting for Queue 1 event
>> [9249422898493] [ID: 00000054] fv_queue_worker: elem 0: with 2 out desc
>> of length 80 bad_in_num=0 bad_out_num=0
>> [9249422914125] [ID: 00000054] unique: 28, opcode: READ (15), nodeid: 2,
>> insize: 80, pid: 0
>> [9249422918423] [ID: 00000054] lo_read(ino=2, size=56, off=624)
>> [9249422921976] [ID: 00000054] virtio_send_data_iov: count=1 len=56
>> iov_len=16
>> [9249422925300] [ID: 00000054] virtio_send_data_iov: elem 0: with 2 in
>> desc of length 72
>> [9249422928
>> ...
>
> --
> You received this message because you are subscribed to the Google Groups
> "OSv Development" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/osv-dev/11106476-58be-4765-9e66-a7e9fab360da%40googlegroups.com
> <https://groups.google.com/d/msgid/osv-dev/11106476-58be-4765-9e66-a7e9fab360da%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups "OSv 
Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/osv-dev/CAL9cFfNC5Z57n1wY%2BX1SsR3BYk4VS1J5rm3HR3h4Sgf5sf9XCw%40mail.gmail.com.

Reply via email to