Re: Deprecating base system ftpd?

2021-04-05 Thread Lev Serebryakov

On 05.04.2021 17:44, Cy Schubert wrote:


- remove ftp:// and http:// from libfetch. This is 2021 and we should all
use https://.

 Please, explain how to setup simple sever which allows upload and on-server 
file management with https ;-)

 I know letters "WebDAV", but I don't know any ftp-like client for it. And 
server is apache24, which is much more huge security target than simple ftpd.

 Even `sftp` is ugly.


- replace DNS lookups with DoH and/or DoT. Why let your ISP see your DNS
traffic?


 As soon as FreeBSD will include in *base* system DoH/DoT recursive server (as it 
includes unbound for simple DNS now). I don't understand why should I trust 
"centralized" DoH services.

 Do we want to import libnghttp2 to base for this?


--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Vinum deprecation for FreeBSD 14 - are there any remaining Vinum users?

2021-04-01 Thread Lev Serebryakov

On 01.04.2021 2:39, Doug Ambrisko wrote:


| > I can only state that I use it only occasionally, and that when I do. I
| > have had no problems with it. I'm glad that it's there when I need it.
|
| Thanks for the reply. Can you comment on your use cases - in
| particular, did you use mirror, stripe, or raid5? If the first two
| then gmirror, gconcat, gstripe, and/or graid are suitable
| replacements.
|
| I'm not looking to deprecate it just because it's old, but because of
| a mismatch between user and developer expectations about its
| stability.

It would be nice if graid got full support for RAID5 alteast I'm not sure
how much the others are used for that are not fully supported (RAID4,
RAID5, RAID5E, RAID5EE, RAID5R, RAID6, RAIDMDF) according to the man
page.  I started to hack in RAID5 full support and try to avoid writes
if members didn't change.  This limits our VROC support.

 My experience, as co-author and maintainer of `sysutil/graid5`, shows, that it 
is very non-trivial task. It contains many subtle problems.

 `graid5` still has some undiscovered problems, and I don't think it worth 
fixing in 2021, when we have ZFS for many years.


--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: `clang -pg` generates binary which coredumps on start

2021-01-29 Thread Lev Serebryakov

On 29.01.2021 10:47, Dimitry Andric wrote:


I'm trying to profile my user-level program on FreeBSD 12-STABLE (amd64). When 
I build it with `cc -g -pg -O3` it coredumps on start. What do I do wrong?

(lldb) bt
* thread #1, name = 'mergenets', stop reason = signal SIGSEGV
  * frame #0: 0x
frame #1: 0x0028ebbf mergenets`__vdso_gettc(th=0x7270, 
tc=0x7fffddbc) at __vdso_gettc.c:0
frame #2: 0x0028e8c3 mergenets`binuptime [inlined] 
tc_delta(th=) at __vdso_gettimeofday.c:46:10
frame #3: 0x0028e8ba mergenets`binuptime(bt=0x7fffde08, 
tk=0x71b0, abs=0) at __vdso_gettimeofday.c:78
frame #4: 0x0028ea73 mergenets`__vdso_clock_gettime(clock_id=4, 
ts=0x7fffde68) at __vdso_gettimeofday.c:165:10
frame #5: 0x00281efb mergenets`__clock_gettime(clock_id=4, 
ts=0x7fffde68) at clock_gettime.c:48:11
frame #6: 0x0024339f mergenets`nstime_update_impl [inlined] 
nstime_get(time=0x000800403a88) at jemalloc_nstime.c:128:2
frame #7: 0x00243395 
mergenets`nstime_update_impl(time=0x000800403a88) at jemalloc_nstime.c:160
frame #8: 0x00234b6d mergenets`__je_arena_new [inlined] 
arena_decay_reinit(decay=0x000800403a20, decay_ms=) at 
jemalloc_arena.c:572:2
frame #9: 0x00234b21 mergenets`__je_arena_new [inlined] 
arena_decay_init(decay=0x000800403a20, decay_ms=, 
stats=0x0008004009a0) at jemalloc_arena.c:593
frame #10: 0x00234b1a mergenets`__je_arena_new(tsdn=0x, 
ind=0, extent_hooks=) at jemalloc_arena.c:1858
frame #11: 0x002239c0 mergenets`__je_arena_init [inlined] 
arena_init_locked(tsdn=0x, ind=0, 
extent_hooks=0x00205778) at jemalloc_jemalloc.c:338:10
frame #12: 0x002239b2 
mergenets`__je_arena_init(tsdn=0x, ind=0, 
extent_hooks=0x00205778) at jemalloc_jemalloc.c:366
frame #13: 0x0022f946 mergenets`malloc_init_hard_a0_locked at 
jemalloc_jemalloc.c:1328:6
frame #14: 0x00222cf5 mergenets`a0ialloc [inlined] 
malloc_init_hard_a0 at jemalloc_jemalloc.c:1343:8
frame #15: 0x00222caa mergenets`a0ialloc [inlined] malloc_init_a0 
at jemalloc_jemalloc.c:214
frame #16: 0x00222caa mergenets`a0ialloc(size=6223, zero=false, 
is_internal=false) at jemalloc_jemalloc.c:234
frame #17: 0x002225fc mergenets`__libc_allocate_tls [inlined] 
malloc_aligned(size=6200, align=16) at tls.c:135:8
frame #18: 0x002225e2 mergenets`__libc_allocate_tls(oldtls=0x, 
tcbsize=, tcbalign=) at tls.c:359
frame #19: 0x002227d0 mergenets`_init_tls at tls.c:469:8
frame #20: 0x0021f234 mergenets`_start(ap=, 
cleanup=) at crt1.c:66:3


Likely https://bugs.freebsd.org/249121 (and maybe 
https://bugs.llvm.org/show_bug.cgi?id=48165).


 I have r367937, and 249121 was fixed in r365654...


--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


`clang -pg` generates binary which coredumps on start

2021-01-28 Thread Lev Serebryakov



 I'm trying to profile my user-level program on FreeBSD 12-STABLE (amd64). When 
I build it with `cc -g -pg -O3` it coredumps on start. What do I do wrong?

(lldb) bt
* thread #1, name = 'mergenets', stop reason = signal SIGSEGV
  * frame #0: 0x
frame #1: 0x0028ebbf mergenets`__vdso_gettc(th=0x7270, 
tc=0x7fffddbc) at __vdso_gettc.c:0
frame #2: 0x0028e8c3 mergenets`binuptime [inlined] 
tc_delta(th=) at __vdso_gettimeofday.c:46:10
frame #3: 0x0028e8ba mergenets`binuptime(bt=0x7fffde08, 
tk=0x71b0, abs=0) at __vdso_gettimeofday.c:78
frame #4: 0x0028ea73 mergenets`__vdso_clock_gettime(clock_id=4, 
ts=0x7fffde68) at __vdso_gettimeofday.c:165:10
frame #5: 0x00281efb mergenets`__clock_gettime(clock_id=4, 
ts=0x7fffde68) at clock_gettime.c:48:11
frame #6: 0x0024339f mergenets`nstime_update_impl [inlined] 
nstime_get(time=0x000800403a88) at jemalloc_nstime.c:128:2
frame #7: 0x00243395 
mergenets`nstime_update_impl(time=0x000800403a88) at jemalloc_nstime.c:160
frame #8: 0x00234b6d mergenets`__je_arena_new [inlined] 
arena_decay_reinit(decay=0x000800403a20, decay_ms=) at 
jemalloc_arena.c:572:2
frame #9: 0x00234b21 mergenets`__je_arena_new [inlined] 
arena_decay_init(decay=0x000800403a20, decay_ms=, 
stats=0x0008004009a0) at jemalloc_arena.c:593
frame #10: 0x00234b1a mergenets`__je_arena_new(tsdn=0x, 
ind=0, extent_hooks=) at jemalloc_arena.c:1858
frame #11: 0x002239c0 mergenets`__je_arena_init [inlined] 
arena_init_locked(tsdn=0x, ind=0, 
extent_hooks=0x00205778) at jemalloc_jemalloc.c:338:10
frame #12: 0x002239b2 
mergenets`__je_arena_init(tsdn=0x, ind=0, 
extent_hooks=0x00205778) at jemalloc_jemalloc.c:366
frame #13: 0x0022f946 mergenets`malloc_init_hard_a0_locked at 
jemalloc_jemalloc.c:1328:6
frame #14: 0x00222cf5 mergenets`a0ialloc [inlined] 
malloc_init_hard_a0 at jemalloc_jemalloc.c:1343:8
frame #15: 0x00222caa mergenets`a0ialloc [inlined] malloc_init_a0 
at jemalloc_jemalloc.c:214
frame #16: 0x00222caa mergenets`a0ialloc(size=6223, zero=false, 
is_internal=false) at jemalloc_jemalloc.c:234
frame #17: 0x002225fc mergenets`__libc_allocate_tls [inlined] 
malloc_aligned(size=6200, align=16) at tls.c:135:8
frame #18: 0x002225e2 mergenets`__libc_allocate_tls(oldtls=0x, 
tcbsize=, tcbalign=) at tls.c:359
frame #19: 0x002227d0 mergenets`_init_tls at tls.c:469:8
frame #20: 0x0021f234 mergenets`_start(ap=, 
cleanup=) at crt1.c:66:3


--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: HEADS UP: FreeBSD src repo transitioning to git this weekend

2020-12-23 Thread Lev Serebryakov

On 23.12.2020 18:04, Lev Serebryakov wrote:

On 23.12.2020 17:32, Michael Grimm wrote:


git-branch(1):
    With a -m or -M option,  will    be renamed to . 
If

==

     had a corresponding reflog, it is renamed to    match
    , and    a reflog entry is created to remember the branch
    renaming. If     exists,    -M must    be used    to force 
the rename to
    happen.

I don't understand that text completely, because I don't know what a reflog is, 
yet ;-)

Thus: Should I use "-m" or "-M" in my scenario when switching from stable/12 to 
stable/13 in the near future?

You should not use any options if you want to switch your working copy to new 
branch. `-m` and `-M` *renames* branch!

 I'm idiot today, it is `git checkout ` of course.

--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: HEADS UP: FreeBSD src repo transitioning to git this weekend

2020-12-23 Thread Lev Serebryakov

On 23.12.2020 17:32, Michael Grimm wrote:


git-branch(1):
With a -m or -M option,  will  be renamed to . If

==

 had a corresponding reflog, it is renamed to  match
, and  a reflog entry is created to remember the branch
renaming. If   exists, -M must be used to force the rename to
happen.

I don't understand that text completely, because I don't know what a reflog is, 
yet ;-)

Thus: Should I use "-m" or "-M" in my scenario when switching from stable/12 to 
stable/13 in the near future?

You should not use any options if you want to switch your working copy to new 
branch. `-m` and `-M` *renames* branch!

--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 12-STABLE try to init thead-using libraries before threads and program crashes

2020-12-03 Thread Lev Serebryakov

On 27.11.2020 20:03, Konstantin Belousov wrote:


libthr is cleanly linked too early, it should come after all consumers.
Anyway, try this.

diff --git a/lib/libthr/thread/thr_mutex.c b/lib/libthr/thread/thr_mutex.c
index 57984ef6d0e..303386db7fe 100644
--- a/lib/libthr/thread/thr_mutex.c
+++ b/lib/libthr/thread/thr_mutex.c
@@ -384,6 +384,8 @@ __Tthr_mutex_init(pthread_mutex_t * __restrict mutex,
struct pthread_mutex *pmtx;
int ret;
  
+	_thr_check_init();

+
if (mutex_attr != NULL) {
ret = mutex_check_attr(*mutex_attr);
if (ret != 0)



 It helps!

--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 12-STABLE try to init thead-using libraries before threads and program crashes

2020-11-30 Thread Lev Serebryakov

On 27.11.2020 20:03, Konstantin Belousov wrote:

On Fri, Nov 27, 2020 at 06:03:13PM +0300, Lev Serebryakov wrote:


  I have locally-built net/samba413 port on 12-STABLE (r367937) which crashes 
in library initialization code due to wrong library initialization order:

(No debugging symbols found in /usr/local/bin/testparm)
(gdb) b  _libpthread_init
Function "_libpthread_init" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (_libpthread_init) pending.
(gdb) run
Starting program: /usr/local/bin/testparm

Program received signal SIGSEGV, Segmentation fault.
thr_malloc_lock (curthread=0x801e077d0) at 
/usr/src/lib/libthr/thread/thr_malloc.c:66
66  curthread->locklevel++;
(gdb) bt
#0  thr_malloc_lock (curthread=0x801e077d0) at 
/usr/src/lib/libthr/thread/thr_malloc.c:66
#1  __thr_calloc (num=1, size=96) at /usr/src/lib/libthr/thread/thr_malloc.c:88
#2  0x000801474843 in mutex_init (mutex=0x801072008, mutex_attr=, 
calloc_cb=) at /usr/src/lib/libthr/thread/thr_mutex.c:295
#3  __Tthr_mutex_init (mutex=0x801072008, mutex_attr=) at 
/usr/src/lib/libthr/thread/thr_mutex.c:395
#4  0x0008016d62fc in ?? () from /usr/local/lib/libgnutls.so.30
#5  0x0008016cfcb3 in ?? () from /usr/local/lib/libgnutls.so.30
#6  0x0008016d0077 in ?? () from /usr/local/lib/libgnutls.so.30
#7  0x00080103730d in objlist_call_init (list=, 
lockstate=) at /usr/src/libexec/rtld-elf/rtld.c:2823
#8  0x00080103603d in _rtld (sp=0x7fffeb58, exit_proc=0x7fffeb20, 
objp=0x7fffeb28) at /usr/src/libexec/rtld-elf/rtld.c:811
#9  0x0008010338c9 in rtld_start () at 
/usr/src/libexec/rtld-elf/amd64/rtld_start.S:39
#10 0x in ?? ()
(gdb)

  Please note, that `_libpthread_init` HAS BEEN NOT CALLED before 
`_Tthr_mutex_init`.

  Looks like some corner-case problem in rtld?

  Link command for this program is:

[3517/3660] Linking bin/default/source3/utils/testparm
runner ['cc', 'source3/utils/testparm.c.41.o', 
'-o/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source3/utils/testparm',
 '-Wl,-Bstatic', '-Wl,-Bdynamic', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source4/heimdal_build',
 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source4/lib/events',
 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/tdb_wrap', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/security',
 '-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/librpc', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/registry',
 '-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/dbwrap', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/socket', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/param', 
'-L/wrkdirs/usr/ports/net/

sam

ba413/work/samba-4.13.1/bin/default/lib/messaging', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/util', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/util', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/replace', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source3', 
'-L/usr/local/lib', '-L/usr/local/lib', '-L/usr/local/lib', '-L/usr/local/lib', 
'-L/usr/local/lib', '-L/usr/local/lib', '-lpopt-samba3-samba4', '-lsmbconf', 
'-lreplace-samba4', '-lsamba-errors', '-lcmdline-contexts-samba4', 
'-lsamba-util', '-lsamba3-util-samba4', '-lmessages-dgm-samba4', 
'-lsys-rw-samba4', '-lmessages-util-samba4', '-liov-buf-samba4', 
'-lsamba-hostconfig', '-lsocket-blocking-samba4', '-linterfaces-samba4', 
'-ldbwrap-samba4', '-ltevent-util', '-lsamba-sockets-samba4', 
'-lutil-reg-samba4', '-lutil-tdb-samba4', '-lndr', 
'-ltalloc-report-printf-samba4', '-lserver-id-db-samba4', 
'-lsamba-cluster-support-samba4', '-

lC

HARSET3-samba4', '-lsamba-security-samba4', '-lsmbd-s
him-samba4', '-lsamba-debug-samba4', '-lgenrand-samba4', '-ltime-basic-samba4', 
'-lutil-setid-samba4', '-lmsghdr-samba4', '-lserver-role-samba4', 
'-ltdb-wrap-samba4', '-levents-samba4', '-lndr-nbt', '-lroken-samba4', 
'-lexecinfo', '-ltevent', '-ltalloc', '-lpthread', '-lutil', 
'-lunwind-generic', '-lunwind', '-liconv', '-lz', '-ltdb', '-lpopt', 
'-lgnutls', '-ltalloc', '-fstack-protector-strong', '-L/usr/local/lib', '-pie', 
'-Wl,-z,relro,-z,now', '-Wl,-no-undefined', '-Wl,--export-dynamic']



libthr is cleanly linked too early, it should come after all consumers.

 I think, system should be resilent to such mistakes.


Anyway, try this.

diff --git a/lib/libthr/thread/thr_mutex.c b/lib/libthr/thread/thr_mutex.c
index 57984ef6d0e..303386db7fe 100644
--- a/lib/libthr/thread/thr_mutex.c
+++ b/lib/libthr/thread/thr_mutex.c
@@ -384,6 +384,8 @@ __Tthr_mutex_init(pthread_mutex_t * __restrict mutex,
struct pthrea

12-STABLE try to init thead-using libraries before threads and program crashes

2020-11-27 Thread Lev Serebryakov



 I have locally-built net/samba413 port on 12-STABLE (r367937) which crashes in 
library initialization code due to wrong library initialization order:

(No debugging symbols found in /usr/local/bin/testparm)
(gdb) b  _libpthread_init
Function "_libpthread_init" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (_libpthread_init) pending.
(gdb) run
Starting program: /usr/local/bin/testparm

Program received signal SIGSEGV, Segmentation fault.
thr_malloc_lock (curthread=0x801e077d0) at 
/usr/src/lib/libthr/thread/thr_malloc.c:66
66  curthread->locklevel++;
(gdb) bt
#0  thr_malloc_lock (curthread=0x801e077d0) at 
/usr/src/lib/libthr/thread/thr_malloc.c:66
#1  __thr_calloc (num=1, size=96) at /usr/src/lib/libthr/thread/thr_malloc.c:88
#2  0x000801474843 in mutex_init (mutex=0x801072008, mutex_attr=, 
calloc_cb=) at /usr/src/lib/libthr/thread/thr_mutex.c:295
#3  __Tthr_mutex_init (mutex=0x801072008, mutex_attr=) at 
/usr/src/lib/libthr/thread/thr_mutex.c:395
#4  0x0008016d62fc in ?? () from /usr/local/lib/libgnutls.so.30
#5  0x0008016cfcb3 in ?? () from /usr/local/lib/libgnutls.so.30
#6  0x0008016d0077 in ?? () from /usr/local/lib/libgnutls.so.30
#7  0x00080103730d in objlist_call_init (list=, 
lockstate=) at /usr/src/libexec/rtld-elf/rtld.c:2823
#8  0x00080103603d in _rtld (sp=0x7fffeb58, exit_proc=0x7fffeb20, 
objp=0x7fffeb28) at /usr/src/libexec/rtld-elf/rtld.c:811
#9  0x0008010338c9 in rtld_start () at 
/usr/src/libexec/rtld-elf/amd64/rtld_start.S:39
#10 0x in ?? ()
(gdb)

 Please note, that `_libpthread_init` HAS BEEN NOT CALLED before 
`_Tthr_mutex_init`.

 Looks like some corner-case problem in rtld?

 Link command for this program is:

[3517/3660] Linking bin/default/source3/utils/testparm
runner ['cc', 'source3/utils/testparm.c.41.o', 
'-o/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source3/utils/testparm',
 '-Wl,-Bstatic', '-Wl,-Bdynamic', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source4/heimdal_build',
 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source4/lib/events',
 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/tdb_wrap', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/security',
 '-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/librpc', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/registry',
 '-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/dbwrap', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/socket', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/param', 
'-L/wrkdirs/usr/ports/net/sam
ba413/work/samba-4.13.1/bin/default/lib/messaging', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/util', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/libcli/util', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/lib/replace', 
'-L/wrkdirs/usr/ports/net/samba413/work/samba-4.13.1/bin/default/source3', 
'-L/usr/local/lib', '-L/usr/local/lib', '-L/usr/local/lib', '-L/usr/local/lib', 
'-L/usr/local/lib', '-L/usr/local/lib', '-lpopt-samba3-samba4', '-lsmbconf', 
'-lreplace-samba4', '-lsamba-errors', '-lcmdline-contexts-samba4', 
'-lsamba-util', '-lsamba3-util-samba4', '-lmessages-dgm-samba4', 
'-lsys-rw-samba4', '-lmessages-util-samba4', '-liov-buf-samba4', 
'-lsamba-hostconfig', '-lsocket-blocking-samba4', '-linterfaces-samba4', 
'-ldbwrap-samba4', '-ltevent-util', '-lsamba-sockets-samba4', 
'-lutil-reg-samba4', '-lutil-tdb-samba4', '-lndr', 
'-ltalloc-report-printf-samba4', '-lserver-id-db-samba4', 
'-lsamba-cluster-support-samba4', '-lC
HARSET3-samba4', '-lsamba-security-samba4', '-lsmbd-s
him-samba4', '-lsamba-debug-samba4', '-lgenrand-samba4', '-ltime-basic-samba4', 
'-lutil-setid-samba4', '-lmsghdr-samba4', '-lserver-role-samba4', 
'-ltdb-wrap-samba4', '-levents-samba4', '-lndr-nbt', '-lroken-samba4', 
'-lexecinfo', '-ltevent', '-ltalloc', '-lpthread', '-lutil', 
'-lunwind-generic', '-lunwind', '-liconv', '-lz', '-ltdb', '-lpopt', 
'-lgnutls', '-ltalloc', '-fstack-protector-strong', '-L/usr/local/lib', '-pie', 
'-Wl,-z,relro,-z,now', '-Wl,-no-undefined', '-Wl,--export-dynamic']

--
// Lev Serebryakov
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 11.2-STABLE kernel wired memory leak

2019-02-15 Thread Lev Serebryakov
Hello Eugene,

Tuesday, February 12, 2019, 10:18:09 PM, you wrote:

> Do you have/had some memory pressure here? Growth of swap usage?
 After several days, ARC is even smaller, but Wired is the same:

Mem: 88M Active, 904M Inact, 29G Wired, 1121M Free
ARC: 13G Total, 5288M MFU, 6937M MRU, 2880K Anon, 44M Header, 1036M Other
 11G Compressed, 15G Uncompressed, 1.32:1 Ratio

  :-\

 Strill "lowmem_uptime" is zero, so no "low memory" situation, but ARC
becomes smaller and smaller (and hit rate goes down too) and it is not clear
where are all this "Wired" RAM :-(

 I had 16G on this system with same load and about half-year ago 14G was
typical ARC with 97% hit rate and now it is 32G (other things are unchanged)
and it is 13G ARC and 94% hit rate. And all memory is still Wired!

-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 11.2-STABLE kernel wired memory leak

2019-02-12 Thread Lev Serebryakov
Hello Eugene,

Tuesday, February 12, 2019, 10:18:09 PM, you wrote:

>>  I'm have same problem.
>> 
>>  According to top(1) I have 29G Wired, but only 17G Total ARC (12G
>> difference! System has 32G of RAM), and this statistic shows:
>> 
>> 5487.5 zio_data_buf_524288
>>920.125 zio_data_buf_131072
>>626 zio_buf_131072
>>468 zio_data_buf_1048576
>>398.391 zio_buf_16384
>>305.464 dnode_t
>>227.989 zio_buf_512
>>  171.5 zio_data_buf_458752
>> 141.75 zio_data_buf_393216
>>116.456 dmu_buf_impl_t
>> 
>>  So, more than 6G (!) is not used in ARC, but hold by ZFS anyway.

> dnode_t and dmu_buf_impl_t are parts of ZFS too,
> so these numbers represent about 9G, not 6G.

> Do you have/had some memory pressure here? Growth of swap usage?
 I don't have memory pressure right now, but according to my previous
experience, ARC will not grow anymore even under heavy disk load (I don't
have vfs.zfs.arc_max set).

 Before new ARC (vfs.zfs.abd_scatter_enabled) I had typically ALL
memory occuped by ARC, Wired memory was almost exactly equal to ARC, and
ARC hitrate was higher (but I have not exact numbers, unfortunately).

 Now I have "vfs.zfs.abd_scatter_enabled=0", but still Wired is much larger
that ARC under any disk load (it is mostly torrent box).

-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 11.2-STABLE kernel wired memory leak

2019-02-12 Thread Lev Serebryakov
On 12.02.2019 21:48, Eugene Grosbein wrote:

> I will reach the console next day only. Is it wise to use kgdb over ssh for 
> running remote system? :-)
 It works for me :-)

BTW, my is:

(kgdb) p time_uptime
$1 = 81369
(kgdb) p lowmem_uptime
$2 = 0

 (yes, this system have been rebooted less than a day ago).

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: 11.2-STABLE kernel wired memory leak

2019-02-12 Thread Lev Serebryakov
On 12.02.2019 21:37, Eugene Grosbein wrote:

>> vfs.zfs.arc_max=1216348160
> 
> Each line shows how many megabytes is allocated but currently unused by 
> corresponding
> UMA zone (and unavailable for other consumers). Your numbers are pretty low,
> you have nothing to worry about IMHO. I have hundreds of megabytes and 
> gigabytes there.
 I'm have same problem.

 According to top(1) I have 29G Wired, but only 17G Total ARC (12G
difference! System has 32G of RAM), and this statistic shows:

5487.5 zio_data_buf_524288
   920.125 zio_data_buf_131072
   626 zio_buf_131072
   468 zio_data_buf_1048576
   398.391 zio_buf_16384
   305.464 dnode_t
   227.989 zio_buf_512
 171.5 zio_data_buf_458752
141.75 zio_data_buf_393216
   116.456 dmu_buf_impl_t

 So, more than 6G (!) is not used in ARC, but hold by ZFS anyway.

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-22 Thread Lev Serebryakov
On 20.11.2018 23:45, Mark Johnston wrote:

>>  Where is other 11G of memory?!
>>
>> I've checked USED and FREE in "vmstat -z" output and got this:
>>
>> $ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n |
>> tail -20
>> 23001088 9171456 MAP ENTRY
>> 29680800 8404320 VM OBJECT
>> 34417408 10813952 256
>> 36377964 2665656 S VFS Cache
>> 50377392 53856 sa_cache
>> 50593792 622985216 zio_buf_131072
>> 68913152 976896 mbuf_cluster
>> 73543680 7225344 mbuf_jumbo_page
>> 92358552 67848 zfs_znode_cache
>> 95731712 51761152 4096
>> 126962880 159581760 dmu_buf_impl_t
>> 150958080 233920512 mbuf_jumbo_9k
>> 165164600 92040 VNODE
>> 192701120 30350880 UMA Slabs
>> 205520896 291504128 zio_data_buf_1048576
>> 222822400 529530880 zio_data_buf_524288
>> 259143168 293476864 zio_buf_512
>> 352485376 377061376 zio_buf_16384
>> 376109552 346474128 dnode_t
>> 2943016960 5761941504 abd_chunk
>> $
>>
>>  And total USED/FREE numbers is very strange for me:
>>
>> $ vmstat -z | tr : , | awk -F , '1{u+=$2*$4; f+=$2*$5} END{print u,f}'
>> 5717965420 9328951088
>> $ One more datapoint: I needed to reboot system and right after reboot
ARC becomes 14GiB (what was expected) and now it slows defalate, though
I didn't get more "Free" memory. So, ARC becomes smaller and smaller
after first fill-up, but all memory is "Wired".

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-21 Thread Lev Serebryakov
Hello Eugene,

Wednesday, November 21, 2018, 5:19:32 PM, you wrote:

>>  It is more likely that there is a bug in "priority" for memory
>> distribution: abd FREE memory has higher priority than ARC somehow.
> OTOH, if "abd_chunks" part of ZFS ARC is not released to the UMA
> from which it was allocated (to be reused by other parts of the kernel)
> but is reused by ZFS itself, then top(1) should report it as part of ZFS ARC
> and not as other "Wired" memory.
 It will be better to system use this memory for ARC and not as "Free" chunks 
for
future usage :-)


-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-21 Thread Lev Serebryakov
Hello Eugene,

Wednesday, November 21, 2018, 4:23:29 PM, you wrote:

>>  And here top consumers. I don't like that most of te memory is in FREE
>> abd_chunks - 8GB!
>> 
>> USED (b) FREE (b) NAME
>> 531902464 8392536064 abd_chunk
> This may be a leak. Can you monitor this value for longer run?
 No problem.

 But I don't think it is "true" leak, when memory is NEVER
freed, as uptime of this box is 11 days already, and sometimes ARC is much
larger than 2GiB. For example, now it is inflated to 8GiB.

 Ok, and now it is:

USED (b) FREE (b) NAME
35445924 3639276 S VFS Cache
37336376 1067704 arc_buf_hdr_t_l2only
47760912 2670336 sa_cache
51531120 55440 VM OBJECT
55574528 30408704 zio_data_buf_1048576
56183040 21365760 256
61734912 50331648 zio_buf_131072
70467584 2375680 mbuf_cluster
72028160 3895296 mbuf_jumbo_page
87561672 4856808 zfs_znode_cache
110448640 32768 4096
124137120 158133600 dmu_buf_impl_t
150976512 7188480 mbuf_jumbo_9k
156588360 8539896 VNODE
208290960 1040 UMA Slabs
247484416 280662016 zio_buf_512
275775488 96993280 zio_data_buf_524288
361406864 314169856 dnode_t
417366016 1015808 zio_buf_16384
7307493376 2383060992 abd_chunk

 It is more likely that there is a bug in "priority" for memory
distribution: abd FREE memory has higher priority than ARC somehow.

-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-21 Thread Lev Serebryakov
Hello Lev,

Wednesday, November 21, 2018, 1:56:18 PM, you wrote:

>> Could you show the output of "vmstat -s" when in this state?
>  Now ARC is 1.9GB (!!!) and 15G is still Wired:

> % vmstat -s
> 1311134466 cpu context switches
> 2126950424 device interrupts
>  45414140 software interrupts
> 103215017 traps
> 2910067754 system calls
>25 kernel threads created
>108756  fork() calls
> 50914 vfork() calls
>   111 rfork() calls
> 0 swap pager pageins
> 0 swap pager pages paged in
> 0 swap pager pageouts
> 0 swap pager pages paged out
>  4201 vnode pager pageins
> 51719 vnode pager pages paged in
> 31597 vnode pager pageouts
> 63028 vnode pager pages paged out
> 7 page daemon wakeups
> 1212387275 pages examined by the page daemon
> 0 clean page reclamation shortfalls
> 0 pages reactivated by the page daemon
>   8281789 copy-on-write faults
>  7909 copy-on-write optimized faults
>  0180 zero fill pages zeroed
> 24762 zero fill pages prezeroed
> 2 intransit blocking page faults
>  63838217 total VM faults taken
>  3816 page faults requiring I/O
> 0 pages affected by kernel thread creation
>   3996512 pages affected by  fork()
>   1842784 pages affected by vfork()
>  5499 pages affected by rfork()
>  88771375 pages freed
> 0 pages freed by daemon
>  21591789 pages freed by exiting processes
>  4936 pages active
>161234 pages inactive
> 16674 pages in the laundry queue
>   3848989 pages wired down
> 39951 pages free
>  4096 bytes per page
> 612681203 total name lookups
>   cache hits (95% pos + 0% neg) system 0% per-directory
>   deletions 0%, falsehits 0%, toolong 0%
> %
 And here top consumers. I don't like that most of te memory is in FREE
abd_chunks - 8GB!

USED (b) FREE (b) NAME
28785840 9299280 VM OBJECT
33817600 11413760 256
36598392 2486808 S VFS Cache
38157856 246224 arc_buf_hdr_t_l2only
44302336 629276672 zio_buf_131072
50377824 53424 sa_cache
72323072 85626880 mbuf_jumbo_page
74094592 55296 mbuf_cluster
90320896 63102976 4096
92359344 67056 zfs_znode_cache
126912480 159632160 dmu_buf_impl_t
150967296 233911296 mbuf_jumbo_9k
165164600 92040 VNODE
199124480 23927520 UMA Slabs
209715200 8388608 zio_data_buf_1048576
218103808 48758784 zio_data_buf_524288
259242496 293377536 zio_buf_512
346030080 383516672 zio_buf_16384
375592672 346991008 dnode_t
531902464 8392536064 abd_chunk



-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-21 Thread Lev Serebryakov
Hello Mark,

Tuesday, November 20, 2018, 11:45:37 PM, you wrote:

> Could you show the output of "vmstat -s" when in this state?
 Now ARC is 1.9GB (!!!) and 15G is still Wired:

% vmstat -s
1311134466 cpu context switches
2126950424 device interrupts
 45414140 software interrupts
103215017 traps
2910067754 system calls
   25 kernel threads created
   108756  fork() calls
50914 vfork() calls
  111 rfork() calls
0 swap pager pageins
0 swap pager pages paged in
0 swap pager pageouts
0 swap pager pages paged out
 4201 vnode pager pageins
51719 vnode pager pages paged in
31597 vnode pager pageouts
63028 vnode pager pages paged out
7 page daemon wakeups
1212387275 pages examined by the page daemon
0 clean page reclamation shortfalls
0 pages reactivated by the page daemon
  8281789 copy-on-write faults
 7909 copy-on-write optimized faults
 0180 zero fill pages zeroed
24762 zero fill pages prezeroed
2 intransit blocking page faults
 63838217 total VM faults taken
 3816 page faults requiring I/O
0 pages affected by kernel thread creation
  3996512 pages affected by  fork()
  1842784 pages affected by vfork()
 5499 pages affected by rfork()
 88771375 pages freed
0 pages freed by daemon
 21591789 pages freed by exiting processes
 4936 pages active
   161234 pages inactive
16674 pages in the laundry queue
  3848989 pages wired down
39951 pages free
 4096 bytes per page
612681203 total name lookups
  cache hits (95% pos + 0% neg) system 0% per-directory
  deletions 0%, falsehits 0%, toolong 0%
%




-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

2018-11-20 Thread Lev Serebryakov

 I have server which is mostly torrent box. It uses ZFS and equipped
with 16GiB of physical memory. It is running 11-STABLE (r339914 now).

 I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago.

 I was used to see 13-14GiB of memory in ZFS ARC and it was Ok.
Sometimes it "locks" under heavy disk load due to ARC memory pressure,
but it was bearable, and as ZFS is main reason this server exists, I
didn't limit ARC.

 But new revision (r339914) shows very strange behaivor: ARC is no more
than 4GiB, but kernel has 15GiB wired:

Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free
ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other
 2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio

 It is typical numbers for last week: 15G wired, 237M Free, but only
4252M ARC!

 Where is other 11G of memory?!

I've checked USED and FREE in "vmstat -z" output and got this:

$ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n |
tail -20
23001088 9171456 MAP ENTRY
29680800 8404320 VM OBJECT
34417408 10813952 256
36377964 2665656 S VFS Cache
50377392 53856 sa_cache
50593792 622985216 zio_buf_131072
68913152 976896 mbuf_cluster
73543680 7225344 mbuf_jumbo_page
92358552 67848 zfs_znode_cache
95731712 51761152 4096
126962880 159581760 dmu_buf_impl_t
150958080 233920512 mbuf_jumbo_9k
165164600 92040 VNODE
192701120 30350880 UMA Slabs
205520896 291504128 zio_data_buf_1048576
222822400 529530880 zio_data_buf_524288
259143168 293476864 zio_buf_512
352485376 377061376 zio_buf_16384
376109552 346474128 dnode_t
2943016960 5761941504 abd_chunk
$

 And total USED/FREE numbers is very strange for me:

$ vmstat -z | tr : , | awk -F , '1{u+=$2*$4; f+=$2*$5} END{print u,f}'
5717965420 9328951088
$

 So, only ~5.7G is used and 9.3G is free! But why this memory is not
used by ARC anymore and why is it wired and not free?

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: How to boot from GPT partition without "bootme" attribute?

2018-10-30 Thread Lev Serebryakov
Hello Ian,

Wednesday, October 31, 2018, 1:58:49 AM, you wrote:


> While loader(8) is loading the kernel, interrupt it to get the console
> prompt (or ask the menu to give the prompt if you use menus) and do:

>  unload
>  set currdev=disk0p2
>  boot
 Thnx!

 Is it possible to pass this information from gptboot(8) to loader(8)
somehow? Selecting "active" partition this way looks tedious.

 IMHO, better solution will be add some interactivity to gptboot(8) akin to
super-compact, but mighty boot0(8)

-- 
Best regards,
 Levmailto:l...@freebsd.org
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: How to boot from GPT partition without "bootme" attribute?

2018-10-30 Thread Lev Serebryakov
Hello Mark,

Wednesday, October 31, 2018, 12:38:07 AM, you wrote:


>>  After that loader, loaded from p2, loads kernel from p3 and boots
>> system from p3!
> Are the kernel's on p2 and p3 distinct in an identifiable way?
> Can you be sure it was not a mix of the p2 kernel and p3 world
> that booted? I ask because . . .
  Maybe, it is kernel from p2 and userland from p3, but anyway, it is not
 what I want to achieve. I'll add other kernel IDENT for other partition for
 check, but I'm sure, that p3 is moutned as /. I have different /etc/fstab
 on different partitions, of course. If kernel on "bootme" GPT partition
 will be faulty, it will be disaster, as gptboot could not (or I can not
 find how to) switch "bootme" attribute of GPT partition.

  I want to migrate my NanoBSD images from MBR to GPT, but I can not find
 way to easily boot from "previous" partition when "new" one is messed up.

> Any chance that that /etc/fstab initially used points
> to p3's world for / ?
  /etc/fstab on p2 points to p2, and /etc/fstab on p3 points to p3, I'm sure.

-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


How to boot from GPT partition without "bootme" attribute?

2018-10-30 Thread Lev Serebryakov

 I have disk with GPT scheme and three partitions:

p1 - freebsd-boot
p2 - freebsd-ufs
p3 - freebsd-ufs

 pmbr is installed on this disk, and gptboot is installed on p1. Both p2
and p3 contains valid FreeBSD installation, with /boot/loader, kernel,
and everything.

 I have attribute "bootme" set on p3, but not on p2.

 What should I do to boot from p2?

 I've tried to interrupt gptboot and override its choice:

 0:ad(0p3)/boot/loader

 with

 0:ad(0p2)/boot/loader

 After that loader, loaded from p2, loads kernel from p3 and boots
system from p3!

 If I have MBR, I could override "active" slice in boot0 MBR loader
interactively.

 Is it analogous feature for GPT?

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


loader lsdev crashes loader (Was: head -r338804 boots threadripper 1950X fine; head -r338810+ do not; -r338807 seems implicated)

2018-10-23 Thread Lev Serebryakov
On 22.10.2018 12:27, Toomas Soome wrote:

> It would help to get output from loader lsdev -v command.
 current loader crashes on "lsdev" for me:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=232483 (it is not
threadripper-related, my hardware is Intel Atom).

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: 11-STABLE still livelocks under combined network & disk activity — patch from D7538 helps

2018-05-22 Thread Lev Serebryakov
On 22.05.2018 18:53, Mike Tancsa wrote:

>>  Or there are other solutions?
>   If you set vfs.zfs.arc_max to some value like 8G do you still
> experience the problem ?
 I've tried 12G, it doesn't help. But anyway, it is ugly workaround. 95%
of time it is Ok to have 12G ARC on this system, and only 5% of time it
is a problem. With D7538 it simply works.

 I could try 8G without D7538 at weekend, though.

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


11-STABLE still livelocks under combined network & disk activity — patch from D7538 helps

2018-05-22 Thread Lev Serebryakov

 My home server (and torrent box) is rather beefy (E3-1220v3, 16GiB RAM,
radiz5, SSD L2ARC), NIC is igb (I210).

 This server expieince live-lock when there is fast and large download
with multiple streams (some very popular large torrent). In this state
it is not accessible by SSH, USB is failed (UPS, mouse and keyboard are
flaky), existing ssh connection is not simply "slow" but almost
unusable: 1-2 keypresses PER MINUTE, etc.

 top(1) shows (with 1 "frame" per minute update) that 100% of CPU is
consumed by "intr{irqXXX: igb0:que X}" in this state, memory is really
low (less than 100MiB) and pmc-based stats shows, that it is very hard
lock congestion somewhere in memory subsystem.

 As soon as download is finished, everything become normal again.

 Please note, that it is 100Mb/s download at max, not 1Gb/s!

  I've tried to tune different sysctls and even tuned UDP buckets, but
it doesn't help.

 This problem could be solved by https://reviews.freebsd.org/D7538.
Maybe, it could be integrated to system?

 Or there are other solutions?

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: Intel I210 (igb) sometimes consume all CPU on not-so-big traffic — need help!

2017-11-20 Thread Lev Serebryakov
On 20.11.2017 19:27, Ryan Stone wrote:

> Please try the following patch.  It should resolve your issue:
> https://people.freebsd.org/~rstone/patches/e1000-9k.diff
Thank you, I'll try! Really, typically I don't have this problem for
~week after reboot, so results will be later.

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: Intel I210 (igb) sometimes consume all CPU on not-so-big traffic — need help!

2017-11-20 Thread Lev Serebryakov
On 09.11.2017 23:17, Lev Serebryakov wrote:

  Looks like I know where it spent all time. I've used 'pmcstat' and got
very suspicious flamegraph. Looks like problem is on codepath which lies
through

igb_refresh_mbufs
m_getjcl
uma_zalloc_arg
[zone_alloc_item]
zone_import
zone_fetch_slab
keg_fetch_slab
keg_alloc_slab
mbuf_jumbo_alloc
kmem_alloc_contig
vm_page_reclaim_contig
vm_phys_scan_contig
vm_page_scan_contig

zone_alloc_item is optional, it presents 50% of time, otherwise path is
one step shorter.

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Re: Intel I210 (igb) sometimes consume all CPU on not-so-big traffic — need help!

2017-11-09 Thread Lev Serebryakov
On 09.11.2017 23:23, Michael Sierchio wrote:

 Nope.

> Is device polling enabled?
> 
> - M
> 
> On Thu, Nov 9, 2017 at 12:17 PM, Lev Serebryakov <l...@freebsd.org> wrote:
> 
>>
>>  I still have problems with my E-1220v3 server equipped with Intel I210
>> adapter. It can not be loaded more than 100Mbit/s because it is
>> connection to internet.
>>
>>  But sometimes four interrupt threads "intr{irqXXX: igb0:que Y}" consume
>> 100% CPU. Interrupt rate is very modest:
>>
>> % vmstat -i
>> interrupt  total   rate
>> ...
>> irq276: igb0:que 0 851899713   1193
>> irq277: igb0:que 1 907338150   1271
>> irq278: igb0:que 2 907538207   1271
>> irq279: igb0:que 3 768217584   1076
>> irq280: igb0:link  2  0
>> %
>>
>>  But CPU consumption is 90-100% per thread:
>>
>> PID USERNAME PRI NICE SIZE  RES STATE C   TIME   WCPU COMMAND
>>  11 root -92-   0K 544K CPU2  2 146:22 98.30% intr{irq278:
>> igb0:que 2}
>>  11 root -92-   0K 544K WAIT  0 178:18 81.55% intr{irq276:
>> igb0:que 0}
>>  11 root -92-   0K 544K WAIT  1 135:34 77.77% intr{irq277:
>> igb0:que 1}
>>  11 root -92-   0K 544K CPU3  3 138:57 67.50% intr{irq279:
>> igb0:que 3}
>>
>>  procstat -ak looks suspicious:
>>
>> % sudo procstat -ak | grep igb0:que
>>11 100056 intr   irq276: igb0:que 0  vm_page_scan_contig
>> vm_phys_scan_contig vm_page_reclaim_contig kmem_alloc_contig
>> mbuf_jumbo_alloc keg_alloc_slab keg_fetch_slab zone_fetch_slab
>> zone_import zone_alloc_item uma_zalloc_arg m_getjcl igb_refresh_mbufs
>> igb_rxeof igb_msix_que intr_event_execute_handlers ithread_loop fork_exit
>>11 100058 intr   irq277: igb0:que 1  mi_switch ithread_loop fork_exit
>> fork_trampoline
>>11 100060 intr   irq278: igb0:que 2  mi_switch ithread_loop fork_exit
>> fork_trampoline
>>11 100062 intr   irq279: igb0:que 3  mi_switch ithread_loop fork_exit
>> fork_trampoline
>> %
>>
>> --
>> // Lev Serebryakov
>>
>>
> 
> 


-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Intel I210 (igb) sometimes consume all CPU on not-so-big traffic — need help!

2017-11-09 Thread Lev Serebryakov

 I still have problems with my E-1220v3 server equipped with Intel I210
adapter. It can not be loaded more than 100Mbit/s because it is
connection to internet.

 But sometimes four interrupt threads "intr{irqXXX: igb0:que Y}" consume
100% CPU. Interrupt rate is very modest:

% vmstat -i
interrupt  total   rate
...
irq276: igb0:que 0 851899713   1193
irq277: igb0:que 1 907338150   1271
irq278: igb0:que 2 907538207   1271
irq279: igb0:que 3 768217584   1076
irq280: igb0:link  2  0
%

 But CPU consumption is 90-100% per thread:

PID USERNAME PRI NICE SIZE  RES STATE C   TIME   WCPU COMMAND
 11 root -92-   0K 544K CPU2  2 146:22 98.30% intr{irq278:
igb0:que 2}
 11 root -92-   0K 544K WAIT  0 178:18 81.55% intr{irq276:
igb0:que 0}
 11 root -92-   0K 544K WAIT  1 135:34 77.77% intr{irq277:
igb0:que 1}
 11 root -92-   0K 544K CPU3  3 138:57 67.50% intr{irq279:
igb0:que 3}

 procstat -ak looks suspicious:

% sudo procstat -ak | grep igb0:que
   11 100056 intr   irq276: igb0:que 0  vm_page_scan_contig
vm_phys_scan_contig vm_page_reclaim_contig kmem_alloc_contig
mbuf_jumbo_alloc keg_alloc_slab keg_fetch_slab zone_fetch_slab
zone_import zone_alloc_item uma_zalloc_arg m_getjcl igb_refresh_mbufs
igb_rxeof igb_msix_que intr_event_execute_handlers ithread_loop fork_exit
   11 100058 intr   irq277: igb0:que 1  mi_switch ithread_loop fork_exit
fork_trampoline
   11 100060 intr   irq278: igb0:que 2  mi_switch ithread_loop fork_exit
fork_trampoline
   11 100062 intr   irq279: igb0:que 3  mi_switch ithread_loop fork_exit
fork_trampoline
%

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Low default setting of UDBHASHSIZE leads to unresponsive system

2017-11-01 Thread Lev Serebryakov

 Now 11-STABLE (and 12-CURRENT too) have this:

sys/netinet/udp_usrreq.c:#define   UDBHASHSIZE 128

 Looks like such low value could lead to 100% consumption of CPU by
interrupt threads (igb queues in my case) on heavy incoming UDP traffic
(torrents with uTP in my case).

 My system (E3-1220v3 with I210 NICs) becomes completely unresponsive
(nut complains about lost connection to UPS, ssh to system times out,
etc) when system downloads torrent with many uTP (UDP) peers. Four igb0
queues consume 100% CPU each in this scenario.

 Total traffic could be very low like 500KiB/s (yes, 500KiB/s, not
MiB/s!), I don't speak about 1Gbit/s or even 100Mbit/s here!

  Rebuilding kernel with UDBHASHSIZE=16384 seems to help.

  Why is this value so low and why I need to patch sources to change it?
Many such settings are changeable via sysctl and/or tunables, but this
one looks hardcoded.

-- 
// Lev Serebryakov



signature.asc
Description: OpenPGP digital signature


Is it known problem, that zfs.ko could not be built with system compiler (clang 3.9.1) without optimization?

2017-02-22 Thread Lev Serebryakov
Hello Freebsd-stable,

   Now if you build zfs.ko with -O0 it panics on boot.

   If you use default optimization level, a lot of fbt DTreace probes are
  missing.

-- 
Best regards,
 Lev  mailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: IPv6 works on em0 () but not on em1 () - what's wrong?,IPv6 works on em0 () but not on em1 () - what's wrong?

2017-01-10 Thread Lev Serebryakov
Hello Hiroki,

Wednesday, January 11, 2017, 2:43:28 AM, you wrote:

>  What happens by typing the following command?
>  % ping6 ff02::1%em1

% ping6 ff02::1%em1
PING6(56=40+8+8 bytes) fe80::225:90ff:fe24:6bf8%em1 --> ff02::1%em1
16 bytes from fe80::225:90ff:fe24:6bf8%em1, icmp_seq=0 hlim=64 time=0.163 ms
16 bytes from fe80::222:4dff:fe9d:e093%em1, icmp_seq=0 hlim=64 time=0.737 
ms(DUP!)
16 bytes from fe80::225:90ff:fe24:6bf8%em1, icmp_seq=1 hlim=64 time=0.132 ms
16 bytes from fe80::222:4dff:fe9d:e093%em1, icmp_seq=1 hlim=64 time=0.766 
ms(DUP!)
16 bytes from fe80::225:90ff:fe24:6bf8%em1, icmp_seq=2 hlim=64 time=0.086 ms
16 bytes from fe80::222:4dff:fe9d:e093%em1, icmp_seq=2 hlim=64 time=0.713 
ms(DUP!)
...

 BTW, when I add address and default route by hands, everything starts to
work. So, this NIC doesn't have problems with IPv6 per se! Looks like some
weird configuration problem.

-- 
Best regards,
 Levmailto:l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


IPv6 works on em0 () but not on em1 () - what's wrong?

2017-01-10 Thread Lev Serebryakov

 I have MoBo (Supermicro X9SCL-F) with two 1G NICs, first one (em0) is
based on 82579LM, and second one (em1) is based on 82574L.

 When I'm using em0 with simple config:

ifconfig_em0="inet 192.168.134.2 netmask 255.255.255.0 mtu 9000"
ifconfig_em0_ipv6="inet6 accept_rtadv"

 everything works fine - em0 get IPv6 prefix from rtadvd of my router
and "tspdump -n -i em0 icmp6" shows some traffic, like router and prefix
announcements. So far so good.

 I want to use em1 (and don't use em0 at all), because 82579LM has some
known bugs according to SuperMicro support and someties hangs whole system.

  So, I change config to

ifconfig_em1="inet 192.168.134.2 netmask 255.255.255.0 mtu 9000"
ifconfig_em1_ipv6="inet6 accept_rtadv"

 connect em1 instead of em0 to the switch and reboot. And after that
interface (em1) can not get IPv6 prefix, don't get global address (and
shows only link-local one)and "tcpdump -n -i em1 icmp6" shows nothing at
all! IPv4 works fine, though.

 What do I do wrong? Is it known issue of 82574L?

 I'm running 10-STABLE r311462.

-- 
// Lev Serebryakov AKA Black Lion



signature.asc
Description: OpenPGP digital signature


Re: ZFS ARC vs Inactive memory on 10-STABLE: is it Ok?

2016-02-15 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

On 15.02.2016 17:55, Mark Saad wrote:

> Wow someone else as crazy as I was. :)
...
> I eventually convinced management to move to a automated tape
> library and a normal backup client
 It is my own home NAS, and I need to backup about 2TB offsite (you
could call me paranoid, yes). CrashPlan is almost only offer on the
market I could afford. I will be happy to use tarsnap or rsync.net,
for example, but it is too expensive for me :(

- -- 
// Lev Serebryakov
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQJ8BAEBCgBmBQJWwem6XxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePIqwP/iefNVwjlBfyPVuIXKtlldPP
CHLgdUaUSb+Nj67WJ20aKxw5nBHoJtRi60Ao1azutzYVEJdMDLGCX7ExqBAoMreY
sDZlKfTQViYlMhFhXch0AddEcticKrIl24D8a2WAaKLsnFSNY/U4XEd/jYl/TUVd
kbPbN+9Tufr/xzkilwiQJ7M1jKgq2PfPF6mrezPPRkvJGuBHpQPSOMRnlylQmw4K
wpBxroepNohcSIdLHOKXD6nGt9vaIF7vWycjF/IGEoWi/mmyjjR8eqBGHc6t3kZt
+yktp9q56TdPgh4EgfivoQyFiQwhlcUOB6HbrXyTSXXhpTKcy0/KpeiNUwnnp6j/
Qlm1xJPJnrw1mUj5i0790h4ZuFfurfFf7cL79RL9ZQHr7os5a5A5jNQlX2+GKSgD
J5eraHgYiio4a3d805wsvCETJjZGjBn0Jk5YANuodAcZyzo66RffFQomuWMlSe13
Et9NXmWT6rrNhxVC7BJv8zhK7Xy7YhIBiY3xONbpxcX7bVJt/1LIha44/Ft/BoLp
rlnJITPQZPn2FUwILQz4D+caJqkEeELpGd6Q385RLEHlf++izyT3MXvJl1MAhnYS
RoByj7qdy1EfSi/C0uVdxRHwk+tItySpgTVQ+5gm6T8B1dDs+noXednC6j72i+Xf
L14BPz8y5/9rCR93XhdP
=5Vz8
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


ZFS ARC vs Inactive memory on 10-STABLE: is it Ok?

2016-02-15 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512


 I have mostly-storage server with 8GB of physical RAM and 9TB (5x2TB
HDD) raidz ZFS pool (so, about 6.5TB usable space).

 ARC is limited to 3GB by vfs.zfs.arc_max.

 This server runs Samba (of course), CrashPlan backup client (Linux
Java!), and torrent client (transmission-daemon).

 And I'm noticing this regularly ("screenshot" of top(1)):

Mem: 1712M Active, 3965M Inact, 2066M Wired, 137M Cache, 822M Buf,
4688K Free
ARC: 421M Total, 132M MFU, 54M MRU, 1040K Anon, 7900K Header, 227M Other
Swap: 4096M Total, 248M Used, 3848M Free, 6% Inuse

 As you can see, here are almost 4G of Inactive memory and only 412M
of ARC!

 Is it Ok? Why Inactive memory (non-dirty buffers?) are pressed ARC
out of memory?

- -- 
// Lev Serebryakov
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQJ8BAEBCgBmBQJWweC0XxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePRTYP/RHajhE+EuvX3fCppShb/BSg
vpJZ8F1jeInIOVXe/XLw07jht04uquTXHsMvw6F0J+WIIqsCld53q1bfj4CWAnl6
4TjULTZYUWANv3wK6KxItEN5eMmDEPOW6Eqls57OSCFcZA/32hyf/Y15Nec0L6JD
sd8wpqUvQs0zb//frbUpjIRcfoVSMO2ip4doGPDtBv9IcE/kDz78IcmU9By2deXU
IJE8Xlg2hDY+f/NhTR2sCuwtCSvpL9/mBztffYqsKQsAm8oIn0Sz9mNdjVzUR+rN
lF4GoxcWf6c3HEM/LF4+dgOdb058YwO4amyUI7GoBSFBQq3OlJzvomGeOi2vPAvC
BkWxOWOcWsmEwfk1b22k00yNAjvaXQsCx6r2L/6vyrAtoQ0moXF4Rks8+MLFRUTu
FFke93UUPRQPXBdrBtlnFpXX6jpmlEm7g9pazarGc4hteYOKpvHajFvNvAB7RswI
NQL70+QfLBgtaA5683scCuURNptStf/RfvhwjW/o5DPNLv+NHnT+nPk64MTDuaZD
4z9Kcj088KjB++xt9c6BXuCS4zlkyUhas5cNGG+SxupZajtIuaCBTeUv0QwjnDH5
Pnu44Xe4MCvpDSt9odICdzytxO6yzwL7mLj70o2SsPs2ijN1w/fOlNqS46bekmJ/
MtvVwObCRnoDg3aMRUL0
=In6V
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 10-STABLE buildworld fails at very early stage

2015-10-30 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

On 30.10.2015 16:36, Herbert J. Skuhra wrote:

>> I have this in /etc/src.conf (it is only one line here):
>> 
>> MAKEOBJDIRPREFIX=/usr/home/build/obj
>> 
>> 
>> % cd /usr/src % sudo svn up Updating '.': At revision 290139. %
>> sudo make buildworld [one screen of output] set -e; cd
>> /usr/src/tools/build; make buildincludes; make installinclude s 
>> sh /usr/src/tools/install.sh -C -o root -g wheel -m 444
>> libegacy.a /usr/home/build/obj/legacy/usr/lib install:
>> /usr/home/build/obj/legacy/usr/lib: No such file or directory ***
>> Error code 71
>> 
>> Stop. make[3]: stopped in /usr/src/tools/build *** Error code 1 %
>> uname -v FreeBSD 10.2-PRERELEASE #7 r286065: Thu Jul 30 21:27:35
>> MSK 2015 root@:/usr/obj/usr/src/sys/BLOB
> 
> Does it work if you do:
> 
> % setenv MAKEOBJDIRPREFIX /usr/home/build/obj
 Nope, same error:

rm -rf /usr/home/build/obj/usr/src/tmp
rm -rf /usr/home/build/obj/usr/src/lib32
mkdir -p /usr/home/build/obj/usr/src/tmp/lib
mkdir -p /usr/home/build/obj/usr/src/tmp/usr
mkdir -p /usr/home/build/obj/usr/src/tmp/legacy/bin
mkdir -p /usr/home/build/obj/usr/src/tmp/legacy/usr
mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist  -p
/usr/home/build/obj/usr/src/tmp/legacy/usr >/dev/null
mtree -deU -f /usr/src/etc/mtree/BSD.groff.dist  -p
/usr/home/build/obj/usr/src/tmp/legacy/usr >/dev/null
mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist  -p
/usr/home/build/obj/usr/src/tmp/usr >/dev/null
mtree -deU -f /usr/src/etc/mtree/BSD.include.dist  -p
/usr/home/build/obj/usr/src/tmp/usr/include >/dev/null
ln -sf /usr/src/sys /usr/home/build/obj/usr/src/tmp
...
sh /usr/src/tools/install.sh -C -o root -g wheel -m 444   libegacy.a
/usr/home/build/obj/usr/src/tmp/legacy/usr/lib
install: libegacy.a: No such file or directory

  Looks like some problem with Makefile, as here is creation of /bin
and /usr "legacy" directories.

- -- 
// Lev Serebryakov
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQJ8BAEBCgBmBQJWM3TyXxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePn9MP/AmfVBYzcq06HZB+KGDExmSk
cjeXEgi5Aq21YDdNnD6tFTVtK330nb+nW+ZnWvziogz6kJL09hxh05wF55jaCtza
dUSFPv1Fd6EDvax5hWYUxOiMALcdYr6I13vDAU/fpzWO7CJtl403T4Z18Yumx9FT
Uc/vz2clKE3fLZi/dJV9zg59H/ESELu9TDdxZIL1HVZ/EucCjSRwJtvAn9cjEUhA
+qR2LgOCJkYAsSFiajw86BDBA0EfSYMl+Kfl0VcbT5tf5mQ8uAUtxL63di1j/dlB
fNVsLpcb5XSSraJj4qexnqQt/0jnU0NvIyPKxFo0IkQ3cqFTxR2iAZpP2iXEPHfJ
KSVp2uS198EIdr3jCvcuHFP/iAWCAtukmpc90i56Vf/yBBkXZs6v9f0ywL93WrCa
gEm2ESajK6XvyqAg8HwbA8NTIrDkMD8BOTnYhS7Ed0vpQa0cGblWA9yw9kRjoDV4
WSQjseRJNjaLzzAmX57dKNWp3x+D8kipd5dGHxxgtmNjlFiR/hnEoIF3kBkufrUk
1xn2jIw/rVScpeHBnnJ7bNJbWc1NMlYyCpfbj8rFOsypxjIIpMR+OofeMKbQ/Izz
FEguAVgnHujG9BgYEj2g0qoe872f3NAoDZwyE8S/qk39eWHF1Bkd2P6SvXIXOUQN
jn2n4WjTpUTMNDBcZT8s
=aM01
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 10-STABLE buildworld fails at very early stage

2015-10-30 Thread Lev Serebryakov
Hello Lev,

Friday, October 30, 2015, 4:47:31 PM, you wrote:

>   Looks like some problem with Makefile, as here is creation of /bin
> and /usr "legacy" directories.
 I've found this:
 http://lists.freebsd.org/pipermail/freebsd-current/2013-August/043439.html
 and it looks like my case exactly (but on -STABLE!).

 "svn status" doesn't show that there is something not-checked-out in
 "/usr/src" and, yes, this is very surprising to have some build-generated
 files in /usr/src!

-- 
Best regards,
 Levmailto:l...@serebryakov.spb.ru

pgpKz46C2sEYu.pgp
Description: PGP signature


10-STABLE buildworld fails at very early stage

2015-10-29 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512


I have this in /etc/src.conf (it is only one line here):

MAKEOBJDIRPREFIX=/usr/home/build/obj


% cd /usr/src
% sudo svn up
Updating '.':
At revision 290139.
% sudo make buildworld
[one screen of output]
set -e; cd /usr/src/tools/build; make buildincludes; make installinclude
s
sh /usr/src/tools/install.sh -C -o root -g wheel -m 444   libegacy.a
/usr/home/build/obj/legacy/usr/lib
install: /usr/home/build/obj/legacy/usr/lib: No such file or directory
*** Error code 71

Stop.
make[3]: stopped in /usr/src/tools/build
*** Error code 1
% uname -v
FreeBSD 10.2-PRERELEASE #7 r286065: Thu Jul 30 21:27:35 MSK 2015
root@:/usr/obj/usr/src/sys/BLOB
%

- -- 
// Lev Serebryakov
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQJ8BAEBCgBmBQJWMiwyXxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EeP1iwQAKB0mwW2w9Ablws1vxcTUmCC
zEPI7zcGi/wu/Xw6w8exsYvwr5nsEKyTCrc9zV2CmwuXoY23Xqk4r1Atl0XXL9eF
5P2fjzNxK8w1NI6PYY6kmw64JpcA1MQKZwizNzE+uhoKkTkX9PQYYGbVOJlNT6v6
7OaQYbsGPwlyRXC0nRWZW1izClIs7XqMFwo+q0oX12/oPZypwPxQsk6KsPym+WQN
uL3ENoa13AnGbc7YY4omO/6Yvi3yIP1tIRUSre1s+ES7/gIKw62uHT0JuCpdCoEL
G1cC9Zq4irGQYJlgR2HEjypTJ09Flzs4rgOmmV/Oj8xJw8N/JGJp0X9NkDHMtkSO
KF+x1cwm+lJeDVNoz0NsJXfMpo33SiKwaTYQiQUhvRQOUpVsWzaC4KV5aNfRFa3/
uDkV7KCJETOQuYC4H7SCRn2KFRp6uxAh/UMXj3XZpwx5VzDI3CxgBx6DMxJF4/zD
+eKIPPdcbGY1rRW5I375Cw/pZv3rYMni3ruPQibXeezD9TJ6YP48gTWKwtcpKiTe
UmJ5IE6gn3PhyPBZjGBqsfnvxLMBw29GwqEE6bBRtQbYrhy3GfBJeShkc2nCR7c2
yv8zcgP2yBjBs+SyBrJvGkHEUxM4gaomkVqMvDsGgFixneOoSquna88S2YCA6mBY
Ik+aukkDLIYCxqbbE6AA
=+GmP
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: 10-STABLE live locks, looks like VM-related

2015-04-08 Thread Lev Serebryakov
Hello Lev,

Monday, April 6, 2015, 11:55:09 AM, you wrote:

  I got several live locks of my server in a row (3 in one week).
  It is amd64 10-STABLE r277307.
  And again, rebuilded to r281159

  http://lev.serebryakov.spb.ru/freebsd/ll/
  I've tested memory with memtest86 for 12 hours without errors.
  Added as core.txt.6



-- 
Best regards,
 Levmailto:l...@serebryakov.spb.ru

pgpfTu1t_ILmE.pgp
Description: PGP signature


10-STABLE live locks, looks like VM-related

2015-04-06 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512


 I got several live locks of my server in a row (3 in one week).
 It is amd64 10-STABLE r277307.
 Looks like live locks is VM related but manifest themselves under
multi-threaded mixed CPU + I/O load (CrashPlan backup + torrents +
openjdk8 rebuild, for example).

 This system doesn't have ZFS, but have several UFS2 SU+J with
different block sizes (16Kb and 32Kb)! As far as I remeber several
versions ago 16Kb + 64Kb mix was a killer (known bug). but 16 + 32
works well for several years.

 I have INVARIANTS and WITNESS in the kernel, but it doesn't help:
only report is bufwait/dirhash right after booting.

 When system hangs, I could ping it, but NFS, SMB, ssh, local console,
everything else userland-related stop to answer.

 I could break into kernel debugger on console and panic manually,
so I have two crash dumps of system in this state.

 Many processes are in vmwait or pfault state according to DDB's
ps output.

 here are logs from two latest crashes:

 http://lev.serebryakov.spb.ru/freebsd/ll/

 I've tested memory with memtest86 for 12 hours without errors.

- -- 
// Lev Serebryakov AKA Black Lion
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.22 (MingW32)

iQJ8BAEBCgBmBQJVIknjXxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EeP5ZkP+QGJje5ejYvKrDS28/Dqrew8
7H07Oqh6XXHG/CPqsQts0MCSfJTjZ/XnaYM5hFARJQYBVj+nZfMyIgaUTgFp6hOd
UnQ+qGYgEuTYm3uxewyPL4C6NtLTJq79Au28oz6ONIbLsl5VQIkTxJMn/40RxtQr
EjqXSDc2al9s36bOidbD/ZdvuK91NaYcNH2tCvv2uNKR8SwA4LXPU+P/K3MtMDsT
K5c+yI9Fb0OWmYAF7wTUgrUrJeXxWcVyTsirtBB4C4sKXFKz1RDieGvUWnVjikbP
27c+cOpGPFzf3EgqFDwER2tLXdoB/YJ4BEY87alNI+mogjNrQa+2ck4wetfUKnSS
QrYKUEoQCJuskbgc2J4LKxIPGOJfYGLBIKv5QzlPcdu5hVOiwNmxn5zpaHbI8nRR
ikXhHmUl5dBOJ1u+6p6fPFJ38l8Ig+vZKRPhSsft6450yftLPliPiOH43mTaAoyd
dhCO0xHBbTNmt0QJEyniyBKxIEs3qYBFYFSQmZjiIXY70lP16Tea0m5r5zt9JYr6
j38IBgFL+TbK0BhwSU0479d29J7loOuIutoVbzKwpgjgu8eGZRcILjyAFonUX4EA
r90Lp4WUjR7qsjyCqFLG+g8kt4Hr6oTKAbMTtscWWlst5PCUOo07j6NAOhTjj5bV
XfC55FMCCuSa95UEC/5M
=a3a7
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 10-STABLE live locks, looks like VM-related

2015-04-06 Thread Lev Serebryakov
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

On 06.04.2015 11:55, Lev Serebryakov wrote:

 I have INVARIANTS and WITNESS in the kernel, but it doesn't help: 
 only report is bufwait/dirhash right after booting.
 One more LOR:

lock order reversal:
 1st 0xf8011b9b82d8 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2157
 2nd 0xfe0170ffaec8 bufwait (bufwait) @
/usr/src/sys/ufs/ffs/ffs_vnops.c:262
 3rd 0xf800b6587a28 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2157


- -- 
// Lev Serebryakov AKA Black Lion
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.22 (MingW32)

iQJ8BAEBCgBmBQJVIlzTXxSAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF
QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EeP8RYP/jJjw6sru0HIqHlPKAAbIFoT
f2NFqSI7aBlfYghC9mQxIpSGOtT5trrG5ZN2hg1jONbk/c2gmSm4otknp4lPDU00
jEghidQ5XQEpSsyr23fMvou3NYLn1iGKGYNuIJE1VZshQUdtxnBUbMokPZb5aVyu
nn3jUsxW3bcHxRR1ygHjU1XC/nv0AKw1xhy6aHodJci9TJnUxOFPEiYWXe3E66YC
83miSicOeJZTPaji2IH6T1pO2aqOaVZhqioAku5eqt6R3NEb41zNyeID6+4swgXb
bDdo7mE9i9L/QTOoAoVn1eKgLLJialhOpDxj3wHOiM3PeziTwS6Hw40F+7oCKcqi
gor5anq9apu9x8npElUGJOgSBZDxEuFzZBWx5ApJj7Iq3DqRF8iGY5/OJ++XP86O
PsKX9AhtQxQojTBqk5FXjSp5LRQLGSAN6m2uB4A7cB17r/MgJo0ZXer1ryZTwNXp
7zVL1xaZNcZHfZusrDs6m69Czpm1PE5Z2e33qa7YNFLihRpBbYazfVhDFORhVS5W
FUeQWJzIdYe7AA7hl/7hpCL2G8dj1+RH5oyQX1kEF76bOSx5LEgPr4vE3WnoTQQr
Go4uFUBJ9zjjAnKdKhUXfJG3i7rBNGwTuAxkU+o+jLX+Ry00iP0GC9xLJBJGtQZo
Kwnd2fW/6hLfNvTzivbS
=o9pc
-END PGP SIGNATURE-
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Hans.
You wrote 17 сентября 2013 г., 9:14:17:

HPS Check using usbdump -i usbusX -f Y -s 65536 -vvv
HPS what is going on. Maybe some USB transfers are returning zero length data 
from the chip.
  After closing port I disable all interrupts in chip, I've checked this (it
 was my first thought: ``I forget to disable internal interrupts on device
 close''), so, theoretically, it should stop spam system with interrupts...


-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Hans.
You wrote 17 сентября 2013 г., 9:14:17:

HPS Check using usbdump -i usbusX -f Y -s 65536 -vvv
HPS what is going on. Maybe some USB transfers are returning zero length data 
from the chip.
 Ok, I got 500 irq/s here from my device, so, I have same problem, as
 topicstarter. My usbdump (9-STABLE) doesn't understand '-f Y', without
 filter I get:

12:42:58.929604 usbus3.2 SUBM-INTR-EP=0089,SPD=HIGH,NFR=1,SLEN=0,IVAL=2
 frame[0] READ 16 bytes
 flags 0xa SHORT_XFER_OK|PIPE_BOF|0
 status 0xeb023 
OPEN|TRANSFERRING|STARTED|SHORT_XFER_OK|BDMA_ENABLE|BDMA_SETUP|CURR_DMA_SET|CAN_CANCEL_IMMED|DOING_CALLBACK|0
12:42:58.931601 usbus3.2 
DONE-INTR-EP=0089,SPD=HIGH,NFR=1,SLEN=8,IVAL=2,ERR=0
 frame[0] READ 5 bytes
   C1 01 01 01 55 -- -- --  -- -- -- -- -- -- -- --  |U   |
 flags 0xa SHORT_XFER_OK|PIPE_BOF|0
 status 0xcb021 
OPEN|STARTED|SHORT_XFER_OK|BDMA_ENABLE|BDMA_SETUP|CAN_CANCEL_IMMED|DOING_CALLBACK|0
12:42:58.931607 usbus3.2 SUBM-INTR-EP=0089,SPD=HIGH,NFR=1,SLEN=0,IVAL=2
 frame[0] READ 16 bytes
 flags 0xa SHORT_XFER_OK|PIPE_BOF|0
 status 0xcb023 
OPEN|TRANSFERRING|STARTED|SHORT_XFER_OK|BDMA_ENABLE|BDMA_SETUP|CAN_CANCEL_IMMED|DOING_CALLBACK|0
12:42:58.933601 usbus3.2 
DONE-INTR-EP=0089,SPD=HIGH,NFR=1,SLEN=8,IVAL=2,ERR=0
 frame[0] READ 5 bytes
   C1 01 01 01 55 -- -- --  -- -- -- -- -- -- -- --  |U   |
 flags 0xa SHORT_XFER_OK|PIPE_BOF|0
 status 0xeb021 
OPEN|STARTED|SHORT_XFER_OK|BDMA_ENABLE|BDMA_SETUP|CURR_DMA_SET|CAN_CANCEL_IMMED|DOING_CALLBACK|0
12:42:58.933610 usbus3.2 SUBM-INTR-EP=0089,SPD=HIGH,NFR=1,SLEN=0,IVAL=2
 frame[0] READ 16 bytes
 flags 0xa SHORT_XFER_OK|PIPE_BOF|0
 status 0xeb023 
OPEN|TRANSFERRING|STARTED|SHORT_XFER_OK|BDMA_ENABLE|BDMA_SETUP|CURR_DMA_SET|CAN_CANCEL_IMMED|DOING_CALLBACK|0


-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Harald.
You wrote 17 сентября 2013 г., 12:46:25:

HS The Y is the device addr @ bus #X.
  Oh :)

HS Same posted some seconds ago :-)
  Yep, exactly the same pattern.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Hans.
You wrote 17 сентября 2013 г., 20:04:58:

HPS I think the adapters use very small buffers. You can try adding
HPS .interval = 4 to the other USB configs, above the one you patched, and 
HPS see what happens. I cannot tell if you will loose characters or not.
 Datasheet promise 2x512 bytes FIFO for each port (on USB level, and typical
16 bytes buffers on UART level, because it emulates 16c550 compatible
UARTs)... Maybe, my setup of these FIFO buffers are not optimal, but
datasheet (even NDA-marked onem and I don't mention public, which is total
bullshit) doesn't say anything about configuring these buffers.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Hans.
You wrote 17 сентября 2013 г., 13:24:26:

HPS Try this patch and see what happens:
 It could throttle interrupts, but it doesn't explain, why device spams with
interrupts when all ports are closed and all UART interrupts are disabled!

HPS BTW: I see that the umcs driver shouldn't do synchronous control 
HPS transfers from the USB interrupt transfer callback. This should be 
HPS postponed into some worker thread, for example the USB explore thread. 
HPS See USB audio driver for an example.
 I've copied code from some other ucom driver... I'll take a look at USB
audio.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-17 Thread Lev Serebryakov
Hello, Harald.
You wrote 17 сентября 2013 г., 21:43:17:

HS Is that worth a try?
HS 
http://www.asix.com.tw/FrootAttach/driver/MCS7840_7820_FreeBSD_driver_v1.1.zip
  Nope. I've started from this driver, and it even doesn't support BREAK
 signal (it is was first reason why I start to write new one -- I needed
 BREAK to enter kernel debugger).

HS At least, it seems to be possible to enable RS485-mode :-) :-)
  I could easily add RS485 mode, BUT! FreeBSD doesn;'t have any userland API
 for it, and the same is true for higher and non-standard baud rates.



-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: umcs (4-Port-USB-serial) triggering way too much ehci IRQs

2013-09-16 Thread Lev Serebryakov
Hello, Harald.
You wrote 16 сентября 2013 г., 20:11:38:

HS I have some of these 4-Port-Serial-USB-Hubs:
HS http://www.delock.com/produkte/F_673_USB---Seriell_87414/merkmale.html
HS They have the MosChip MCS7840 inside, wich also understands RS485/422
HS besides RS232.

HS FreeBSDs umcs(4) supports the RS232 mode with standard baudrates and
HS works with that device.

HS Unfortunately, as soon as I open any of the 4 cuaU0.x ports, there are
HS 500irq/s from ehci.
  I have only one 2-port noname adapter with this chip, which I used to
 write this driver. And it works fine (at least right now):

usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0

ugen3.2: vendor 0x9710 at usbus3
umcs78400: vendor 0x9710 product 0x7840, rev 2.00/0.01, addr 2 on usbus3
umcs78400: Chip mcs7840, found 2 active ports
umcs78400: On-die confguration: RST: active low, HRD: yes, PLL: avail, POR: 
avail, Ports: 4, EEPROM write disabled, IrDA is not available

% vmstat -i
interrupt  total   rate
irq1: atkbd0 799  0
irq18: uhci2 ehci0+ 1210  0
irq20: hpet0   529850590647
irq21: uhci1 2861007  3
irq23: uhci3 ehci1   2181202  2
irq256: em0   1139745179   1393
irq257: ahci0   76093174 93
Total 1750731961   2140

  I have never seen other devices on this chip and I have never had chance
 to try it with 4-port version of device...

  To be honest, I didn't know much about USB at all, I wrote this driver
without complete understanding USB magic and use USB only as transport to
access MCS7840 registers...

 Maybe, local USB Guru Hans Petter Selasky could give cime advicec how to
 debug this situation. I've added freebsd-usb@ to CC:

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: fxp0 interface going up/down/up/down (dhclient related?)

2013-06-09 Thread Lev Serebryakov
Hello, Jeremy.
You wrote 9 июня 2013 г., 14:44:01:

JC The issue is described in the 8.4-RELEASE Errata Notes; the driver is
JC using the same driver version as in stable/9, hence you're experiencing
JC the same problem.  See Open Issues:
   I had some memory, that I had had this problem on my router some time
 (year? two years? three?) ago, and it was fixed somehow at then-HEAD
 (9?) system with disabling link down event on fxp(4), caused by chip
 reset after address setting. Is it deja-vu or true memory?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: [Solved] [UART] GPS 18-5Hz LVC and COM1 silence, OK on Linux though...

2013-04-29 Thread Lev Serebryakov
Hello, Igor.
You wrote 29 апреля 2013 г., 6:06:35:

IM Once I narrowed down the problem (acpi uart), I stumbled across
IM http://forums.freebsd.org/archive/index.php/t-15740.html
IM Preventing the ACPI driver from seizing control of UART seems to work
IM and cuau0 is now functional.
 Hm.  I  need to try this on my D2500CC, where I have 4 UARTs and none
 of them works.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: Any objections/comments on axing out old ATA stack?

2013-03-28 Thread Lev Serebryakov
Hello, Aleksandr.
You wrote 28 марта 2013 г., 18:09:53:


 It'd be nice if we could slim down the CAM stack a bit first; it makes
 embedding it on the smaller devices really freaking painful.
AR /me never seen embedded devices with ATA/SATA and less than 64MB of RAM.
AR (i386/i486 old machines does not count :) )
AR I'm missing something?
 Yes:  USB  UMASS. It uses CAM too, and useful for very small systems,
 like  4MiB  FLASH  and 16MiB RAM (yes, whole system image, kernel and
 all, should be packed to 4MiB).

 Please note, Adrian speaks about CAM, not only CAM + ATA.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

9.1-STABLE, live lock up, seems that it is ZFS lockup in zfskern{txg_thread_enter} state tx-tx

2013-01-31 Thread Lev Serebryakov
Hello, freebsd-fs.

  I have 9.1-STABLE (r244958) system, amd64, 8GiB memory.

  Two SATA disks, 750Gb each.

  Disks are partitoned into 7 (BSD) partitons (exactly the same), 5 of
 these pairs are joined into gmirrors for system FSes (UFS2), one
 pair is used for swaps and 7th pair is used as zmirror for /usr/home.

   Tonight system becomes unusable, as every process which try to read
 directories in /usr/home (like ls ~ or find /usr/home -type f)
 hangs forever. I could login to system, login shell starts, but if I
 run ls right after -- it hangs. Every periodic process, which try
 to read home FS (directories, not files!) hangs. It looks, like
 stat() calls on this FS hangs, but not open()/read()/write()/close().

  One thing I fins suspicious in different system diagnostics, is
  kernel thread zfskern{txg_thread_enter} which is shown in state
  tx-tx forever.

  Disks looks completely OK according to smartd/smartctl, no hardware
 errors in dmesg, etc.

===
# zpool status
  pool: pool
 state: ONLINE
status: The pool is formatted using a legacy on-disk format.  The pool can
still be used, but some features are unavailable.
action: Upgrade the pool using 'zpool upgrade'.  Once this is done, the
pool will no longer be accessible on software that does not support 
feature
flags.
  scan: resilvered 32.1G in 0h34m with 0 errors on Sat Jun  2 16:22:59 2012
config:

NAME STATE READ WRITE CKSUM
pool ONLINE   0 0 0
  mirror-0   ONLINE   0 0 0
ada0s1h  ONLINE   0 0 0
ada1s1h  ONLINE   0 0 0

errors: No known data errors



-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: svn - but smaller?

2013-01-24 Thread Lev Serebryakov
Hello, Peter.
You wrote 24 января 2013 г., 3:05:16:

PW Its not about static linking its embedded subversion libraries.  I'm
  This  port  will  link  statically EVERYTHING, what gets you PACKAGE
without dependencies.

PW complaining about things like gdbm and bdb via apr, build dependencies
  bdb abd gdbm is optional.
PW like both python and perl for apr, and so on.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: svn - but smaller?

2013-01-24 Thread Lev Serebryakov
Hello, 'Jeremy.
You wrote 24 января 2013 г., 12:57:17:


JC to install Subversion.  If you want to pull down ports/ you can use
JC portsnap and waste lots of /var space, hoping that the portsnap mirrors
JC are up to date, and a bunch of other hullabaloo...
   In case of csup, you relies that the cvs mirrors are up to date.
 And  what about /var space... svn spends much more space in
 /usr/ports itself (.svn directory) than portsnap does (now my
 /var/db/portsnap directory is 95MiB, and .svn for ports will be
 comparable with size of ports itself!).

   I personally (maintainer of subversion port!) prefer csup over all
 other methods for non-developers systems too, and I'll be happy to
 see svnup when (if?) it will be created...

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: svn - but smaller?

2013-01-23 Thread Lev Serebryakov
Hello, Chris.
You wrote 24 января 2013 г., 1:25:44:

CR Great idea;
CR http://www.bayofrum.net/~crees/patches/svn-static.diff
 I think, adding SERF or NEON (what is smaller) is good idea, or this
build will lack http support, and it could be surprise to user, as
http access method is well-know and useful in case of corporate
firewalls.

CR Lev, do you mind if I commit this?  I haven't touched the subversion
CR port, but it'll have you as maintainer :)
 Ok :)

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: Does / Is anyone maintaining CVS for FreeBSD?

2013-01-03 Thread Lev Serebryakov
Hello, Matthew.
You wrote 3 января 2013 г., 22:21:16:

 I'm a bit reluctant to installing svn on every system that needs source
 updates. Are there more lightweight ways?

MS freebsd-update(8)
 It says (on 9-STABLE):

 The freebsd-update tool is used to fetch, install, and rollback binary
 updates to the FreeBSD base system.  Note that updates are only available
 if they are being built for the FreeBSD release and architecture being
 used; in particular, the FreeBSD Security Team only builds updates for
 releases shipped in binary form by the FreeBSD Release Engineering Team,
 e.g., FreeBSD 7.3-RELEASE and FreeBSD 8.0-RELEASE, but not FreeBSD
 6.3-STABLE or FreeBSD 9.0-CURRENT.

 So,  as  far  as  I understand, it could not be used to track -STABLE
branch, as it was possible with csup. Nothing is say about possibility
to update src on stable branch with it. Is it possible and man page
needs to be updated?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: Does / Is anyone maintaining CVS for FreeBSD?

2013-01-03 Thread Lev Serebryakov
Hello, Matthew.
You wrote 4 января 2013 г., 0:39:33:

MS Ah. Yes, you are right.  You can't track a stable branch with
MS freebsd-update.  In that case, svn is the way to go.
 And  even  as  developer  I  don't  like this situation. My developer
systems have and could use svn for sure, but servers? csup was very
handy for non-developers machines.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

/var/account/acct gorws indefinitely: Does /etc/peridoic/daily/310.accounting work properly?

2012-11-25 Thread Lev Serebryakov
Hello, Freebsd-stable.

 I have accounting_enable=YES in /etc/rc.conf and:

daily_accounting_enable=YES
daily_accounting_compress=YES
daily_accounting_flags=-m
daily_accounting_save=365

in /etc/periodic.conf

It packs daily logs, but it looks like main log (/var/account/acct) is
not tuncated at all. It is 30M now and every day I got monotonically
increasing numbers in daily mail.

 Is it Ok, and it is as it should be? I've thought, log rotation
should restart log every day and I should get _Daily_ resource usage
by user in daily mail...

 If it is Ok, is it possible to switch behavior to expected by me
without code editing?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: [releng_9_1 tinderbox] failure on powerpc64/powerpc

2012-11-04 Thread Lev Serebryakov
Hello, George.
You wrote 5 ноября 2012 г., 0:07:00:

GM Gosh, I'm SO looking forward to depending on svn instead of csup for
GM software updates.-- George
 It is planned server outage (migration).


-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

FreeBSD 9-STABLE: sh /etc/rc autoboot could not finish

2012-05-19 Thread Lev Serebryakov
Hello, Freebsd-stable.

I've noticed, that after rebuilding system (fresh 9-STABLE, rebuild to
get latest ffs MFCs) something strange happens on boot:


root@blob:/ # ps -ax | grep rc
   18  v0- IE+   0:00,04 sh /etc/rc autoboot
 1937   0  S+0:00,00 grep rc
root@blob:/ # uptime
 0:08  up 33 mins, 1 user, load averages: 0,00 0,00 0,00
root@blob:/ #

  What happens? Why /etc/rc could not finish?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


What is actual status of SUJ in 9-STABLE?

2012-03-29 Thread Lev Serebryakov
Hello, Freebsd-fs.

  My server crashed today morning due to PSU failure, and now it is
checking (in foreground!) 8Tb UFS2+SU volume for 6200 seconds, and it
is only Phase 1b (!!!). I don't want even think about background
check of this FS.

  Is SUJ stable enough to migrate to it? It was marked as stable some
time ago, and was included into 9-RELEASE, but later I seen some
messages on fs@ list, that it still has some problems, and even some
references to McKusick's message about this instability (but I've failed
to find message itself).

  BTW, this check reveals many softupdate inconsistences (mostly DUPs), and 
most of
them are in files, which was not written for sure in time of crash (old
archives, which could be only read!).

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server

2011-12-19 Thread Lev Serebryakov
Hello, Samuel.
You wrote 15 декабря 2011 г., 16:32:47:

 Other benchmarks in the Phoronix suite and their representations are
 similarly flawed, _ALL_ of these results should be ignored and no time
 should be wasted by any FreeBSD committer further evaluating this
 garbage. (Yes, I have been down this rabbit hole).
  Here is one problem: we have choice from three items:

(1) Make FreeBSD looks good on benchmarks by fixing FreeBSD

(2) Make FreeBSD looks good on benchmarks by fixing Phoronix
(communication with them, convincing, that they benchamrks are unfare
/ meaningless, ets)

(3) Lose [potential] userbase.

  You know, that these benchmarks are bad. I know. But potential (and
 even some current!) user doesn't. And it seems, that these benchmarks
 become popular over Internet.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server

2011-12-19 Thread Lev Serebryakov
Hello, Adrian.
You wrote 16 декабря 2011 г., 20:43:27:

 Guys/girls/fuzzy things - this is 2011; people look at shiny blog
 sites with graphs rather than mailing lists. Sorry, we lost that
 battle. :)
  My thoughts exactly.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8.2 + apache == a LOT of sigprocmask

2011-11-17 Thread Lev Serebryakov
Hello, Kostik.
You wrote 17 ноября 2011 г., 11:49:09:

 High-tech solution is to link with libunwind and add code into sigprocmask()
 to gather the stacks. But I expect that gdb attach is enough.
 Proper high-tech solution is to use DTrace. It is very food in such
 things.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: gmirror+gjournal often makes inconsistens file systems

2011-09-09 Thread Lev Serebryakov
Hello, Eugene.
You wrote 9 сентября 2011 г., 9:17:06:

 # fsck -t ffs -y /dev/mirror/gm0.journals1e
  I may be wrong, but I've encountered strong advice not
 to gjournal whole disk, but make gjournal on per-FS basis, many times.
 And it seems, that your first create big journal, and splice/partition/newfs
 it for several FSes.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: gmirror+gjournal often makes inconsistens file systems

2011-09-09 Thread Lev Serebryakov
Hello, Eugene.
You wrote 9 сентября 2011 г., 13:40:51:

 # fsck -t ffs -y /dev/mirror/gm0.journals1e
   I may be wrong, but I've encountered strong advice not
  to gjournal whole disk, but make gjournal on per-FS basis, many times.
  And it seems, that your first create big journal, and splice/partition/newfs
  it for several FSes.
 Yes, I did. Shoud not this kind of partitioning work too?
  I'm not sure, should or should not it work. But it is common
answer/advice in mailing lists not to do so and to use one gjournal per
FS.
  I think, freebsd-fs@ could give more qualified answer.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: Please, MFC r204087

2011-07-18 Thread Lev Serebryakov
Hello, Andriy.
You wrote 18 июля 2011 г., 14:06:14:

   I've got panics, related to race, fixed in r204087, every second
 reboot on my 8-STABLE. This patch fixed them all.
  Applying custom patch after each update is painful.
 You would get a better a chance of anyone looking into your request if you
 provided a link to the commit or the commit log.
 Just saying...
  Really, message was sent to committer too. But here is a links:

http://svnweb.freebsd.org/base?view=revisionrevision=204087

Log Message:
Fix a race in regard of p_numthreads.


-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Please, MFC r204087

2011-07-16 Thread Lev Serebryakov
Hello, Freebsd-stable.

  I've got panics, related to race, fixed in r204087, every second
reboot on my 8-STABLE. This patch fixed them all.

 Applying custom patch after each update is painful.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


How to understand, what userland program does in kernel?

2011-05-04 Thread Lev Serebryakov
Hello, Freebsd-stable.

  I have userland program (transmission BT client), which spent 100%
of one core of E4500 CPU when it has many peers. It is surprises me,
as channel is only 35Mbit, and my Linux friends can upload much more
on comparable hardware.

  But what surprises me even more, that 50% of this time it spends as
System time.

  Is here any way to understand, what transmission does in kernel for
so much time? It seems, that userland profiling doesn't help me, am I
right?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: How to understand, what userland program does in kernel?

2011-05-04 Thread Lev Serebryakov
Hello, Lev.
You wrote 4 мая 2011 г., 16:49:01:

   I have userland program (transmission BT client), which spent 100%
 of one core of E4500 CPU when it has many peers. It is surprises me,
 as channel is only 35Mbit, and my Linux friends can upload much more
 on comparable hardware.
   But what surprises me even more, that 50% of this time it spends as
 System time.
  When it spents, says, 75% of one core, SYSTEM is only 1-2%, not
 75%/2 =~ 37%, what is interesting...

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Backup tool fot ZFS with all classic dump(8) fetatures -- what should I use? (or is here any way to make dump -L works well on large FFS2+SU?)

2011-03-28 Thread Lev Serebryakov
Hello, Freebsd-stable.

  Now I'm backing up my HOME filesystem with dump(8). It works
perfectly for 80GiB FS with many features: snapshot for consistency,
levels, nodump flag (my users use it a lot!), ability to extract
only one removed file from backup without restoring full FS, simple
sctipy wrap-up for levels schedule, etc.

  On new server I  have huge HOME (500GiB). And even if it is filled
up only with 25GiB of data, creating snapshot takes about 10 minutes,
freeze all I/O, and sometimes FAILS (!!!).

  I'm thinking to transfer GOME filesystem to ZFS. But I can not find
appropriate tools for backing it up. Here is some requirements:

 (1) One-file (one-stream) backup. Not directory mirror. I need to
 store it on FTP server and upload with single command.

 (2) Levels  increment backups. Now I have Monthly (0) - Weekly
(1,2,3) - daily (4,5,6,7,8,9) scheme. I could afford other schemes,
but if they doesn't store full backup every day and doesn't need full
backup more often than weekly.

 (3) Minimum of local metadata. Storing previous backups locally to
 calculate next one is not appropriate solution. zfs send needs
 previous snapshots for incremental backup, for example.

 (4) Working with snapshot (I think, it is trivial in case of ZFS).

 (5) Backup exclusions should be controlled by users (not super-user) 
themselves,
 like nodump flag in case of FFS/dump(8). zfs send can not
 provide this. I have very responsible users, so full backup
 now takes only up to 10GiB when all HOME FS is about 25GiB, so it
 is big help when backup is sent over Internet to other host.

 (6) Storing of ALL FS-specific information -- ACLs, etc.

 (7) Free :)

  Is here something like this for ZFS? zfs send looks promising,
 EXCEPT item (5) and, maybe, (3) :(

   gnu tar looks like everything but (6) :(

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0 with latest driver hangs again and again (without Watchdogtimeout message!)

2011-03-05 Thread Lev Serebryakov
Hello, Steven.
You wrote 5 марта 2011 г., 3:06:32:

 Silly question but have you checked your ram for issues, we had a machine
 with seemingly unexplained problems and hangs and it turned out to be
 a duff stick of ram which wasn't being chip killed.
  Yes, two full days (48h) of memtest86+ -- no problems...

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-03-03 Thread Lev Serebryakov
Hello, Arnaud.
You wrote 2 марта 2011 г., 9:55:50:

 I have been running with 7.2.2 and so far so good.  However, its hard to
 say in my case as the box I would only periodically see the issue.
  As I wrote to Jack, my NIC hangs today with 7.2.2
 Do you have any detailed error ? What the output of sysctl dev.em.X
 where X is the index of the hung interface ?
  One more hang. Two logs are attached.

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

em0.7.2.2.hang1.log
Description: Binary data


em0.7.2.2.hang2.log
Description: Binary data
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-03-03 Thread Lev Serebryakov
Hello, Brandon.
You wrote 3 марта 2011 г., 17:08:26:

 I see that you have CRC errors:
 dev.em.0.mac_stats.crc_errs: 156
 and receive errors:
 dev.em.0.mac_stats.recv_errs: 147
 You probably have a hardware problem. Is this the only machine on
 which you're experiencing the problem?
 It is only machine with Intel NIC in my network. I'll try to replace
patchcord...


-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-03-03 Thread Lev Serebryakov
Hello, Brandon.
You wrote 3 марта 2011 г., 17:08:26:

 I see that you have CRC errors:
 dev.em.0.mac_stats.crc_errs: 156
 and receive errors:
 dev.em.0.mac_stats.recv_errs: 147
  It (almost) doesn't change. And it hangs again. It seems, that 7.2.2
 hangs more often than 7.1.9 on my hardware :(


-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-03-01 Thread Lev Serebryakov
Hello, Mike.
You wrote 1 марта 2011 г., 17:20:49:

 I have been running with 7.2.2 and so far so good.  However, its hard to
 say in my case as the box I would only periodically see the issue.
 As I wrote to Jack, my NIC hangs today with 7.2.2

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-02-23 Thread Lev Serebryakov
Hello, Freebsd-net.

  It's me again, as problem is not solved and no clear answer was
received.

  em0 NIC on my storage server hangs every several (2-3) days.
Symptoms are simple: no packets can be send, mbufs are overfilled, No
buf space to send error for any program.

Configuration now is VERY BASIC: no polling, no sysctls or
loader.conf tunables AT ALL. No jumbo frames.

  nic doesn't show any Watchdog timeout / resetting messages.

  Driver from em driver, 82574L chip, and possibly ASPM thread
 doesn't help, really: it seems, that it decrease frequincy of hangs,
 but doesn't eliminate them, but I can not say for sure, may be
 frequency change is only illusion, as it random process.

 I've added diagnostic patch from Michael Tuxen.

 System is cvsupped and built  Mon Feb 21, it is FreeBSD 8-STABLE
(RELENG_8).

  Hardware is:

em0@pci0:0:25:0:class=0x02 card=0x82681043 chip=0x10bd8086 rev=0x02 
hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82566DM Gigabit Ethernet Adapter (82566DM)'
class  = network
subclass   = ethernet
bar   [10] = type Memory, range 32, base 0xfeb4, size 131072, enabled
bar   [14] = type Memory, range 32, base 0xfeb7a000, size 4096, enabled
bar   [18] = type I/O Port, range 32, base 0xe880, size 32, enabled
cap 01[c8] = powerspec 2  supports D0 D3  current D0
cap 05[d0] = MSI supports 1 message, 64 bit
cap 09[e0] = vendor (length 6) Intel cap 2 version 0


  Output of ifconfig, vmstat -m, netstat -m, top -Snd 1, sysctl
dev.em.0 is attached.

  Interesting part of diagnostic sysctls:

dev.em.0.queue0.rxd_head: 896
dev.em.0.queue0.rxd_tail: 895
dev.em.0.queue0.rx_irq: 0
dev.em.0.queue0.rx_nxt_refresh: 896
dev.em.0.queue0.rx_nxt_check: 896

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

em0.log
Description: Binary data
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: em0 with latest driver hangs again and again (without Watchdog timeout message!)

2011-02-23 Thread Lev Serebryakov
Hello, Mike.
You wrote 23 февраля 2011 г., 14:16:28:

   Driver from em driver, 82574L chip, and possibly ASPM thread
  doesn't help, really: it seems, that it decrease frequincy of hangs,
 Looking at your sysctl output, you are not using the test drivers posted
 in that thread.
  Yes, as it doesn't help, I've reverted to stock one.

 If you want to try 7.1.9-test, you can download it at
 http://www.tancsa.com/if_em-8.c for releng_8.
  I've tried it. It has worked without hangs for 7-8 days, and after
that hangs 2 times in 3 days with 7.1.9-test  :(

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0 hangs without any messages like Watchdog timeout, only down/up reset it.

2011-02-07 Thread Lev Serebryakov
Hello, Mike.
You wrote 7 февраля 2011 г., 15:22:11:

   It hangs under load without any output. When it works with POLLING, it
 prints Watchdog timeout and reset automatically several times a day,
 but without POLLING it simply hangs with same frequency. It is
 8.2-PRERELEASE (from RELENG_8), cvsupped AFTER 22 Jan (last commit to
 e1000 drivers family).
 
   Locally system works, but mbufs are overfilled. ifconfig em0 down
  ifconfig em0 up solves problem.
 In non polling mode, do you have any special network or driver settings
 in /boot/loader.conf or /etc/sysctl.conf ?

/boot/loader.conf:
hw.em.rxd=4096
hw.em.txd=4096
net.link.ifqmaxlen=16384

/etc/sysctl.conf:
dev.em.0.rx_int_delay=200
dev.em.0.tx_int_delay=200
dev.em.0.rx_abs_int_delay=4000
dev.em.0.tx_abs_int_delay=4000
dev.em.0.rx_processing_limit=4096


   I'm trying to run with patch from em driver, 82574L chip, and
 possibly ASPM thread now under heavy network load.

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


em0 hangs without any messages like Watchdog timeout, only down/up reset it.

2011-02-06 Thread Lev Serebryakov
Hello, Freebsd-stable.


  My em0 (the same, copy'n'paste hardware info from previous
  mnessage):

em0@pci0:0:25:0:class=0x02 card=0x82681043 chip=0x10bd8086 rev=0x02 
hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82566DM Gigabit Ethernet Adapter (82566DM)'
class  = network
subclass   = ethernet
bar   [10] = type Memory, range 32, base 0xfea4, size 131072, enabled
bar   [14] = type Memory, range 32, base 0xfea79000, size 4096, enabled
bar   [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled
cap 01[c8] = powerspec 2  supports D0 D3  current D0
cap 05[d0] = MSI supports 1 message, 64 bit
cap 09[e0] = vendor (length 6) Intel cap 2 version 0

It is on-board LAN on Q35-based MoBo (ASUS P5E-VM DO)

  It hangs under load without any output. When it works with POLLING, it
prints Watchdog timeout and reset automatically several times a day,
but without POLLING it simply hangs with same frequency. It is
8.2-PRERELEASE (from RELENG_8), cvsupped AFTER 22 Jan (last commit to
e1000 drivers family).

  Locally system works, but mbufs are overfilled. ifconfig em0 down
 ifconfig em0 up solves problem.

 Output of different diagnostic tools (vmstat, netstat, ifconfig,
sysctl of dev.em.0 tree, top -S) are attached in one file.

  Early (about half year ago) this sytem works without any problems
 with net.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

net.hangup.log
Description: Binary data
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: em0: Watchdog timeout -- resetting

2011-02-01 Thread Lev Serebryakov
Hello, Freebsd-stable.
You wrote 1 февраля 2011 г., 10:24:16:

   And all connections are reset. Before latest commits to driver
 this system paniced in swi_clock. Now it works without panics, but
 seems, that problem is not fixed completely.
  I forgot to give one last pice of information: POLLING is in action.
Without it single thread copy from this server via SMB eats one core
of CPU completely.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0: Watchdog timeout -- resetting

2011-02-01 Thread Lev Serebryakov
Hello, Eugene  Jack.
You wrote 1 февраля 2011 г., 11:23:23:

Eugene wrote:
 You could give a try to netisr parallelism of RELENG_8 instead of POLLING
 (and tune interrupt throttling) if your box does not have lots of dynamic
 interfaces like when using mpd.

Jack wrote:
 I don't test POLLING, sounds like its broken, I don't understand
 why you think you need you need it?  This hardware supports
 MSI why not use it?

  I send one answer to two messages, because data is the same.

  Here it is snapshot of top -S with H pressed when server sends
1Gbit/s via SMB with polling (Windows'7 client copies 8GiB sparse file to very
fast local disk):


= POLLING
CPU:  0.5% user,  0.0% nice,  0.6% system,  1.3% interrupt, 98.1% idle
  PID USERNAME PRI NICE   SIZERES STATE   C   TIME   WCPU COMMAND
   11 root 171 ki31 0K32K CPU11  90.1H 100.00% {idle: cpu1}
   11 root 171 ki31 0K32K RUN 0  82.1H 100.00% {idle: cpu0}
   12 root -64- 0K   304K WAIT0  33:40  0.68% {irq18: uhci2 
ehc}
   12 root -44- 0K   304K WAIT1 225:22  0.00% {swi1: netisr 
0}
   14 root -68- 0K   528K -   1  16:19  0.00% {usbus3}
   12 root -40- 0K   304K WAIT0  14:25  0.00% {swi2: cambio}
   12 root -64- 0K   304K WAIT1  12:50  0.00% {irq22: ahci0}
4 root  -8- 0K16K -   0  12:26  0.00% g_down
= POLLING
NB: no smbd process at all in first 8 positions.
Real speed (accroding to Windows'7 report) ~75MiB/s.


  the same without polling, with net.isr settings:
# sysctl net.isr
net.isr.numthreads: 1
net.isr.maxprot: 16
net.isr.defaultqlimit: 256
net.isr.maxqlimit: 10240
net.isr.bindthreads: 0
net.isr.maxthreads: 1
net.isr.direct: 0
net.isr.direct_force: 0

= INTR - ISR.DIRECT=0
CPU:  3.8% user,  0.0% nice, 26.5% system,  6.6% interrupt, 63.2% idle
  PID USERNAME PRI NICE   SIZERES STATE   C   TIME   WCPU COMMAND
   11 root 171 ki31 0K32K RUN 0  82.1H 83.59% {idle: cpu0}
   11 root 171 ki31 0K32K RUN 1  90.1H 64.06% {idle: cpu1}
33873 root  720 28912K  5432K select  0   0:28 34.96% smbd
   12 root -44- 0K   304K WAIT0 225:29  9.18% {swi1: netisr 
0}
0 root -680 0K   128K -   1   0:02  6.30% {em0 taskq}
   12 root -68- 0K   304K WAIT0   0:00  1.56% {irq20: em0 
fwohc}
7 root  44- 0K16K psleep  0   3:12  0.39% pagedaemon
   12 root -64- 0K   304K WAIT1  33:41  0.20% {irq18: uhci2 
ehc}
   14 root -68- 0K   528K -   0  16:19  0.00% {usbus3}
   12 root -40- 0K   304K WAIT0  14:25  0.00% {swi2: cambio}
= INTR - ISR.DIRECT=0
Real speed (accroding to Windows'7 report) ~85MiB/s.

  the same without polling, with net.isr settings:
# sysctl net.isr
net.isr.numthreads: 1
net.isr.maxprot: 16
net.isr.defaultqlimit: 256
net.isr.maxqlimit: 10240
net.isr.bindthreads: 0
net.isr.maxthreads: 1
net.isr.direct: 1
net.isr.direct_force: 1

= INTR - ISR.DIRECT=1
CPU:  2.8% user,  0.0% nice, 30.1% system,  1.7% interrupt, 65.4% idle
  PID USERNAME PRI NICE   SIZERES STATE   C   TIME   WCPU COMMAND
   11 root 171 ki31 0K32K RUN 1  90.2H 89.36% {idle: cpu1}
   11 root 171 ki31 0K32K RUN 0  82.2H 67.87% {idle: cpu0}
33873 root 1030 28912K  5424K CPU00   0:51 33.98% smbd
0 root -680 0K   128K -   1   0:06 12.70% {em0 taskq}
   12 root -68- 0K   304K WAIT0   0:01  1.66% {irq20: em0 
fwohc}
7 root  45- 0K16K psleep  0   3:12  0.78% pagedaemon
   12 root -64- 0K   304K WAIT0  33:42  0.20% {irq18: uhci2 
ehc}
   12 root -44- 0K   304K WAIT1 225:33  0.00% {swi1: netisr 
0}
   14 root -68- 0K   528K -   1  16:20  0.00% {usbus3}
   12 root -40- 0K   304K WAIT0  14:25  0.00% {swi2: cambio}
= INTR - ISR.DIRECT=1
Real speed (accroding to Windows'7 report) ~101MiB/s.

  I've re-created file to flush caches on both sides between trys.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: em0: Watchdog timeout -- resetting

2011-02-01 Thread Lev Serebryakov
Hello, Eugene.
You wrote 1 февраля 2011 г., 16:52:57:

 = INTR - ISR.DIRECT=1
 Real speed (accroding to Windows'7 report) ~101MiB/s.
   I've re-created file to flush caches on both sides between trys.

 netisr queues help to deal with lots of incoming traffic.
 If you bother about outgoing traffic only, it won't help.
 This server is mostly-R/O storage server, so I bother about outgoing
 traffic.

 And now, after switching polling off  experiments, it is lost --
 about 30 minutes after experiments it stops answer on pings and
 other network activity. I'll be near local console only at night to
 report panic or something else.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


em0 lock up / hangs (WAS: em0: Watchdog timeout -- resetting)

2011-02-01 Thread Lev Serebryakov
Hello, Eugene.
You wrote 1 февраля 2011 г., 15:38:33:

 Eugene wrote:
 You could give a try to netisr parallelism of RELENG_8 instead of POLLING
 (and tune interrupt throttling) if your box does not have lots of dynamic
 interfaces like when using mpd.

 Jack wrote:
 I don't test POLLING, sounds like its broken, I don't understand
 why you think you need you need it?  This hardware supports
 MSI why not use it?

   I send one answer to two messages, because data is the same.

   Here it is snapshot of top -S with H pressed when server sends
 1Gbit/s via SMB with polling (Windows'7 client copies 8GiB sparse file to very
 fast local disk):
   the same without polling, with net.isr settings:
 # sysctl net.isr
 net.isr.direct: 0
 net.isr.direct_force: 0
  After these settings server lost connection. It works locally, no
 panic, but ping gateway shows No buffer space available, and any
 other network activity shows the same message.

 Up-down of interface helps.

 I attached outputs of:

 vmstat -m
 netstat -m
 sysctl dev.em0

 BEFORE interface reset

  No polling, net.isr.direct=0, net.isr.direct_force=0

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

sysctl.dev.em0.log
Description: Binary data


vmstat-m.log
Description: Binary data


netstat-m.log
Description: Binary data
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

Re: 8-STABLE/amd64 semi-regular crash with kernel trap 12 with interrupts disabled in process 12 (swi4: clock)

2011-02-01 Thread Lev Serebryakov
Hello, Adam.
You wrote 1 февраля 2011 г., 21:59:31:

 Did it help the problem?  I think I saw a related panic today so I'm
 going to try updating past the time this was MFC'ed to 8 which I think
 was Sat Jan 22 01:34:08 2011 UTC (10 days, 17 hours ago).  Thanks.
 It doesn't crash anymore, but my em0 has wathcdog timeout sometimes
(See other thread here).

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


em0: Watchdog timeout -- resetting

2011-01-31 Thread Lev Serebryakov
Hello, Freebsd-stable.

  System is 8-STABLE (8.2-PRERELEASE) with very last e1000 driver
(cvsupped 27 Jan, last commits to e1000 were done 22 Jan).

  NIC is:

em0: Intel(R) PRO/1000 Network Connection 7.1.9 port 0xdc00-0xdc1f mem 
0xfea4-0xfea5,0xfea79000-0xfea79fff irq 20 at device 25.0 on pci0
em0: No MSI/MSIX using a Legacy IRQ
em0: [FILTER]

em0@pci0:0:25:0:class=0x02 card=0x82681043 chip=0x10bd8086 rev=0x02 
hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82566DM Gigabit Ethernet Adapter (82566DM)'
class  = network
subclass   = ethernet
bar   [10] = type Memory, range 32, base 0xfea4, size 131072, enabled
bar   [14] = type Memory, range 32, base 0xfea79000, size 4096, enabled
bar   [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled

 It is on-board LAN on ASUS P5R-VM DO MoBo (Q35 chipset).

 I have these tunables in /etc/loader.conf

hw.em.rxd=4096
hw.em.txd=4096


 And these non-standard sysctls:

dev.em.0.rx_int_delay=200
dev.em.0.tx_int_delay=200
dev.em.0.rx_abs_int_delay=4000
dev.em.0.tx_abs_int_delay=4000
dev.em.0.rx_processing_limit=4096

 Several times a day I got messages like this:

em0: Watchdog timeout -- resetting
em0: Queue(0) tdh = 1302, hw tdt = 1265
em0: TX(0) desc avail = 31,Next TX to Clean = 1296

em0: Watchdog timeout -- resetting
em0: Queue(0) tdh = 3999, hw tdt = 3959
em0: TX(0) desc avail = 31,Next TX to Clean = 3990

em0: Watchdog timeout -- resetting
em0: Queue(0) tdh = 1431, hw tdt = 1394
em0: TX(0) desc avail = 31,Next TX to Clean = 1425

  And all connections are reset. Before latest commits to driver
this system paniced in swi_clock. Now it works without panics, but
seems, that problem is not fixed completely.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8-STABLE/amd64 semi-regular crash with kernel trap 12 with interrupts disabled in process 12 (swi4: clock)

2011-01-20 Thread Lev Serebryakov
Hello, Eugene.
You wrote 19 января 2011 г., 12:50:25:

 Yes, I've missed it's PRERELEASE already.
 Backtrace points to the problem in em_local_timer() fixed in CURRENT
 7 days ago, take a look:
 http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/e1000/if_em.c#rev1.65
 I run my servers with this commit backported manually as
 it has not been MFC'd yet.
  Ok, I'll try it (rebuilding system now).

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8-STABLE/amd64 semi-regular crash with kernel trap 12 with interrupts disabled in process 12 (swi4: clock)

2011-01-19 Thread Lev Serebryakov
Hello, Eugene.
You wrote 19 января 2011 г., 0:30:09:

 You have not mentioned what tasks does it perform.
  Storage of all my data with software RAID5 + torrent-box for
 25Mibt/s connection/

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8-STABLE/amd64 semi-regular crash with kernel trap 12 with interrupts disabled in process 12 (swi4: clock)

2011-01-19 Thread Lev Serebryakov
Hello, Jeremy.
You wrote 19 января 2011 г., 0:46:54:

 CC'ing Jack Vogel of Intel, as this looks like it could be something the
 em(4) driver might be tickling.  I do see it in the stack trace shortly
 before the crash.  In the interim, can you please provide output from the
 following command:
 # pciconf -lbcv
 And include only the entries relevant to your emX devices.
em0@pci0:0:25:0:class=0x02 card=0x82681043 chip=0x10bd8086 rev=0x02 
hdr=0x00
vendor = 'Intel Corporation'
device = 'Intel 82566DM Gigabit Ethernet Adapter (82566DM)'
class  = network
subclass   = ethernet
bar   [10] = type Memory, range 32, base 0xfea4, size 131072, enabled
bar   [14] = type Memory, range 32, base 0xfea79000, size 4096, enabled
bar   [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled
cap 01[c8] = powerspec 2  supports D0 D3  current D0
cap 05[d0] = MSI supports 1 message, 64 bit
cap 09[e0] = vendor (length 6) Intel cap 2 version 0

It is on-board LAN on Q35-based MoBo (ASUS P5E-VM DO)

 As for the the server refuses to auto-reboot: that may be a separate
 problem.  You might try toggling the hw.acpi.disable_on_reboot and
 hw.acpi.handle_reboot sysctls (check what values they have on your
 system first) to see if there's any improvement.
  Both are zero. BTW, manual reboots (reboot  shutdown -r now) and
shutdowns (shutdown -p now) works perfectly Ok.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8-STABLE/amd64 semi-regular crash with kernel trap 12 with interrupts disabled in process 12 (swi4: clock)

2011-01-19 Thread Lev Serebryakov
Hello, Eugene.
You wrote 19 января 2011 г., 11:44:01:

 There is known instability in em(4) driver in 8.2-RELEASE,
 it may panic due to some lack of NULL pointer checks.
 You should update to RELENG_8 containting fix and retest.
 uname -v
 FreeBSD 8.2-PRERELEASE #5: Sat Jan  8 14:38:46 MSK 2011

 It is built about hour after cvsup.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: i386/153947: Make buildworld fails in hastd/token.c

2011-01-16 Thread Lev Serebryakov
Hello, Angelo.
You wrote 13 января 2011 г., 18:27:37:

 I can confirm it happens also on this STABLE build:
 FreeBSD 8.1-STABLE #1: Tue Oct  5 14:02:34 CEST 2010
 Same on 8.1-RELEASE/amd64.
 And everything were Ok about 5 days ago.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


geom_label, fstab without device names swap partition?

2011-01-12 Thread Lev Serebryakov
Hello, Stable.

  Now, with newfs -L name, geom_label and /dev/ufs/* it is possible
to not use device names for FSes in /etc/fstab at all. But what to
do with swap partitions? How to say, that I want swap on
/dev/ada0s1b or /dev/ad0s1b whatever name it has now?

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8.2-PRERELEASE: live deadlock, almost all processes in pfault state

2011-01-08 Thread Lev Serebryakov
Hello, Kostik.
You wrote 8 января 2011 г., 22:02:32:


 There is some weird backtrace at the pid 20, what is g_raid5 ?
  It is geom_raid5, with two threads -- working one and one for
 processing finished bios.

 If I am guessing right, this creature has a classic deadlock when 
 bio processing requires memory allocation. It seems that tid 100079
  tid 100079 sleep in waiting for some data in queue.

 is sleeping not even due to the free page shortage, but due to address
 space exhaustion. As result, read/write requests are stalled.
  tid 100078 sleep in malloc(). But geom_raid5 never ever allocate
 more than 128MiB of memory and it is 64bit system with huge amount of
 kmem_size/kmem_size_max...

  How could I explore allocation (like vmstat -m) from kdb to be sure,
it doesn't allocated more?

  And, if it is classic deadlock is here any classical solution to
it?

  Really, I'm maintainer of geom_raid5 now, so I need fix this
deadlock, but I don't really understand, why does it occur? I've
hit panic with kernel memory exhausted symptoms when module allocate
too much, but not deadlock :(

 Then, syncer is blocked waiting for some physical buffer (look at tid
 100075), owning the vnode lock. Other processes also wait for the
 locked buffers, etc.

 So my belief is that this is plain driver (g_raid5, whatever is it)
 i/o loss. Try the same load without it.
  I can not, because all data is on this GEOM :)

-- 
// Black Lion AKA Lev Serebryakov l...@serebryakov.spb.ru

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8.2-PRERELEASE: live deadlock, almost all processes in pfault state

2011-01-08 Thread Lev Serebryakov
Hello, Kostik.
You wrote 8 января 2011 г., 22:02:32:


 If I am guessing right, this creature has a classic deadlock when
 bio processing requires memory allocation. It seems that tid 100079
 is sleeping not even due to the free page shortage, but due to address
 space exhaustion. As result, read/write requests are stalled.
  I want to say, that ZFS, for example, could allocate much more
memory, and, yes, it had problems on i386 with this, but not on amd64,
AFAIK...

  So, I'm (geom_radi5) doing something wrong...

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8.2-PRERELEASE: live deadlock, almost all processes in pfault state

2011-01-08 Thread Lev Serebryakov
Hello, Kostik.
You wrote 8 января 2011 г., 22:56:13:


   And, if it is classic deadlock is here any classical solution to
 it?
 Do not allocate during bio processing.
 So, if GEOM need some cache, it needs pre-allocate it and implements
custom allocator over allocated chunk? :(

 And what is bio processing in this context? geom_raid5 puts all
bios into the (private, internal) queue and geom_start() exits
immediately, and bio could spend rather long time in queue (if it is
write request) before it will be sent to underlying provider. And,
yes, it could be combined with other bios to form new one (why
allocation of new bio is needed).

 So, is bio processing a whole time before bio is complete, or only
geom_start() call or what?

 Also, RAID5 needs to read data (other stripes) and write data (new
checksum) when write bio is processed. BTW, system geom_raid3 and
geom_vinum (with raid5 volume) need to do the same to maintain
checksums, so they could deadlock (in theory) too, if problem is
allocate memory during bio processing. And geom_mirror needs
allocate bio for second (third, ...) component on every write...

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: 8.2-PRERELEASE: live deadlock, almost all processes in pfault state

2011-01-08 Thread Lev Serebryakov
Hello, Kostik.
You wrote 8 января 2011 г., 23:20:28:

And, if it is classic deadlock is here any classical solution to
  it?
  Do not allocate during bio processing.
  So, if GEOM need some cache, it needs pre-allocate it and implements
 custom allocator over allocated chunk? :(
 
  And what is bio processing in this context? geom_raid5 puts all
 bio processing == whole time needed to finish pageout. Pageout is
 often performed to clean the page to lower the page shortage.
 If pageout requires more free pages to finish during the shortage,
 then we get the deadlock.
  Ok, and transmission mmap() files on geom_raid5, so when these pages
are paged out, and geom_raid5 asks for other pages, and there is no
free ones... I see. It seems, that M_NOWAIT flag should help, if
geom_raid5 could live with failed mallocs...

 Also, it seems that you allocate not only bios (small objects, not
 every request cause page allocation), but also the huge buffers, that
 require free pages each time.
  Yes, in worst case RAID5 need a lot of additional memory to perform
 simple write. If it is lone write (geom_raid5 waits some time for
 writes in adjacent areas, but not forever), geom_raid5 need to read
 (Number of disks - 1) x (size of write) bytes of data to re-calculate
 checksum. And it need buffers for this data. Worst case for 5-disks
 RAID5 and 128KiB write will be 4x128KiB = 512KiB of buffers. For one
 128KiB write. And I don;t understand how to avoid deadlock here :(
 Maybe, preallocating some memory at start (these 512KiB) and try to
 use them when malloc() failed...

  I need to look how raid3 and vinum/raid5 lives with that situation.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


FreeBSD 8.2-PRERELEASE hangs under load with live kernel

2011-01-06 Thread Lev Serebryakov
Hello, Freebsd-stable.

 I've  added  torrent  client  (transmission)  to  software on my home
 server  and it starts to hang in very unusual way: kernel works but
 userland doesn't.

   I can ping it (and it answers). I can scroll console with
 scrolllock button and keys. I can break into debugger with
 Ctrl+SysReq and it shows, that one CPU is occupied by idle process and
 other by Giant tasq, but no userland processes answer: I can not
 ssh to it, I cannot login on console, samba is dead, etc.

   ps in kernel debugger shows, that many of processes in pfault
 state, and noting more special.

   memtest86+ doesn't show any errors after 8 passes of tests (about
 10 hours), so RAM looks Ok.

   What should I do in kdb to understand what happens?

   Kernel config and /var/run/dmesg.boot is attached.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

BLOB
Description: Binary data


dmesg.boot
Description: Binary data
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org

smartmontools 5.40 ahci.ko -- doesn't work

2010-12-03 Thread Lev Serebryakov
Hello, Stable.

  Latest  smartmontools  5.40  doesn't  work  with AHCI driver :( I've
  found  old  thread  about  5.38, but I have 5.40 and it doesn't work
  with any `-d' type...

  What do I do wrong?


# id
uid=0(root) gid=0(wheel) groups=0(wheel),5(operator)
# uname -srp
FreeBSD 8.2-PRERELEASE amd64
# ls /var/db/pkg | grep smart
smartmontools-5.40
# ls /dev/ada[0-9]
/dev/ada0   /dev/ada1   /dev/ada2   /dev/ada3   /dev/ada4   
/dev/ada5
blob# smartctl -A /dev/ada0
smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.2-PRERELEASE amd64] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net

/dev/ada0: No such file or directory
Smartctl: please specify device type with the -d option.

Use smartctl -h to get a usage summary
# smartctl -A -d ata /dev/ada0
smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.2-PRERELEASE amd64] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net

Smartctl: Device Read Identity Failed (not an ATA/ATAPI device)

A mandatory SMART command failed: exiting. To continue, add one or more '-T 
permissive' options.
# smartctl -A -d scsi /dev/ada0
smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.2-PRERELEASE amd64] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net

Smartctl open device: /dev/ada0 failed: No such file or directory
# smartctl -A -d atacam /dev/ada0
smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.2-PRERELEASE amd64] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net

Smartctl open device: /dev/ada0 failed: No such file or directory
#

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


WITHOUT_MODULES: does it work?

2010-09-17 Thread Lev Serebryakov
Hello, Freebsd-stable.

  I'm trying to build very small FreeBSD installation (8.1-STABLE) and
  trying  to  use  WITHOUT_MOUDLES=list on buildkernel stage. But it
  builds all modules anyway.

  Simple check shows that I do something wrong:

% cd /usr/src/sys/modules
%make -V SUBDIR | grep -l 3dfx
(standard input)
%make WITHOUT_MODULES=3dfx -V SUBDIR | grep -l 3dfx
(standard input)
%

  What do I do wrong?

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


Re: WITHOUT_MODULES: does it work?

2010-09-17 Thread Lev Serebryakov
Hello, Oliver.
You wrote 17 сентября 2010 г., 21:03:29:

 No, it doesn't.  WITHOUT_MODULES (note spelling) works fine.
  It was error in message, not in config file :(

 The following will make it clearer:
 Yep, my fault.

 And  I  found  why  it  doesn't  work  via NanoBSD build: quotes were
 excessive.

 Sorry for noise.

-- 
// Black Lion AKA Lev Serebryakov l...@freebsd.org

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org


  1   2   >