Re: need: port openvpn into osv

[Geraldo Netto]

Hello Maxul,

Waldek/Nadav might provide a more accurate information
but I don't think we have tap on OSv
which means we would need to port ourselves the implementation
I guess the easiest path is to borrow code from FreeBSD or any other
project with a permissive license (we cannot link GPL code on OSv)
and we probably need a Linux like API

Maybe those quick references can help you:
https://github.com/LaKabane/libtuntap
https://www.kernel.org/doc/Documentation/networking/tuntap.txt


Kind Regards,

Geraldo Netto
Sapere Aude => Non dvcor, dvco
http://exdev.sf.net/

On 27 April 2018 at 12:40,  wrote:

> Hi all,
>
> I enjoy the performance benefit of OSv, especially the No SpinLock and Van
> Jacobson implementation. I wish to establish the OSv image into the real
> cloud. My target app is OpenVPN. I try porting it into the OSv. OpenVPN
> deals with a tap device provided by Linux. Does anyone have any idea how to
> solve this?
>
> Best,
> Maxul
>
> --
> You received this message because you are subscribed to the Google Groups
> "OSv Development" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to osv-dev+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups "OSv 
Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to osv-dev+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Build failed in Jenkins: osv-build-nightly #1455

[jenkins]

See 


--
[...truncated 140.87 KB...]
Adding /tests/tst-resolve.so...
Adding /tests/tst-except.so...
Adding /tests/misc-tcp-sendonly.so...
Adding /tests/tst-tcp-nbwrite.so...
Adding /tests/misc-tcp-hash-srv.so...
Adding /tests/misc-loadbalance.so...
Adding /tests/misc-scheduler.so...
Adding /tests/tst-console.so...
Adding /tests/tst-app.so...
Adding /tests/misc-setpriority.so...
Adding /tests/misc-timeslice.so...
Adding /tests/misc-tls.so...
Adding /tests/misc-gtod.so...
Adding /tests/tst-dns-resolver.so...
Adding /tests/tst-fs-link.so...
Adding /tests/tst-kill.so...
Adding /tests/tst-truncate.so...
Adding /tests/misc-panic.so...
Adding /tests/tst-utimes.so...
Adding /tests/tst-utimensat.so...
Adding /tests/tst-futimesat.so...
Adding /tests/misc-tcp.so...
Adding /tests/tst-strerror_r.so...
Adding /tests/misc-random.so...
Adding /tests/misc-urandom.so...
Adding /tests/tst-commands.so...
Adding /tests/tst-threadcomplete.so...
Adding /tests/tst-timerfd.so...
Adding /tests/tst-nway-merger.so...
Adding /tests/tst-memmove.so...
Adding /tests/tst-pthread-clock.so...
Adding /tests/misc-procfs.so...
Adding /tests/tst-chdir.so...
Adding /tests/tst-chmod.so...
Adding /tests/tst-hello.so...
Adding /tests/misc-concurrent-io.so...
Adding /tests/tst-concurrent-init.so...
Adding /tests/tst-ring-spsc-wraparound.so...
Adding /tests/tst-shm.so...
Adding /tests/tst-align.so...
Adding /tests/tst-cxxlocale.so...
Adding /tests/misc-tcp-close-without-reading.so...
Adding /tests/tst-sigwait.so...
Adding /tests/tst-sampler.so...
Adding /tests/misc-malloc.so...
Adding /tests/misc-memcpy.so...
Adding /tests/misc-free-perf.so...
Adding /tests/tst-fallocate.so...
Adding /tests/misc-printf.so...
Adding /tests/tst-hostname.so...
Adding /tests/tst-sendfile.so...
Adding /tests/misc-lock-perf.so...
Adding /tests/tst-uio.so...
Adding /tests/tst-printf.so...
Adding /tests/tst-pthread-affinity.so...
Adding /tests/tst-pthread-tsd.so...
Adding /tests/tst-thread-local.so...
Adding /tests/tst-zfs-mount.so...
Adding /tests/tst-regex.so...
Adding /tests/tst-tcp-siocoutq.so...
Adding /tests/libtls.so...
Adding /tests/tst-tls.so...
Adding /tests/tst-select-timeout.so...
Adding /tests/tst-faccessat.so...
Adding /tests/tst-fstatat.so...
Adding /tests/misc-reboot.so...
Adding /tests/tst-fcntl.so...
Adding /tests/payload-namespace.so...
Adding /tests/tst-namespace.so...
Adding /tests/tst-without-namespace.so...
Adding /tests/payload-env.so...
Adding /tests/payload-merge-env.so...
Adding /tests/misc-execve.so...
Adding /tests/misc-execve-payload.so...
Adding /tests/misc-mutex2.so...
Adding /tests/tst-pthread-setcancelstate.so...
Adding /tests/tst-syscall.so...
Adding /tests/tst-pin.so...
Adding /tests/tst-run.so...
Adding /tests/tst-ifaddrs.so...
Adding /tests/tst-pthread-affinity-inherit.so...
Adding /tests/tst-sem-timed-wait.so...
Adding /tests/tst-ttyname.so...
Adding /tests/tst-pthread-barrier.so...
Adding /tests/tst-feexcept.so...
Adding /tests/tst-math.so...
Adding /tests/tst-sigaltstack.so...
Adding /tests/tst-fread.so...
Adding /tests/tst-tcp-cork.so...
Adding /tests/tst-tcp-v6.so...
Adding /tests/tst-calloc.so...
Adding /tests/tst-crypt.so...
Adding /tests/testrunner.so...
Adding /tests/tst-rename.so...
Adding /tests/tst-vfs.so...
Adding /tests/tst-libc-locking.so...
Adding /tests/misc-fs-stress.so...
Adding /tests/misc-bdev-write.so...
Adding /tests/misc-bdev-wlatency.so...
Adding /tests/misc-bdev-rw.so...
Adding /tests/tst-promise.so...
Adding /tests/tst-dlfcn.so...
Adding /tests/tst-stat.so...
Adding /tests/tst-wait-for.so...
Adding /tests/tst-bsd-tcp1.so...
Adding /tests/tst-bsd-tcp1-zsnd.so...
Adding /tests/tst-bsd-tcp1-zrcv.so...
Adding /tests/tst-bsd-tcp1-zsndrcv.so...
Adding /tests/tst-async.so...
Adding /tests/tst-rcu-list.so...
Adding /tests/tst-tcp-listen.so...
Adding /tests/tst-poll.so...
Adding /tests/tst-bitset-iter.so...
Adding /tests/tst-timer-set.so...
Adding /tests/tst-clock.so...
Adding /tests/tst-rcu-hashtable.so...
Adding /tests/tst-unordered-ring-mpsc.so...
Adding /tests/tst-seek.so...
Adding /tests/tst-solaris-taskq.so...
Adding /tests/misc-zfs-io.so...
cpiod finished
+ cd 
+ exec ./scripts/test.py
  TEST java-perms  OK  (10.724 s)
  TEST java_isolated   OK  (14.830 s)
  TEST java_non_isolated   OK  (9.311 s)
  TEST tcp_close_without_reading  qemu-system-x86_64: -redir 
tcp:::: The -redir option is deprecated. Please use '-netdev 
user,hostfwd=...' instead.
 OK  (3.784 s)
  TEST tracing_smoke_test  OK  (17.748 s)
  TEST tst-af-local.so OK  (6.814 s)
  TEST tst-align.soOK  (3.140 s)
  TEST tst-app.so  OK  (3.511 s)
  TEST tst-async.soOK  (3.720 s)
  TEST 

need: port openvpn into osv

[lmy2010lmy]

Hi all,

I enjoy the performance benefit of OSv, especially the No SpinLock and Van 
Jacobson implementation. I wish to establish the OSv image into the real 
cloud. My target app is OpenVPN. I try porting it into the OSv. OpenVPN 
deals with a tap device provided by Linux. Does anyone have any idea how to 
solve this?

Best,
Maxul

-- 
You received this message because you are subscribed to the Google Groups "OSv 
Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to osv-dev+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: Build failed in Jenkins: osv-build-nightly #1451

[Waldek Kozaczuk]

My theory might be right.

I ran simple experiment by adding this before first assert 
in test_when_ring_gets_full test:
sched::thread::pin(sched::cpus[0]);

and then before assert(!ring.push(5)); 
sched::thread::pin(sched::cpus[1]);

I received this error:

OSv v0.24-519-g2a7a27b
eth0: 192.168.122.15
__sigsetjmp() stubbed
Running 3 test cases...
Assertion failed: !ring.push(5) 
(/home/wkozaczuk/projects/osv/tests/tst-unordered-ring-mpsc.cc: 
test_method: 62)

[backtrace]
0x00225a88 <__assert_fail+24>
0x11406f64 
0x1140717d 
0xa2c4de5f 
0xa2915857 
0x1186afbf 
0x00841f0e 
Test tst-unordered-ring-mpsc.so FAILED
Traceback (most recent call last):
  File "./scripts/test.py", line 187, in 
main()
  File "./scripts/test.py", line 174, in main
run_tests()
  File "./scripts/test.py", line 165, in run_tests
run(tests_to_run)
  File "./scripts/test.py", line 85, in run
run_test(test)
  File "./scripts/test.py", line 60, in run_test
test.run()
  File "/home/wkozaczuk/projects/osv/scripts/tests/testing.py", line 29, in 
run
run_command_in_guest(self.command).join()
  File "/home/wkozaczuk/projects/osv/scripts/tests/testing.py", line 163, 
in join
raise Exception('Guest failed')
Exception: Guest failed

Please note however that the second line in the backtrace is different from 
the one in the Jenkins failure. So I am not sure if I have reproduced the 
exact same error.

On Friday, April 27, 2018 at 10:41:59 AM UTC-4, Waldek Kozaczuk wrote:
>
> This time tst-unordered-ring-mpsc failed (line 60). I briefly looked at it 
> and it seems to me that the test makes an assumption that it will be 
> executed on the same CPU. The unordered_ring_mpsc structure holds vector 
> for each cpu. But what if the thread running the test get migrated to 
> different CPU between line 59 and 60?
>
> To be honest I am quite ignorant about unordered_ring_mpsc so my reasoning 
> might be flawed.
>
> On Monday, April 23, 2018 at 6:58:03 PM UTC-4, jen...@scylladb.com wrote:
>>
>> See <
>> http://jenkins.cloudius-systems.com:8080/job/osv-build-nightly/1451/display/redirect?page=changes>
>>  
>>
>>
>> Changes: 
>>
>> [geraldonetto] add encrypt (3) functions (fix #945) 
>>
>> [geraldonetto] add crypt (3) tests 
>>
>> -- 
>> [...truncated 149.75 KB...] 
>> Adding /tests/tst-except.so... 
>> Adding /tests/misc-tcp-sendonly.so... 
>> Adding /tests/tst-tcp-nbwrite.so... 
>> Adding /tests/misc-tcp-hash-srv.so... 
>> Adding /tests/misc-loadbalance.so... 
>> Adding /tests/misc-scheduler.so... 
>> Adding /tests/tst-console.so... 
>> Adding /tests/tst-app.so... 
>> Adding /tests/misc-setpriority.so... 
>> Adding /tests/misc-timeslice.so... 
>> Adding /tests/misc-tls.so... 
>> Adding /tests/misc-gtod.so... 
>> Adding /tests/tst-dns-resolver.so... 
>> Adding /tests/tst-fs-link.so... 
>> Adding /tests/tst-kill.so... 
>> Adding /tests/tst-truncate.so... 
>> Adding /tests/misc-panic.so... 
>> Adding /tests/tst-utimes.so... 
>> Adding /tests/tst-utimensat.so... 
>> Adding /tests/tst-futimesat.so... 
>> Adding /tests/misc-tcp.so... 
>> Adding /tests/tst-strerror_r.so... 
>> Adding /tests/misc-random.so... 
>> Adding /tests/misc-urandom.so... 
>> Adding /tests/tst-commands.so... 
>> Adding /tests/tst-threadcomplete.so... 
>> Adding /tests/tst-timerfd.so... 
>> Adding /tests/tst-nway-merger.so... 
>> Adding /tests/tst-memmove.so... 
>> Adding /tests/tst-pthread-clock.so... 
>> Adding /tests/misc-procfs.so... 
>> Adding /tests/tst-chdir.so... 
>> Adding /tests/tst-chmod.so... 
>> Adding /tests/tst-hello.so... 
>> Adding /tests/misc-concurrent-io.so... 
>> Adding /tests/tst-concurrent-init.so... 
>> Adding /tests/tst-ring-spsc-wraparound.so... 
>> Adding /tests/tst-shm.so... 
>> Adding /tests/tst-align.so... 
>> Adding /tests/tst-cxxlocale.so... 
>> Adding /tests/misc-tcp-close-without-reading.so... 
>> Adding /tests/tst-sigwait.so... 
>> Adding /tests/tst-sampler.so... 
>> Adding /tests/misc-malloc.so... 
>> Adding /tests/misc-memcpy.so... 
>> Adding /tests/misc-free-perf.so... 
>> Adding /tests/tst-fallocate.so... 
>> Adding /tests/misc-printf.so... 
>> Adding /tests/tst-hostname.so... 
>> Adding /tests/tst-sendfile.so... 
>> Adding /tests/misc-lock-perf.so... 
>> Adding /tests/tst-uio.so... 
>> Adding /tests/tst-printf.so... 
>> Adding /tests/tst-pthread-affinity.so... 
>> Adding /tests/tst-pthread-tsd.so... 
>> Adding /tests/tst-thread-local.so... 
>> Adding /tests/tst-zfs-mount.so... 
>> Adding /tests/tst-regex.so... 
>> Adding /tests/tst-tcp-siocoutq.so... 
>> Adding /tests/libtls.so... 
>> Adding /tests/tst-tls.so... 
>> Adding /tests/tst-select-timeout.so... 
>> Adding /tests/tst-faccessat.so... 
>> Adding /tests/tst-fstatat.so... 
>> Adding /tests/misc-reboot.so... 
>> Adding /tests/tst-fcntl.so... 
>> Adding /tests/payload-namespace.so... 
>> Adding /tests/tst-namespace.so... 
>> Adding /tests/tst-without-namespace.so... 
>> Adding /t

Re: Build failed in Jenkins: osv-build-nightly #1451

[Waldek Kozaczuk]

This time tst-unordered-ring-mpsc failed (line 60). I briefly looked at it 
and it seems to me that the test makes an assumption that it will be 
executed on the same CPU. The unordered_ring_mpsc structure holds vector 
for each cpu. But what if the thread running the test get migrated to 
different CPU between line 59 and 60?

To be honest I am quite ignorant about unordered_ring_mpsc so my reasoning 
might be flawed.

On Monday, April 23, 2018 at 6:58:03 PM UTC-4, jen...@scylladb.com wrote:
>
> See <
> http://jenkins.cloudius-systems.com:8080/job/osv-build-nightly/1451/display/redirect?page=changes>
>  
>
>
> Changes: 
>
> [geraldonetto] add encrypt (3) functions (fix #945) 
>
> [geraldonetto] add crypt (3) tests 
>
> -- 
> [...truncated 149.75 KB...] 
> Adding /tests/tst-except.so... 
> Adding /tests/misc-tcp-sendonly.so... 
> Adding /tests/tst-tcp-nbwrite.so... 
> Adding /tests/misc-tcp-hash-srv.so... 
> Adding /tests/misc-loadbalance.so... 
> Adding /tests/misc-scheduler.so... 
> Adding /tests/tst-console.so... 
> Adding /tests/tst-app.so... 
> Adding /tests/misc-setpriority.so... 
> Adding /tests/misc-timeslice.so... 
> Adding /tests/misc-tls.so... 
> Adding /tests/misc-gtod.so... 
> Adding /tests/tst-dns-resolver.so... 
> Adding /tests/tst-fs-link.so... 
> Adding /tests/tst-kill.so... 
> Adding /tests/tst-truncate.so... 
> Adding /tests/misc-panic.so... 
> Adding /tests/tst-utimes.so... 
> Adding /tests/tst-utimensat.so... 
> Adding /tests/tst-futimesat.so... 
> Adding /tests/misc-tcp.so... 
> Adding /tests/tst-strerror_r.so... 
> Adding /tests/misc-random.so... 
> Adding /tests/misc-urandom.so... 
> Adding /tests/tst-commands.so... 
> Adding /tests/tst-threadcomplete.so... 
> Adding /tests/tst-timerfd.so... 
> Adding /tests/tst-nway-merger.so... 
> Adding /tests/tst-memmove.so... 
> Adding /tests/tst-pthread-clock.so... 
> Adding /tests/misc-procfs.so... 
> Adding /tests/tst-chdir.so... 
> Adding /tests/tst-chmod.so... 
> Adding /tests/tst-hello.so... 
> Adding /tests/misc-concurrent-io.so... 
> Adding /tests/tst-concurrent-init.so... 
> Adding /tests/tst-ring-spsc-wraparound.so... 
> Adding /tests/tst-shm.so... 
> Adding /tests/tst-align.so... 
> Adding /tests/tst-cxxlocale.so... 
> Adding /tests/misc-tcp-close-without-reading.so... 
> Adding /tests/tst-sigwait.so... 
> Adding /tests/tst-sampler.so... 
> Adding /tests/misc-malloc.so... 
> Adding /tests/misc-memcpy.so... 
> Adding /tests/misc-free-perf.so... 
> Adding /tests/tst-fallocate.so... 
> Adding /tests/misc-printf.so... 
> Adding /tests/tst-hostname.so... 
> Adding /tests/tst-sendfile.so... 
> Adding /tests/misc-lock-perf.so... 
> Adding /tests/tst-uio.so... 
> Adding /tests/tst-printf.so... 
> Adding /tests/tst-pthread-affinity.so... 
> Adding /tests/tst-pthread-tsd.so... 
> Adding /tests/tst-thread-local.so... 
> Adding /tests/tst-zfs-mount.so... 
> Adding /tests/tst-regex.so... 
> Adding /tests/tst-tcp-siocoutq.so... 
> Adding /tests/libtls.so... 
> Adding /tests/tst-tls.so... 
> Adding /tests/tst-select-timeout.so... 
> Adding /tests/tst-faccessat.so... 
> Adding /tests/tst-fstatat.so... 
> Adding /tests/misc-reboot.so... 
> Adding /tests/tst-fcntl.so... 
> Adding /tests/payload-namespace.so... 
> Adding /tests/tst-namespace.so... 
> Adding /tests/tst-without-namespace.so... 
> Adding /tests/payload-env.so... 
> Adding /tests/payload-merge-env.so... 
> Adding /tests/misc-execve.so... 
> Adding /tests/misc-execve-payload.so... 
> Adding /tests/misc-mutex2.so... 
> Adding /tests/tst-pthread-setcancelstate.so... 
> Adding /tests/tst-syscall.so... 
> Adding /tests/tst-pin.so... 
> Adding /tests/tst-run.so... 
> Adding /tests/tst-ifaddrs.so... 
> Adding /tests/tst-pthread-affinity-inherit.so... 
> Adding /tests/tst-sem-timed-wait.so... 
> Adding /tests/tst-ttyname.so... 
> Adding /tests/tst-pthread-barrier.so... 
> Adding /tests/tst-feexcept.so... 
> Adding /tests/tst-math.so... 
> Adding /tests/tst-sigaltstack.so... 
> Adding /tests/tst-fread.so... 
> Adding /tests/tst-tcp-cork.so... 
> Adding /tests/tst-tcp-v6.so... 
> Adding /tests/tst-calloc.so... 
> Adding /tests/tst-crypt.so... 
> Adding /tests/testrunner.so... 
> Adding /tests/tst-rename.so... 
> Adding /tests/tst-vfs.so... 
> Adding /tests/tst-libc-locking.so... 
> Adding /tests/misc-fs-stress.so... 
> Adding /tests/misc-bdev-write.so... 
> Adding /tests/misc-bdev-wlatency.so... 
> Adding /tests/misc-bdev-rw.so... 
> Adding /tests/tst-promise.so... 
> Adding /tests/tst-dlfcn.so... 
> Adding /tests/tst-stat.so... 
> Adding /tests/tst-wait-for.so... 
> Adding /tests/tst-bsd-tcp1.so... 
> Adding /tests/tst-bsd-tcp1-zsnd.so... 
> Adding /tests/tst-bsd-tcp1-zrcv.so... 
> Adding /tests/tst-bsd-tcp1-zsndrcv.so... 
> Adding /tests/tst-async.so... 
> Adding /tests/tst-rcu-list.so... 
> Adding /tests/tst-tcp-listen.so... 
> Adding /tests/tst-poll.so... 
> Adding /tests/tst-bitset-iter.so... 
> Adding /tests/tst-timer-set.so... 
> Adding /tests/tst-clock