Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Jiong Wang]

Great, will have a look, thanks!

Regards,
Jiong

On 05/04/2019 07:45, Y Song wrote:

Hi, Jiong,

To follow up the iovisor meeting discussion, the below is my prototype
for an end_loop
instruction in llvm:
https://github.com/yonghong-song/llvm/commit/b83226772100317092cae6478229ed6ca3b9903c
The goal is to help verifier to just focus on these marked cases,
rejecting any other backedges.

Please let me and John know if you get some better idea for bounded
loop support in llvm/verifier.

Thanks,

Yonghong

On Wed, Apr 3, 2019 at 11:49 AM Brenden Blanco  wrote:

Hi All,

Thanks for the good discussion today! Below are my notes.

Thanks,
Brenden

=== Discussion ===

[...]

Yonghong:
* Compile once run anywhere work continues
   * bitfield handling bugs in IR/debuginfo

Daniel:
* Global support work continues
   * BTF side patches submitted to bpf mailing list
   * tests included

Jiong:
* 32 bit patch set
   * test methodology improvements
   * updated patches later in the week
   * some concerns around shifts, to be addressed in later improvements

Andrii:
* BTF and compile-once work integration
   to share prototype tool with Saeed

Brendan:
* Is there a tool to measure queue latency in qdisc->netdev layer?
   * debian/ubuntu are packaging bpftrace
   * except libbcc renamed to libbpf_cc
   * some issues with mixing iovisor's libbcc and debian's

Jesper:
* Fedora adding packaging support for libbpf

Alexei:
* systemd also adding support for libbpf - link to be provided?

=== Attendees ===
Brenden Blanco
Andril Nakryiko
Daniel Borkmann
Jesper Brouer
Jiong Wang
Marco Leogrande
Michael Savisko
Paul Chaignon
Quentin Monnet
Alexei Starovoitov
Saeed
Flavio
Rony
Jonathan Lemon
Brendan Gregg
Dan Siemon
Joe Stringer
John





-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1645): https://lists.iovisor.org/g/iovisor-dev/message/1645
Mute This Topic: https://lists.iovisor.org/mt/30527411/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Yonghong Song]

Hi, Jiong,

To follow up the iovisor meeting discussion, the below is my prototype
for an end_loop
instruction in llvm:
https://github.com/yonghong-song/llvm/commit/b83226772100317092cae6478229ed6ca3b9903c
The goal is to help verifier to just focus on these marked cases,
rejecting any other backedges.

Please let me and John know if you get some better idea for bounded
loop support in llvm/verifier.

Thanks,

Yonghong

On Wed, Apr 3, 2019 at 11:49 AM Brenden Blanco  wrote:
>
> Hi All,
>
> Thanks for the good discussion today! Below are my notes.
>
> Thanks,
> Brenden
>
> === Discussion ===
[...]
> Yonghong:
> * Compile once run anywhere work continues
>   * bitfield handling bugs in IR/debuginfo
>
> Daniel:
> * Global support work continues
>   * BTF side patches submitted to bpf mailing list
>   * tests included
>
> Jiong:
> * 32 bit patch set
>   * test methodology improvements
>   * updated patches later in the week
>   * some concerns around shifts, to be addressed in later improvements
>
> Andrii:
> * BTF and compile-once work integration
>   to share prototype tool with Saeed
>
> Brendan:
> * Is there a tool to measure queue latency in qdisc->netdev layer?
>   * debian/ubuntu are packaging bpftrace
>   * except libbcc renamed to libbpf_cc
>   * some issues with mixing iovisor's libbcc and debian's
>
> Jesper:
> * Fedora adding packaging support for libbpf
>
> Alexei:
> * systemd also adding support for libbpf - link to be provided?
>
> === Attendees ===
> Brenden Blanco
> Andril Nakryiko
> Daniel Borkmann
> Jesper Brouer
> Jiong Wang
> Marco Leogrande
> Michael Savisko
> Paul Chaignon
> Quentin Monnet
> Alexei Starovoitov
> Saeed
> Flavio
> Rony
> Jonathan Lemon
> Brendan Gregg
> Dan Siemon
> Joe Stringer
> John
>
> 
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1644): https://lists.iovisor.org/g/iovisor-dev/message/1644
Mute This Topic: https://lists.iovisor.org/mt/30527411/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Brenden Blanco]

On Tue, Apr 2, 2019 at 10:48 AM Saeed Mahameed
 wrote:
>
> Hi Brenden,
>
> I am sending this on behalf of Michael Savisko, he is having some
> difficulties sending emails to the iovisor list.
Sending to the iovisor-dev mailer is gated by a signup requirement, in
order to reduce spam. The signup process should be pretty painless, I
believe it just requires going through an email validation step:
https://lists.iovisor.org/g/iovisor-dev/join
>
> Michael is working on real world use cases for XDP acceleration.
> He would like to present and discuss his work and analysis on
> accelerating Katran load balancer [1] via meta data offloads.
> He will need 10 minutes and will share some slides, i hope we can push
> this to tomorrow's meeting agenda.

Sounds good!
>
> Katran modified code is on Github:
> https://github.com/savisko/katran/tree/xdp_off
>
> [1] 
> https://code.fb.com/open-source/open-sourcing-katran-a-scalable-network-load-balancer/
> Thanks,
> Saeed.
>
> On Wed, Mar 20, 2019 at 3:32 PM Brenden Blanco  wrote:
> >
> > Hi all,
> >
> > Thanks for joining the discussion today. Here are the notes; however, this 
> > was
> > a longer discussion and I'm sure I missed some things.
> >
> > Cheers,
> > Brenden
> >
> > === Discussion ===
> >
> > Yonghong:
> > * Some internal BTF work
> > * Compiler support for static variables
> > * Some compile-once-run-everywhere work
> > * Looking for help with issues regarding libbpf packaging/dependencies
> >   * Issue to continue offline, not concluded on the call
> > * Issue related to function->function call in bcc and compiler optimizations
> >   * Jiong offers to debug the codegen using 32 bit mode
> >
> > Saeed:
> > * XDP driver statistics standardization
> >   * All drivers run same entry point for xdp progs
> > * Why not account stats here?
> > * Even though xdp program can implement its own statistics
> > * Many drivers are already paying stats accounting cost
> >   * Just remove unused stats from driver?
> > * Stats may be used in debugging, but FB for instance is guarding with
> >   static key, wouldn't want extra stats on by default
> > * Allocating resources for tx queue/redirect?
> >   * Is there a better way to allocate resources when it isn't known that a
> > program will need queues
> >   * One approach is to attach dummy bpf program
> >   * Resource allocation point when configuring devmap?
> > * Seems like a clean enough solution, doesn't solve all cases but moves 
> > the
> >   ball forward
> > * BTF metadata structure registration
> >   * Should be queryable from userspace, don't yet have an API for that
> >   * Netlink vs syscall?
> > * No silver bullet for all use cases
> >   * Hesitation for creating a new object to describe existing objects (bpf
> > progs, maps)
> > * BTF is metadata conceptually different from maps, progs
> > * ethtool? unlikely due to lack of code ownership
> > * For buffers, something like devlink is more appropriate
> > * For BTF, bpf() syscall works
> > * BTF for statistics description (ethtool replacement?)
> >
> > Daniel:
> > * verification of static data is working, patches coming soon
> >
> > === Attendees ===
> > Brenden Blanco
> > Michael Savisko
> > Alexei Starovoitov
> > Daniel Borkmann
> > Jakub Kicinski
> > Neerav Parikh
> > Paul Chaignon
> > Saeed
> > Marco Leogrande
> > Jiong Wang
> > Andrii Nakryiko
> > Yonghong Song
> > William Tu
> > Joe Stringer
> > John
> > Maciej Fijalkowski
> > Martin Lau
> > Mauricio Vasquez
> > Piotr Raczynski
> > Quillian Rutherford
> >
> > 
> >

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1637): https://lists.iovisor.org/g/iovisor-dev/message/1637
Mute This Topic: https://lists.iovisor.org/mt/30527411/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Saeed Mahameed]

Hi Brenden,

I am sending this on behalf of Michael Savisko, he is having some
difficulties sending emails to the iovisor list.

Michael is working on real world use cases for XDP acceleration.
He would like to present and discuss his work and analysis on
accelerating Katran load balancer [1] via meta data offloads.
He will need 10 minutes and will share some slides, i hope we can push
this to tomorrow's meeting agenda.

Katran modified code is on Github:
https://github.com/savisko/katran/tree/xdp_off

[1] 
https://code.fb.com/open-source/open-sourcing-katran-a-scalable-network-load-balancer/
Thanks,
Saeed.

On Wed, Mar 20, 2019 at 3:32 PM Brenden Blanco  wrote:
>
> Hi all,
>
> Thanks for joining the discussion today. Here are the notes; however, this was
> a longer discussion and I'm sure I missed some things.
>
> Cheers,
> Brenden
>
> === Discussion ===
>
> Yonghong:
> * Some internal BTF work
> * Compiler support for static variables
> * Some compile-once-run-everywhere work
> * Looking for help with issues regarding libbpf packaging/dependencies
>   * Issue to continue offline, not concluded on the call
> * Issue related to function->function call in bcc and compiler optimizations
>   * Jiong offers to debug the codegen using 32 bit mode
>
> Saeed:
> * XDP driver statistics standardization
>   * All drivers run same entry point for xdp progs
> * Why not account stats here?
> * Even though xdp program can implement its own statistics
> * Many drivers are already paying stats accounting cost
>   * Just remove unused stats from driver?
> * Stats may be used in debugging, but FB for instance is guarding with
>   static key, wouldn't want extra stats on by default
> * Allocating resources for tx queue/redirect?
>   * Is there a better way to allocate resources when it isn't known that a
> program will need queues
>   * One approach is to attach dummy bpf program
>   * Resource allocation point when configuring devmap?
> * Seems like a clean enough solution, doesn't solve all cases but moves 
> the
>   ball forward
> * BTF metadata structure registration
>   * Should be queryable from userspace, don't yet have an API for that
>   * Netlink vs syscall?
> * No silver bullet for all use cases
>   * Hesitation for creating a new object to describe existing objects (bpf
> progs, maps)
> * BTF is metadata conceptually different from maps, progs
> * ethtool? unlikely due to lack of code ownership
> * For buffers, something like devlink is more appropriate
> * For BTF, bpf() syscall works
> * BTF for statistics description (ethtool replacement?)
>
> Daniel:
> * verification of static data is working, patches coming soon
>
> === Attendees ===
> Brenden Blanco
> Michael Savisko
> Alexei Starovoitov
> Daniel Borkmann
> Jakub Kicinski
> Neerav Parikh
> Paul Chaignon
> Saeed
> Marco Leogrande
> Jiong Wang
> Andrii Nakryiko
> Yonghong Song
> William Tu
> Joe Stringer
> John
> Maciej Fijalkowski
> Martin Lau
> Mauricio Vasquez
> Piotr Raczynski
> Quillian Rutherford
>
> 
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1636): https://lists.iovisor.org/g/iovisor-dev/message/1636
Mute This Topic: https://lists.iovisor.org/mt/30527411/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Saeed Mahameed]

Hi Guys,

My agenda for next meeting:

1) unifying and centralizing XDP statistics accounting [1].
2) XDP resource management, User API [2].
3) XDP meta data via btf (in kernel BTF registration).
4) all of the above issues share one common problem, which is the lack
of a unified user interface
without it, We really can't make a real progress.

I just sent a proposal [3] for away to achieve the unified interface,
please look it up and let me know your thoughts.
[1] 
https://github.com/xdp-project/xdp-project/blob/master/xdp-project.org#statistics-per-xdp-action
[2] 
https://github.com/xdp-project/xdp-project/blob/master/xdp-project.org#better-ndo_xdp_xmit-resource-management
[3] Subject: "[RFC][Proposal] BPF Control MAP"

Thanks,
Saeed

On Wed, Mar 6, 2019 at 12:51 PM Brenden Blanco  wrote:
>
> Hi All,
>
> Thank you for joining the call today. Here are my notes from the discussion.
>
> Thanks,
> Brenden
>
> === Discussion ===
> Brenden:
> * Plan to tag release to coincide with kernel 5.0
>
> Brendan:
> * Speaking this weekend at SCaLE in Los Angeles
>
> Yonghong:
> * LLVM work
>  * compile once - run anywhere WIP
>  * support for static variables
>
> Daniel:
> * Global data support work in kernel continues
> * Ability to lock maps as read-only
> * bugfixes after merge window
>
> Alexei:
> * Some thoughts on future work of BPF
>  * especially with introduction of BTF
>  * overall needs concerted effort to improve debuggability
>  * BTF for programs itself with source/type/layout information
>  * structures for maps and global data
>  * suggest to always require type information
>(already turned on by default in bcc and supported by llvm)
>  * Some extra hoops to jump through for driver embedded BPF
>  * to be enabled with a sysctl
>  * kernel support is ready
>  * some long tail of support - e.g. systemd has raw assembly BPF
>  * kconfig option - eventual deprecation
>  * if kernel is default strict, llvm should automatically emit BTF as well
> * memcg accounting patch status?
>  * Daniel - still being worked on
>  * proposal to enable the same accounting for verifier memory
>  * helps to enable verifier multithreading
>
> Jakub:
> * question regarding global data atomicity
>  * Daniel - requires read once / write once instructions to work properly
>  * some todo work on documentation, interpreter + jit implementations
>  * depends on architecture (machine word size guarantees only)
>
> Jesper:
> * which llvm release supports BTF
>  * landed in December - will be in 8.0, better in 9.0
> * working on tutorial for xdp at netdev
>  * https://www.netdevconf.org/0x13/session.html?tutorial-XDP-hands-on
>  * soliciting feedback
>   * https://github.com/xdp-project/xdp-tutorial/
>
> Saeed:
> * request to devote some time in the next meeting to iron out some XDP issues
>  * please send an agend in reply to the reminder email before next call
>  * prepare discussion over email in between time
>
> === Attendees ===
> Alexei Starovoitov
> Marco Leogrande
> Mauricio Vasquez
> Paul Chaignon
> Brenden Blanco
> Jiong Wang
> Yonghong Song
> Daniel Borkmann
> Jesper Brouer
> Quentin Monnet
> Dan Siemon
> Jakub Kicinski
> Saeed
> John
> Yutaro
>
> 
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1604): https://lists.iovisor.org/g/iovisor-dev/message/1604
Mute This Topic: https://lists.iovisor.org/mt/30289974/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Jiong Wang]

On 24/01/2019 02:33, Brenden Blanco wrote:

Jiong:
* respin jmp32 patch set - v2
   - implementation in working state
   - isa for subregister looking good
   - codegen giving smaller results (num of instructions)
   - will resend patch set after fixing test failure


Finished re-spin and rebased on top of latest bpf-next.

My set will potentially conflict with the following three other bpf-next
pending patches/sets on selftests Makefile and test_verifier.c:
  - Stanislav's LLVM_READELF change on Makefile.
  - Alexei's spin_lock change on test_verifier.c.
  - Jakub's test_verifier.c refactor on test_verifier.c.

The conflict should be easy to resolve. For test_verifier.c, my set just
adds new tests at the end of the test array. I will send out v3 shortly.

Regards,
Jiong


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1558): https://lists.iovisor.org/g/iovisor-dev/message/1558
Mute This Topic: https://lists.iovisor.org/mt/29521656/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[William Tu]

On Wed, Jan 9, 2019 at 11:59 AM Brenden Blanco  wrote:
>
> Hi All,
>
> Thanks for joining the call today after a short holiday hiatus. Below are my
> notes from the call.
>
> === Discussion ===
> Brenden
> * Adopted new project kubectl-trace into github.com/iovisor from the author's
>   (@fntlnz) personal github
>   - Adds support for running bpftrace as a 'kubectl trace' command in a
> kubernetes environment
>   - Presented at Kubecon 2018:
> 
> https://kccna18.sched.com/event/GrYw/ebpf-powered-distributed-kubernetes-performance-analysis-lorenzo-fontana-influxdata
>   - Please give it a spin and contribute/comment on
> github.com/iovisor/kubectl-trace
> * Nice work Lorenzo!
>
> Yonghong
> * funcinfo and line info merged BTF support merged into kernel
> * clang debug info for bpf
>   - use -g from clang to generate such info that gets passed along to BTF
>   - some blocking issues to bring this feature into bcc
> - btf info not being handled properly by dynamic linker
> * bcc plan to release by end of the week to coincide with kernel release
> * wip: add 128 bit int support
>
> Brendan
> * Compiler errors with linux 5.0-rc (asm goto)
> * Working on documentation and packaging for bpftrace
>   - lots of small bugs to fix marching towards 1.0
>
> Alexei
> * Proposing dates and format for BPF/IO Visor specific technical miniconf in 
> the
>   springtime
>   - March-May timeframe
>   - 2 days?
>
> William
> * Adding AF_XDP support to vSphere driver

Sorry, I mean AF_XDP for veth driver.
Thank you
William


>
>
> === Attendees ===
> Brenden Blanco
> Quentin Monnet
> Jakub Kicinski
> Alexei Starovoitov
> Jiong Wang
> Maciej Fijalkowski
> William Tu
> Yonghong Song
> Brendan Gregg
> Daniel Borkmann
> Martin Lau
> Neerav Parikh
>
> 
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1555): https://lists.iovisor.org/g/iovisor-dev/message/1555
Mute This Topic: https://lists.iovisor.org/mt/28988043/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Yonghong Song]

On Wed, Oct 3, 2018 at 11:26 AM Brenden Blanco  wrote:
>
> Hi all,
>
> Thanks for joining the call this week. Here are my notes of the items 
> discussed.
>
> -Brenden
>
> === Discussion ===
>
> Yonghong:
> - BTF support in LLVM WIP
>   - prototype is approaching functionality
>   - to post to llvm mailing list soon (enabled through -g -target=bpf mode)

The link to the llvm patch which generates .BTF and .BTF.ext sections:
https://reviews.llvm.org/D52950

>
> William:
> - OVS + AF_XDP performance improvements
>   - more batching on tx side
>   - add more asynchronous logic
>   - goes from 5Mpps -> 14Mpps forwarding
> - tested ixgbe AF_XDP v2 support - seems to be working
>
> Daniel:
> - kTLS and sockmap integration WIP with John
>   - planning to post this week
> - bpf plumbers track submissions is closed
>
> JohnF:
> - Working on Cilium pieces for kTLS+sockmap
>
> Joe:
> - Socket lookup helpers were merged this week
>
> Jesper:
> - working on XDP paper with John and Daniel
> - Gave talk in Paris @Kernel Recipes
>   - 
> http://people.netfilter.org/hawk/presentations/KernelRecipes2018/XDP_Kernel_Recipes_2018.pdf
>
> Mauricio:
> - Working to address review comments this week on bpf queue and stackmap
>
> === Attendees ===
> Brenden Blanco
> Yonghong Song
> Jakub Kicinski
> Mauricio Vasquez
> JohnF
> Daniel Borkmann
> Joe Stringer
> William Tu
> Jesper Brouer
> Jiong Wang
> Nic Viljoen
> Quentin Monnet
>
> 
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#1492): https://lists.iovisor.org/g/iovisor-dev/message/1492
Mute This Topic: https://lists.iovisor.org/mt/26721077/21656
Group Owner: iovisor-dev+ow...@lists.iovisor.org
Unsubscribe: https://lists.iovisor.org/g/iovisor-dev/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Jiong Wang via iovisor-dev]

On 17/05/2018 05:38, Brenden Blanco via iovisor-dev wrote:

Hi All,

Thanks for attending the meeting today. As usual, here are my notes.

=== Discussion ===
Bjorn
- AF_XDP zero copy implementation RFC on netdev
- some uapi concerns, may need to back out changes
- but, over next couple weeks before merge window, discuss and improve in
  hopes of merging
- clean up non-intel code, respin, leave out i40e patches at the end
- separate i40e cleanup spin
- bcm may try to join as 2nd vendor to flesh out uapi
- some discussion of common code organization
- xdp in separate file helps backporting

Yonghong
- some python3 fixes
- proposals for improved container support
- rewriter complexity increasing
- tracing event introspection

Martin
- BTF id landed
- working on bpftool support
- still using pahole to convert dwarf
- still unclear how integration with llvm will look

Jiong
- dominator tree info RFCs pushed
- significant mem/exec time costs to run (e.g. 2x more, 3x slower)


Just for the record, if I listened correctly, John proposed to introduce
a switch for the new CFG infrastructure, i.e, we keep the exisiting DFS
based check_cfg, the new CFG code will only be enabled when check_cfg
detected a loop and wants know whether it is bounded, by this we could
avoid extra mem/exec time cost on programs that don't have loop.

Regards,
Jiong


John
- induction variable tracking in progress
- next: min/max value tracking
both: to work on topic branch under bpf-next

William
- tried workaround from Yonghong
- still need to dig into root cause

Joe
- implementation of sock lookup going through iterations
- concerns over locking in bpf being a leaky implementation detail


=== Attendees ===
Brenden Blanco
Alexei Starovoitov
Bjorn Topel
Daniel Borkmann
Jesper Brouer
Jiong Wang
Magnus Karlsson
Quentin Monnet
Joe Stringer
Andy Gospodarek
Ferris
Brendan Gregg
Jakub Kicinski
William Tu
Yonghong Song
Alexander Duyck
Sandipan
John F
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev


___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev

Re: [iovisor-dev] minutes: IO Visor TSC / Dev Meeting

[Björn Töpel via iovisor-dev]

2018-05-03 1:39 GMT+02:00 Brenden Blanco via iovisor-dev
:
> Hi All,
>
> Thanks for joining the discussion today. As usual, here are my notes.
>
> -Brenden
>
> === Discussion ===
>
> John:
> - sockmap fixes pushed
>   - fixed broken tests
> - sockmap hash impl next
> - bounded loop rfc making progress
> - cilium code using sockhash almost finished as well
>
> Yonghong:
> - python3 test cleanup
>   - except memleak tool
> - raw tracepoint support in bcc
>   - runqlat tool
>   - bio tracing
>   - more precise than kprobes
> - next work: introspection - bpf trace program in perf
>
> Martin:
> - BTF id patch WIP
>   - BTF id -> BTF map
> - next: support function pointer type in BTF
>
> William:
> - moving bpf tunnel example -> selftest
> - hitting issue with long running test tunnel cases
>   - try enabling kasan to debug
> - verifier issue bugfix (ctx + constant arithmetic) WIP
>
> Daniel:
> - finalizing removal of some inst from jit
> - few bugfixes in x86 jit
>
> Alexei:
> - AF_XDP patches being reviewed, looks ok
>

Unfortunately, I missed the call. Appreciate that AF_XDP was took into
discussion! Thanks for the review!

> Jesper:
> - Testing AF_XDP patches currently
>   - no driver changes needed with xdp_redirect
>   - driver changes still needed for zerocopy
>   - intel: 12mpps, mlnx: 9mpps drop
>

Again, thanks a lot for spending time on the AF_XDP patchset!


Cheers,
Björn

> Brendan:
> - CFP for USENIX LISA in October, Nashville TN
>
> === Attendees ===
> Brenden Blanco
> Alex Reece
> Jakub Kicinski
> Martin Lau
> Quentin Monnet
> Sandipan
> Jiong Wang
> William Tu
> Alexei Starovoitov
> Alexander Duyck
> John Fastabend
> Jesper Brouer
> Daniel Borkmann
> Yonghong Song
> Brendan Gregg
> Ferris
> ___
> iovisor-dev mailing list
> iovisor-dev@lists.iovisor.org
> https://lists.iovisor.org/mailman/listinfo/iovisor-dev
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev

Re: [iovisor-dev] minutes: IO Visor TSC / Dev Meeting

[Y Song via iovisor-dev]

On Wed, May 2, 2018 at 4:39 PM, Brenden Blanco via iovisor-dev
 wrote:
> Hi All,
>
> Thanks for joining the discussion today. As usual, here are my notes.
>
> -Brenden
>
> === Discussion ===
>
> John:
> - sockmap fixes pushed
>   - fixed broken tests
> - sockmap hash impl next
> - bounded loop rfc making progress
> - cilium code using sockhash almost finished as well
>
> Yonghong:
> - python3 test cleanup
>   - except memleak tool

This is the test_tools_memleak issue I mentioned.
https://github.com/iovisor/bcc/issues/1685

I would be great if somebody who knows python (esp. python3) better
can help take a look.
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Brenden Blanco via iovisor-dev]

On Wed, Feb 21, 2018 at 11:55 AM, Brenden Blanco  wrote:
> Hi all,
>
> Thanks for attending the call this week. My notes are included below.
>
> === Updates ===
>
> DTrace GPLed in Dec 2017
> - To help with Oracle Linux port
> - Should we take dtrace kernel code into linux?
>   - opinion: probably not necessary now, more applicable 5 years ago
> - How about dtrace frontend?
>   - may have more short term value
>   - combine with bpftrace?
>   - who would work on it?
>   - userspace tools are now UPL - how does that work with apache2?
> - CTF
>   - currently forking the format into BTF
>   - exceed 32k types, other limitations
>   - still, is the code useful to combine?
>
> bpfilter announcement
> - lots of lwn/reddit/hackernews comments
>
> Brenden:
> - Fixes for python3 string encoding
>   - please test tools with python3 -W and submit PRs/issues
> - todo: push clang ir rewriter to github branch

As requested, I have pushed the WIP code to
https://github.com/iovisor/bcc/tree/ir-probe-rewrite. Only one of the
two test cases currently works. The basic idea is to use the pointer
alias info to track which loads read from on-stack memory and maps,
and treat the rest as unsafe reads and rewrite them into
bpf_probe_read calls. Map data is not yet handled.

>
> Yonghong:
> - Kernel related bugfixes
>   - memory leak in shared lpm map
>
> Daniel:
> - bpfilter work
> - retpoline work in tail call code of x86 jit
>   - also arm64
>
> John:
> - some more sockmap changes
>   - tx hooks
>   - more testing, cleanup
>   - optimizations in followup patches
>
> Joe:
> - Soliciting feedback for socket sharing patches
>   - looking into storing data along with socket
> - scratch accessible from bpf program
> - How to protect scratch area?
>   - new lock helper idea
>
> Sargun:
> - Asking for feedback on seccomp ebpf changes
>   - desires access to read-only map for
>   - use case for scratch buffer primitive as well
>
> Brendan:
> - New pcp-bcc-pmda plugin by redhat
>   - tbd: integrate into vector
>
> Jesper:
> - XDP redirect work
>   - bugfixes
>   - page free and return API next
> - getting help from mellanox devs
> - XDP bulk xmit for rx
>
> === Attendees ===
> Brenden Blanco
> Eduard Serra
> Alexei Starovoitov
> Joe String
> Jakub Kicinski
> Jiong Wang
> Mauricio Vasquez
> Quentin Monnet
> Saeed
> Sandipan
> Sargun Dhillon
> Brendan Gregg
> Yonghong Song
> Jesper Brouer
> Alexander Duyck
> Edwin Peer
> PJ Waskiewicz
> Daniel Borkmann
> Nic Viljoen
> John Fastabend
> Alexander Duyck
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Alexei Starovoitov via iovisor-dev]

On Wed, Aug 23, 2017 at 4:40 PM, Brenden Blanco via iovisor-dev
 wrote:
> Hi All,
>
> Thanks for joining in to the call today. We shared a round of updates, which 
> are
> included in the notes below.
>
> Also please remember that Plumbers is right around the corner! If you have
> signed up to lead discussion of a topic at the Tracing+BPF microconference,
> Alexei would like to have a brief description of what will be discussed so 
> that
> organizers can update the bylines on the schedule. Please send that soon!

the proposals from tracing wiki need to be re-submitted
to show up in official plumbers schedule.
Please do so here:
https://linuxplumbersconf.org/2017/ocw/events/LPC2017/tracks/640
Anything tracing or bpf related is a good topic to discuss.

Thanks!
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev

Re: [iovisor-dev] minutes: IO Visor TSC/Dev Meeting

[Alexei Starovoitov via iovisor-dev]

On Wed, May 17, 2017 at 2:14 PM, Brenden Blanco via iovisor-dev
 wrote:
> Hi All,
>
> Thanks for attending the call today, here are the notes.

thanks a lot for taking and publishing these notes!

> CFP for Linux Plumbers
> Sept 13-15, Los Angeles
> Tracing microconference accepted
>  (Alexei, Brendan, Josef leading topics)
>  http://wiki.linuxplumbersconf.org/2017:tracing
> Last year was successful, looking forward to more topics
>  (tbd: find previous etherpad)

https://etherpad.openstack.org/p/LPC2016_Tracing
a bit terse, but if you were there last year, it's a good memory refresh :)
___
iovisor-dev mailing list
iovisor-dev@lists.iovisor.org
https://lists.iovisor.org/mailman/listinfo/iovisor-dev