Reviewed-by: Dean Marx
On Wed, Sep 10, 2025 at 3:43 PM Paul Szczepanek wrote:
>
> From: Thomas Wilks
>
> Updated and corrected test case doc strings inside of test suites.
>
> Changed helper functions inside of testsuites into private functions
> and removed doc st
Add test suite covering virtio-user and vhost
server/client forwarding scenarios with
testpmd packet validation.
Signed-off-by: Dean Marx
---
doc/api/dts/tests.TestSuite_virtio_fwd.rst | 8 +
dts/tests/TestSuite_virtio_fwd.py | 179 +
2 files changed, 187
Add start tx_first method to testpmd shell, which sends
a specified number of burst packets prior to starting
packet forwarding.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 21 +++
1 file changed, 21 insertions(+)
diff --git a/dts/framework
The standard for test case docstrings in DTS requires each
case to have a Steps and Verify section to outline
each respective step of the test. Add these sections
to existing suites that are not formatted this way.
Bugzilla ID: 1599
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_blocklist.py
Add a section to the dts rst under How to Write a Test Suite
which provides an example for how to write a test case
docstring, including a steps and verify section.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 16
1 file changed, 16 insertions(+)
diff --git a/doc
Add a python script that checks all test cases
to ensure each docstring contains a steps and
verify section in accordance with coding guidelines.
Add a section within the check-format script which
calls the docstring script after linting with ruff.
Bugzilla ID: 1623
Signed-off-by: Dean Marx
Add a python script that checks all test cases
to ensure each docstring contains a steps and
verify section in accordance with coding guidelines.
Add a section within the check-format script which
calls the docstring script after linting with ruff.
Bugzilla ID: 1623
Signed-off-by: Dean Marx
A majority of test cases in DTS are prepended with 'test_',
however this is no longer required with the introduction of
functional/performance test decorators some time ago.
Remove all of these prefixes from test cases.
Bugzilla ID: 1770
Signed-off-by: Dean Marx
---
A majority of test cases in DTS are prepended with 'test_',
however this is no longer required with the introduction of
functional/performance test decorators some time ago.
Remove all of these prefixes from test cases.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload
The standard for test case docstrings in DTS requires each
case to have a Steps and Verify section to outline
each respective step of the test. Add these sections
to existing suites that are not formatted this way.
Bugzilla ID: 1599
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_blocklist.py
Add a section to the dts rst under How to Write a Test Suite
which provides an example for how to write a test case
docstring, including a steps and verify section.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 16
1 file changed, 16 insertions(+)
diff --git a/doc
Some of the DTS test suites require two link topologies
in order to run, but not all truly require two links
for proper testing. Rewrite the topology requirements
on these test suites to reflect the actual
requirements.
Bugzilla ID: 1755
Signed-off-by: Dean Marx
---
dts/tests
nning quickly.
Bugzilla ID: 1759
Signed-off-by: Dean Marx
Reviewed-by: Luca Vizzarro
---
dts/framework/testbed_model/topology.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dts/framework/testbed_model/topology.py
b/dts/framework/testbed_model/topology.py
index 899ea
-by: Dean Marx
---
v2:
* Grouped one_link default and two_link requirements patches
v3:
* Remove one_link suite decorators
* Add two_link requirement to one_port_blocklisted case
Dean Marx (2):
dts: make one link the default topology
dts: rewrite two link topology requirements
dts/framework
Reviewed-by: Dean Marx
the check,
then verifies they are not None directly after.
Fixes: 8c9a7471a0e6 ("dts: add checksum offload test suite")
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload.py | 5 +
1 file changed, 5 insertions(+)
diff --git a/dts/tests/TestSuite_checksum_offload
Current test suite docstring for checksum offload suite
says there are 6 test cases when it should say 7.
Fixes: 8c9a7471a0e6 ("dts: add checksum offload test suite")
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload.py | 2 +-
1 file changed, 1 insertion(+),
The standard for test case docstrings in DTS requires each
case to have a Steps and Verify section to outline
each respective step of the test. Add these sections
to existing suites that are not formatted this way.
Bugzilla ID: 1599
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_blocklist.py
Add a section to the dts rst under How to Write a Test Suite
which provides an example for how to write a test case
docstring, including a steps and verify section.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 16
1 file changed, 16 insertions(+)
diff --git a/doc
nning quickly.
Bugzilla ID: 1759
Signed-off-by: Dean Marx
---
dts/framework/testbed_model/topology.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dts/framework/testbed_model/topology.py
b/dts/framework/testbed_model/topology.py
index 899ea0ad3a..9f21520bbb 100644
---
Some of the DTS test suites require two link topologies
in order to run, but not all truly require two links
for proper testing. Rewrite the topology requirements
on these test suites to reflect the actual
requirements.
Bugzilla ID: 1755
Signed-off-by: Dean Marx
---
dts/tests
I second Patrick's comments
nning quickly.
Bugzilla ID: 1759
Signed-off-by: Dean Marx
---
dts/framework/testbed_model/topology.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dts/framework/testbed_model/topology.py
b/dts/framework/testbed_model/topology.py
index 899ea0ad3a..9f21520bbb 100644
---
test suite")
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload.py | 7 +--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/dts/tests/TestSuite_checksum_offload.py
b/dts/tests/TestSuite_checksum_offload.py
index b03c3d46ed..9dfbcb8028 100644
--- a
Current test suite docstring for checksum offload suite
says there are 6 test cases when it should say 7.
Fixes: 8c9a7471a0e6 ("dts: add checksum offload test suite")
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload.py | 2 +-
1 file changed, 1 insertion(+),
The standard for test case docstrings in DTS requires each
case to have a Steps and Verify section to outline
each respective step of the test. Add these sections
to existing suites that are not formatted this way.
Bugzilla ID: 1599
Signed-off-by: Dean Marx
---
dts/tests
Add a section to the dts rst under How to Write a Test Suite
which provides an example for how to write a test case
docstring, including a steps and verify section.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 16
1 file changed, 16 insertions(+)
diff --git a/doc
Some of the DTS test suites require two link topologies
in order to run, but not all truly require two links
for proper testing. Rewrite the topology requirements
on these test suites to reflect the actual
requirements.
Bugzilla ID: 1755
Signed-off-by: Dean Marx
---
dts/tests
up at the DTS meeting yesterday that this suite is
reliable on Intel NICs, but unreliable on Mellanox (CX6), which I can
confirm after running on a CX5 and Intel XL710 and seeing the same
behavior.
Reviewed-by: Dean Marx
Tested-by: Dean Marx
On Fri, Jul 18, 2025 at 4:23 AM Bruce Richardson
wrote:
>
> On Thu, Jul 17, 2025 at 05:03:13PM -0400, Dean Marx wrote:
> > I've created a v1 of a QinQ test suite around the set of test cases
> > discussed earlier (which is not set in stone, and I expect it to
> > cha
I've created a v1 of a QinQ test suite around the set of test cases
discussed earlier (which is not set in stone, and I expect it to
change significantly across many future versions.) The PASS/FAIL
values can be mostly disregarded in the context of this conversation,
but I've added logging to expla
Add QinQ test suite, which verifies PMD behavior when
sending QinQ (IEEE 802.1ad) packets.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_qinq.py | 329
1 file changed, 329 insertions(+)
create mode 100644 dts/tests/TestSuite_qinq.py
diff --git a/dts
Add QinQ strip and VLAN extend methods to TestPmdShell class.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 52 +++
1 file changed, 52 insertions(+)
diff --git a/dts/framework/remote_session/testpmd_shell.py
b/dts/framework/remote_session
The Framework Coding Guidelines section includes outdated information
about DTS and how to write a test suite. Updated these points to include
the new test case decorators and setup/teardown hooks.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 203
Rephrase some of the DTS tool/term definitions to be more concise.
These sections were unnecessarily verbose and can be conveyed
in a clearer way.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 37 -
1 file changed, 12
Refactor README to contain only a high level description
of relevant DTS concepts and a simple getting started guide.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 116 --
1 file changed, 56
I've created a list of test cases which I'm planning on implementing
in future QinQ testing. After talking with Bruce about some Intel test
results earlier, I've got a solid idea of what the expected behaviors
are in five of these, but I'm unsure about the other three. If anyone
is able to provide
The Framework Coding Guidelines section includes outdated information
about DTS and how to write a test suite. Updated these points to include
the new test case decorators and setup/teardown hooks.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 201
Refactor README to contain only a high level description
of relevant DTS concepts and a simple getting started guide.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 116 --
1 file changed, 56
Rephrase some of the DTS tool/term definitions to be more concise.
These sections were unnecessarily verbose and can be conveyed
in a clearer way.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 37 -
1 file changed, 12
The Framework Coding Guidelines section includes outdated information
about DTS and how to write a test suite. Updated these points to include
the new test case decorators and setup/teardown hooks.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 201
Rephrase some of the DTS tool/term definitions to be more concise.
These sections were unnecessarily verbose and can be conveyed
in a clearer way.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 37 -
1 file changed, 12
Refactor README to contain only a high level description
of relevant DTS concepts and a simple getting started guide.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 116 --
1 file changed, 56
On Mon, Jul 14, 2025 at 9:30 AM Bruce Richardson
wrote:
>
> The behaviour of VLAN tag stripping Rx offloads is unclear in DPDK, and
> not very well documented. Even the documentation that does exist appears
> contradictory.
>
> For example, the doxygen docs for the mbuf flag
> RTE_MBUF_F_RX_QINQ_S
The Framework Coding Guidelines section includes outdated information
about DTS and how to write a test suite. Updated these points to include
the new test case decorators and setup/teardown hooks.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 194
Rephrase some of the DTS tool/term definitions to be more concise.
These sections were unnecessarily verbose and can be conveyed
in a clearer way.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
doc/guides/tools/dts.rst | 37 -
1 file changed, 12
Refactor README to contain only a high level description
of relevant DTS concepts and a simple getting started guide.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 115 --
1 file changed, 55
> Also, I never did get a response from you about whether it would be good to
> include some ascii art to depict these topologies :)
>
> You don't have to be a fan, but it would be good to get your opinion. If you
> think it's a good idea, can you add a bugzilla ticket so we can do this
> during
The Framework Coding Guidelines section includes outdated information
about DTS and how to write a test suite. Updated these points to include
the new test case decorators and setup/teardown hooks.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 181
Rephrase some of the DTS tool/term definitions to be more concise.
These sections were unnecessarily verbose and can be conveyed
in a clearer way.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 37 -
1 file changed, 12 insertions(+), 25 deletions
Remove unnecessary information from README.md,
and add new sections to clarify the purpose/use
of DTS along with clear setup instructions.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 115
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
During the process of writing these changes and testing virtual
functions on multiple environments, I came across some notable
behaviors. On Mellanox devices, the current test suites in DTS run
without issue, receiving and forwarding packets as expected. However,
this is not the case on Broadcom an
Add a section to the dts.rst file explaining how to
enable SR-IOV mode on an environment, as well
as any additional steps needed for virtual
function configuration.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 46
dts/README.md| 2
Add a physical function NIC capability that checks
if the test run is using PFs. Add PF capability
requirement to all suites/cases that do not
run without error on virtual functions.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 22 +++
dts/tests
Add virtual functions to DTS framework, along with
a field for specifying VF test runs in the config file.
Signed-off-by: Patrick Robb
Signed-off-by: Dean Marx
---
dts/framework/config/test_run.py | 2 +
dts/framework/test_run.py| 7 +++
dts/framework
Remove unnecessary verification step in the start method
of TestPmdShell which checks the link status.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 7 ---
1 file changed, 7 deletions(-)
diff --git a/dts/framework/remote_session/testpmd_shell.py
b/dts
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
Add a method for validating flow rules to the testpmd shell class.
Implement test case skipping for flow rules that do not pass
validation.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
---
dts/framework/remote_session/testpmd_shell.py | 15 +
dts/framework/test_run.py
Add an RTE Flow API testing suite, which covers some basic
synchronous Flow API rules that should be supported across PMDs.
This suite will be added to over time, as the Flow API is too large
to cover all in one suite, and sending one monolithic series
would be impossible.
Signed-off-by: Dean
Remove unnecessary verification step in the start method
of TestPmdShell which checks the link status.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 7 ---
1 file changed, 7 deletions(-)
diff --git a/dts/framework/remote_session/testpmd_shell.py
b/dts
Add a physical function NIC capability that checks
if the test run is using PFs. Add PF capability
requirement to all suites/cases that do not
run without error on virtual functions.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 22 +++
dts/tests
enabled.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_checksum_offload.py | 69 ---
dts/tests/TestSuite_dual_vlan.py | 6 +-
dts/tests/TestSuite_dynamic_queue_conf.py | 2 +-
dts/tests/TestSuite_mtu.py| 7 ++-
dts/tests
Add virtual functions to DTS framework, along with
a field for specifying VF test runs in the config file.
Signed-off-by: Patrick Robb
Signed-off-by: Dean Marx
---
dts/framework/config/test_run.py | 2 +
dts/framework/test_run.py| 7 +++
dts/framework
Add virtual functions to DTS framework, along with
a field for specifying VF test runs in the config file.
Signed-off-by: Patrick Robb
Signed-off-by: Dean Marx
---
dts/framework/config/test_run.py | 2 +
dts/framework/test_run.py| 7 +++
dts/framework
Rearrange the topology and DPDK setup/teardown calls during
test runs to ensure the devbind script is not called
while the DPDK tmp directory doesn't exist.
Fixes: 4cef16f1f0a4 ("dts: improve port handling")
Signed-off-by: Dean Marx
---
dts/framework/test_run.py | 5 +++--
1
Rearrange the topology and DPDK setup/teardown calls during
test runs to ensure the devbind script is not called
while the DPDK tmp directory doesn't exist.
Fixes: 4cef16f1f0a4 ("dts: improve port handling")
Signed-off-by: Dean Marx
---
dts/framework/test_run.py | 5 +++--
1
Rearrange the topology and DPDK setup/teardown calls during
test runs to ensure the devbind script is not called
while the DPDK tmp directory doesn't exist.
Fixes: 4cef16f1f0a4 ("dts: improve port handling")
Signed-off-by: Dean Marx
---
dts/framework/test_run.py | 4 ++--
1
e mapping of test suite names
to their corresponding configurations."
Reviewed-by: Dean Marx
Add QinQ strip and VLAN extend methods to TestPmdShell class.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 52 +++
1 file changed, 52 insertions(+)
diff --git a/dts/framework/remote_session/testpmd_shell.py
b/dts/framework/remote_session
Add QinQ test suite, which verifies PMD behavior when
sending QinQ (IEEE 802.1ad) packets.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_qinq.py | 240
1 file changed, 240 insertions(+)
create mode 100644 dts/tests/TestSuite_qinq.py
diff --git a/dts
Forwarding - Confirms both VLAN tags are preserved across
forwarding paths.
Mismatched TPID Handling - Tests behavior when the outer VLAN uses
a non-standard TPID, ensuring proper fallback behavior.
Dean Marx (2):
dts: add qinq strip and VLAN extend to testpmd shell
dts: add qinq test
Modify dts.rst to exclude redundant/outdated information about the project,
and add new information regarding setup and framework design.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
doc/guides/tools/dts.rst | 372
Remove unnecessary information from README.md,
and add new sections to clarify the purpose/use
of DTS along with clear setup instructions.
Signed-off-by: Dean Marx
Reviewed-by: Patrick Robb
Reviewed-by: Paul Szczepanek
---
dts/README.md | 115
or SIGQUIT, not SIGINT:
https://www.chromium.org/chromium-os/developer-library/reference/linux-constants/signals/
Otherwise:
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
Tested-by: Dean Marx
Tested-by: Dean Marx
Remove unnecessary information from README.md, and add new sections to clarify
the purpose/use of DTS along with clear setup instructions.
Signed-off-by: Dean Marx
---
dts/README.md | 104 +++---
1 file changed, 39 insertions(+), 65 deletions(-)
diff
Modify dts.rst to exclude redundant/outdated information about the project,
and add new information regarding setup and framework design.
Signed-off-by: Dean Marx
---
doc/guides/tools/dts.rst | 310 +--
1 file changed, 99 insertions(+), 211 deletions(-)
diff
Fix a bug in the port stats check test suite that was causing
the DTS doc generation to fail.
Fixes: 8f21210b1d50 ("dts: add port stats check test suite")
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_port_stats_checks.py | 13 +
1 file changed, 9 insertions(+), 4
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
Reviewed-by: Dean Marx
s.
This commit message is worded a bit strangely to me, not sure garnered
is the right word to use here. Also not sure what "as such" is
referring to exactly
> +"""Performance testing capable traffic generatiors."""
*generators
Reviewed-by: Dean Marx
Add jump action verification method and test case to Flow API test suite,
as well as a case for validating flows with different priority levels.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_flow.py | 187 +++-
1 file changed, 165 insertions(+), 22 deletions
Add a method for validating flow rules to the testpmd shell class.
Implement test case skipping for flow rules that do not pass
validation.
Signed-off-by: Dean Marx
---
dts/framework/remote_session/testpmd_shell.py | 15
dts/framework/test_run.py | 3 +
dts/framework
Add an RTE Flow API testing suite, which covers some basic
synchronous Flow API rules that should be supported across PMDs.
This suite will be added to over time, as the Flow API is too large
to cover all in one suite, and sending one monolithic series
would be impossible.
Signed-off-by: Dean
ike the concept of having a configurations directory within DTS,
those files were starting to add up anyways.
Reviewed-by: Dean Marx
Add jump action verification method and test case to Flow API test suite,
as well as a case for validating flows with different priority levels.
Signed-off-by: Dean Marx
---
dts/tests/TestSuite_flow.py | 187 +++-
1 file changed, 165 insertions(+), 22 deletions
Add an RTE Flow API testing suite, which covers some basic
synchronous Flow API rules that should be supported across PMDs.
This suite will be added to over time, as the Flow API is too large
to cover all in one suite, and sending one monolithic series
would be impossible.
Signed-off-by: Dean
Remove capability requirement from checksum offload test suite
that was not required to run the test cases.
Signed-off-by: Dean Marx
Reviewed-by: Luca Vizzarro
Reviewed-by: Nicholas Pratte
---
dts/tests/TestSuite_checksum_offload.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/dts/tests
Looks good!
Reviewed-by: Dean Marx
Change the unified packet testing suite to use layer 4
destination ports as packet verification IDs.
Signed-off-by: Dean Marx
Reviewed-by: Luca Vizzarro
Reviewed-by: Nicholas Pratte
---
dts/tests/TestSuite_uni_pkt.py | 106 -
1 file changed, 51 insertions
Add a field to the TestPmdVerbosePacket text parser
that stores destination port values for TCP/UDP packets.
Signed-off-by: Dean Marx
Reviewed-by: Luca Vizzarro
Reviewed-by: Nicholas Pratte
---
dts/framework/remote_session/testpmd_shell.py | 5 +
1 file changed, 5 insertions(+)
diff
Change the checksum offload testing suite to use layer 4
destination ports as packet verification IDs.
Signed-off-by: Dean Marx
Reviewed-by: Luca Vizzarro
Reviewed-by: Nicholas Pratte
---
dts/tests/TestSuite_checksum_offload.py | 130 ++--
1 file changed, 77 insertions
Hi all,
I've submitted an RFC for an initial Flow test suite here:
https://patches.dpdk.org/project/dpdk/patch/20250515163809.184720-2-dm...@iol.unh.edu/
It covers most of the functionality discussed in this thread, besides
jump, RSS, and represented port actions which will be added in the
near
1 - 100 of 431 matches
Mail list logo
