[OE-core] [PATCH v5] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza <jose.pe

[OE-core] [PATCH] lsb/lsbtests: Update package lists to use latest version of binary

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Currently package list is pointing to "lsb-setup-4.1.0-1.noarch.rpm" which is not available anymore on http://ftp.linuxfoundation.org/pub/lsb/base/released-all/binary/ hence BASE_PACKAGES_LIST is updated to poi

[OE-core] [PATCH] selftest/devtool: Avoid writing on TOPDIR on kernel test case

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Use a tempdir to copy the .config file from the kernel instead of being copied to build directory. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/selftest/cases/de

[OE-core] [PATCH] test_sdkext: Add support to execute suite with pre-built artifacts from Auto Builder

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> testsdkest' suite is not working properly when using pre-built artifacts downloaded from AutoBuilder, some updates are applied as follows: - testsdk.bbclass: add functionally to override the .data.json file with the

[OE-core] [PATCH v2] oeqa/selftest: Add missing IDs to various test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add decorator @OETestID() with Tesopia TC-ID to the test cases that did not have it properly set. [YOCTO #11873] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/selftest/cases

[OE-core] [PATCH] oeqa/selftest: Add missing IDs to various test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add decorator @OETestID() with Tesopia TC-ID to the test cases that did not have it properly set. [YOCTO #11873] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/selftest/cases

[OE-core] [PATCH v2] oeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add 'bitbake -m' to the sync method and ensure all process related to bitbake are correctly unloaded before doing the different measurements. Also add a call to sync funtion on Test4 before final measurment of eSDK deploy di

[OE-core] [PATCH] oeqa/buildperf: Add 'bitbake -m' on sync function to ensure bitbake is unloaded

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add 'bitbake -m' to the sync method and ensure all process related to bitbake are correctly unloaded before doing the different measurements. Also add a call to sync funtion on Test4 before final measurment of eSDK deploy di

[OE-core] [PATCH] buildperf/tests_basics: sync the system to have clean esdk deploy dir

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> In some cases and depending on the resources measurement of disk usage for eSDK deploy dir is failing due “measure_disk_usage” was locking for tmp files (bitbake.lock and bitbake.sock) that were not deleted on time, th

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass

[OE-core] [PATCH 1/2] oeqa/runtime: Replace buildiptables for buildlzip on runtime tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues lzip package was selected to be used on the tests as this does not have any "musl" depende

[OE-core] [PATCH 2/2] testimage: Use the renamed buildlzip

From: Khem Raj buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass

[OE-core] [PATCH 0/2] Add lzip test instead of iptables for runtime

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> This series is created to replace iptables tests for lzip test and avoid conflicts with images built with “musl”. A two separate patches were sent before related to this, one for SDK [1] and other one to add c

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 10:40 AM, Khem Raj wrote: On Thu, Jul 6, 2017 at 8:34 AM, Jose Perez Carranza <jose.perez.carra...@linux.intel.com> wrote: On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj <raj.k...@gmail.com> ---

Re: [OE-core] [PATCH 22/22] testimage: Use the renamed buildlzip

On 07/06/2017 09:33 AM, Khem Raj wrote: buildiptables has been replaced with buildlzip Signed-off-by: Khem Raj --- meta/classes/testimage.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/testimage.bbclass

[OE-core] [PATCH v2] oeqa/sdk: Replace buildiptables for buildlzip tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues lzip package was selected to be used on the tests as this does not have any "musl" dep

Re: [OE-core] [PATCH] oeqa/sdk: Replace buildiptables for buildgzip tests

On 07/03/2017 11:59 AM, Khem Raj wrote: On Mon, Jul 3, 2017 at 9:26 AM, <jose.perez.carra...@linux.intel.com> wrote: From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Buildiptables test cases are conflicting with images built with “musl” as standard C library, in or

[OE-core] [PATCH] oeqa/sdk: Replace buildiptables for buildgzip tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Buildiptables test cases are conflicting with images built with “musl” as standard C library, in order to avoid those issues gzip package was selected to be used on the tests as this does not conflicts with “musl”. [YOCTO

[OE-core] [PATCH] selftest/bbtests: Create test case to verify bberror/waring

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Create test case that uses “crasher.bbclass” to generate some warnings and errors and verify that are correctly displayed on log. [YOCTO #9949] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com&g

[OE-core] [PATCH] selftest/seltest.py: Add test to check imports from other layers

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> This tests adds a check of selftest itself to verify if can add test from other layers. [YOCTO #9770] Signed-off-by: Mariano Lopez <mariano.lo...@linux.intel.com> Signed-off-by: Jose Perez Carranza <j

[OE-core] [PATCH 2/2] selftest: Add Testopia ID to test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add decorator @OETestID() with proper Tesopia TC ID to the test cases that did not have it set. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/selftest/cases/containerimage

[OE-core] [PATCH 1/2] systemdboot: Add Test to check boot file is created correctly

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add Test case to verify if EFI bootloader for systemd boot is correctly build inside of image. [YOCTO #9903] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- .../lib/oeqa/selftest/cases/sys

Re: [OE-core] [PATCH v4] runtime/dnf: Add new dnf test cases

On 06/14/2017 07:00 AM, Alexander Kanavin wrote: On 06/13/2017 10:56 PM, jose.perez.carra...@linux.intel.com wrote: From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering pa

[OE-core] [PATCH v4] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza <jose.pe

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

Thank you Alex ! I will work on a patch with your approach On 06/09/2017 04:22 AM, Alexander Kanavin wrote: On 06/08/2017 07:35 PM, Alexander Kanavin wrote: I haven't been able to reproduce the installroot failure, works fine here. The installroot issue is most likely due to dnf

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

On 06/08/2017 07:49 AM, Alexander Kanavin wrote: On 06/08/2017 03:49 PM, Jose Perez Carranza wrote: 1. bitbake core-image-sato using shared states (I'm using local sstates) When you do this, tmp/deploy/rpm should get re-populated with rpm packages, regardless of whether they're taken from

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

On 06/08/2017 06:31 AM, Alexander Kanavin wrote: On 06/07/2017 08:31 PM, Jose Perez Carranza wrote: When I tried this test image was built without using states hence "busybox*.rpm" and "curl*.rpm"where present under "tmp/deploy/rpm/core2_64" hence the r

Re: [OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

When I tried this test image was built without using states hence "busybox*.rpm" and "curl*.rpm"where present under "tmp/deploy/rpm/core2_64" hence the repo i taking tha packages form there to add them to repo and used on the image, but when using sstates those packages are not being built so

[OE-core] [PATCH v3] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza <jose.pe

Re: [OE-core] [PATCH v2] runtime/dnf: Add new dnf test cases

On 05/11/2017 01:56 PM, Alexander Kanavin wrote: On 05/11/2017 08:33 PM, jose.perez.carra...@linux.intel.com wrote: +def test_dnf_exclude(self): +excludepkg = 'curl-dev' +self.dnf('list %s' % excludepkg, 0) +self.dnf_with_repo('remove -y curl') +

[OE-core] [PATCH v2] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza <jose.pe

[OE-core] [PATCH] runtime/dnf: Add new dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test cases to test “exclude” and “installroot“ options, also modify the logic of filtering packages on the feed to have all the packages needed by the tests. [YOCTO #10744] Signed-off-by: Jose Perez Carranza <jose.pe

[OE-core] [PATCH] selftest/devtool: Modify test to use default config

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Modify “test_devtool_virtual_kernel_modify” to be executed with default configuration defined on oe-selftest test suite. A shorter string was added to the the header file to avoid overlapped sections when building kernel for q

[OE-core] [PATCH] devtool: Avoid touch sstates when cleaning linux-yocto environment

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> sstates are cleaned when ruining test_devtool_virtual_kernel_modify to have a clean environment but this is affecting eSDK test that are dependent of those sstates, hence “cleansstate” is replaced for “clean”. [YOCTO

[OE-core] [PATCH] oe-selftest : Unset SANITY_TESTED_DISTROS to avoid warnings on execution

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Unsetting SANITY_TESTED_DISTROS is required to avoid warnings that are treated like failures by oe-selftest suite. [YOCTO #11401] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- scripts

[OE-core] [PATCH] runtime/dnf : Add ID to the dnf test cases

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add the corresponding Testopia ID to the test cases for dnf Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/runtime/cases/dnf.py | 12 1 file changed, 12 inserti

[OE-core] [PATCH v2] selftest/devtool: Add test to verify "modify virtual/kernel"

From: Jose Perez Carranza <jose.perez.carra...@linux-ntel.com> The purpose of this test case is to verify that devtool modify works correctly when building the kernel. [YOCTO #10817] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/selftes

Re: [OE-core] [PATCH] selftest/devtool: Add test to verify "modify virtual/kernel"

On 03/09/2017 01:57 PM, Burton, Ross wrote: On 23 January 2017 at 22:13, > wrote: > > +checkmodcode = runCmd("strings %s | head -n 10 | grep '%s'" % (bzimagefile, modstring)) Annoyingly this bit is

[OE-core] [PATCH] selftest/runtime-tests: Modify positins test to reduce execution time

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Currently test_postinst_roofs_and_boot is building a full-cmdline image this is taking a lot of time to execute the test, so a minimal image will be build instead. Signed-off-by: Jose Perez Carranza <jose.pe

[OE-core] [PATCH] selftest/devtool: Add test to verify "modify virtual/kernel"

From: Jose Perez Carranza <jose.perez.carra...@linux-ntel.com> The purpose of this test case is to verify that devtool modify works correctly when building the kernel. [YOCTO #10817] Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux-ntel.com> --- meta/lib/oeqa/selftes

[OE-core] [PATCH] Tinfoil: Add test IDs to tinfoil test cases

From: Jose Perez Carranza <jose.perez.carra...@intel.com> Testopia entrances were created and the IDs retrieved are added to their corresponding test case on tinfoil script. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@intel.com> --- meta/lib/oeqa/selftest/tinfoil.py | 9

[OE-core] [PATCH] runtime: Add cleanup for logrotate tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Delete logrotate dir to avoid errors when test are executed more than 1 time on the same target. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/runtime/logrotate.py | 1 + 1

Re: [OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 12/13/2016 10:32 AM, Burton, Ross wrote: On 13 December 2016 at 16:17, Burton, Ross > wrote: It took over a minute to load a few tests. Do you have any idea why the discovery is so slow? at my host is very fast the load (1

[OE-core] [PATCH] postinst: Add a test case to verify postinst scripts behavior

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Add test case that verify behavior of postinst scripts at roofts time and when is delayed to the first boot directly on the target. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- .../

[OE-core] [PATCH] runtime: Update test cases numbers for runtime tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Update test case numbers on runtime tests to do match with templates defined on Testopia for 2.3 release Signed-off-by: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> --- meta/lib/oeqa/runtime/buildgalcu

Re: [OE-core] [PATCH] Test needed to verify postinst script order.

On 11/17/2016 06:14 AM, Burton, Ross wrote: On 16 November 2016 at 00:50, Francisco Pedraza > wrote: Will verify the following: 1. Compile a minimal image. 2. The compiled image will add the

Re: [OE-core] FW: [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/15/2016 03:11 PM, Burton, Ross wrote: On 15 November 2016 at 19:10, Benjamin Esquivel > wrote: The reason for the migration of the tests is for them to be included in the selftest execution. And for

Re: [OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/15/2016 11:16 AM, Burton, Ross wrote: On 15 November 2016 at 16:24, > wrote: +class TestPackagesFilterOutSystem(oeSelfTest): As the tests don't need anything special that oeSelfTest provides, can

[OE-core] [PATCH v2] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Currently the unittests for scripts on meta/lib/oe/tests are not being executed by any suite hence the best option is migrate them to meta/lib/oeqa/selftest/oelib-tests to be executed along with the selftest suite. [YOCTO

Re: [OE-core] [PATCH] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

On 11/03/2016 06:12 PM, Benjamin Esquivel wrote: Hello José, a couple of comments below. On Thu, 2016-11-03 at 17:46 -0500, jose.perez.carra...@linux.intel.com wrote: From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Currently the unittests for scripts on meta/

[OE-core] [PATCH] oe-tests: Migrate tests from /oe/test to /oeqa/selftest/oe-tests

From: Jose Perez Carranza <jose.perez.carra...@linux.intel.com> Currently the unittests for scripts on meta/lib/oe are not being executed by any suite hence the best option is migrate them to meta/lib/oeqa/selftest to be executed along with the selftest suite. [YOCTO #7376] Signed-off-by

[OE-core] [PATCH] buildperf: Add support for times without decimal part

Add logic for the cases when the time retrieved does not have decimal part. Signed-off-by: Jose Perez Carranza <jose.perez.carra...@intel.com> --- meta/lib/oeqa/buildperf/base.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/me

[OE-core] [PATCH] oeqa/controllers: Add test target for Systemd-boot

A new test target is neede to test Systemd-boot similar to gummiboot. Created a copy of GummibootTarget class and named as SystemdbootTarget, at this point the gummibootTarget will remain until documentation is updated with new systed information. Signed-off-by: Jose Perez Carranza