summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
* weston: wrapper for weston modules argumentPavel Zhukov2021-10-113-0/+25
| | | | | | | | | | | | | | | Due to custom option parser implementation weston accepts only one argument of a given type. As the result if multiple modules add multiple --modules agruments only last will be used. This fix introduces wrapper around modules in terms of weston-init to prepare proper modules argument for weston and adds systemd-notify module into weston-init module to support Type=notify in systemd service file. (From OE-Core rev: c8aa0222ce2be647911114aaebcbb0d55d7caf87) Signed-off-by: Pavel Zhukov <pavel.zhukov@huawei.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* python3-more-itertools: upgrade 8.8.0 -> 8.9.0wangmy2021-10-111-1/+1
| | | | | | | | (From OE-Core rev: 665c8ee52a3d1c636a72df5668da397d9c636454) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* help2man: upgrade 1.48.4 -> 1.48.5wangmy2021-10-111-1/+1
| | | | | | | | | | | | | * Use @samp{} around the option in the menu description for "--help recommendations" to avoid rendering the -- as endash. * Update French translations * Update standards version to 4.6.0 (no changes). (From OE-Core rev: acfb0bd59dfa14a84e3b2b57ddc0dbbe1b065707) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* vulkan-tools: upgrade 1.2.182 -> 1.2.191wangmy2021-10-111-2/+2
| | | | | | | | (From OE-Core rev: f8edaf76ad0231d8f41e9ea3f69a25ebeafe681f) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* vulkan-loader: upgrade 1.2.182 -> 1.2.191wangmy2021-10-111-1/+1
| | | | | | | | (From OE-Core rev: db1c5c530fd1e0a26182a13ef26bd10e41c373b7) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* vulkan-headers: upgrade 1.2.182 -> 1.2.191wangmy2021-10-111-2/+2
| | | | | | | | (From OE-Core rev: e79a68d26f3126c16290355de6e391c15a539a60) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* tar: filter CVEs using vendor nameRalph Siemsen2021-10-111-3/+3
| | | | | | | | | | | | | | | | | | Recently a number of CVEs have been logged against a nodejs project called "node-tar". These appear as false positives against the GNU tar being built by Yocto. Some of these have been manually excluded using CVE_CHECK_WHITELIST. To avoid this problem, use the vendor name (in addition to package name) for filtering CVEs. The syntax for this is: CVE_PRODUCT = "vendor:package" When not specified, the vendor defaults to "%" which matches anything. (From OE-Core rev: 45d1a0bea0c628f84a00d641a4d323491988106f) Signed-off-by: Ralph Siemsen <ralph.siemsen@linaro.org> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* mount-copybind: add rootcontext mountoption for overlayfsMaximilian Blenk2021-10-111-1/+13
| | | | | | | | | | | | | | | | If selinux is enabled, the context of the mountpoint for overlayfs needs to be specified manually via the rootcontext option. To this end, the required context is determined using matchpathcon(1) and passed via the rootcontext mount option. Additionally, if the mount source directory is created by mount-copybind it also needs to take care that the context of the directory is correct (From OE-Core rev: 57f51e8c73ab9f55f20815a9459c3afad2b281e6) Signed-off-by: Tobias Kaufmann <Tobias.KA.Kaufmann@bmw.de> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* mount-copybind: add SELinux supportTobias Kaufmann2021-10-111-0/+12
| | | | | | | | | | | | | | bind mounts don't use the SELinux label of the target, but the SELinux label of the source. This patch restores the SELinux context of the bind mount recursively using restorecon. (From OE-Core rev: 6f3e231dc9bc11772573bf9683de9804460362d1) Signed-off-by: Tobias Kaufmann <Tobias.KA.Kaufmann@bmw.de> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* findutils: add ptestOleh Matiusha2021-10-114-2/+73
| | | | | | | | | | Placed it in PTESTS_SLOW since it takes 36s to execute this ptest on qemu. (From OE-Core rev: da489ef6e36711cb40d26f64f292fb92a0073f4a) Signed-off-by: Oleh Matiusha <oleh.matiusha@globallogic.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* harfbuzz: upgrade 2.9.0 -> 2.9.1wangmy2021-10-111-1/+1
| | | | | | | | | | | | | | | | | | | | Final subset API is in place and if no issues are discovered, it will be the stable subset API of HarfBuzz 3.0.0. Old API is kept to ease transition, but will be removed in 3.0.0. Various fuzzer-found bug fixes. hb_buffer_append() now handles the pre- and post-context which previously were left unchanged in the destination buffer. hb-view / hb-shape now accept following new arguments: --unicodes-before/after: takes a list of hex numbers that represent Unicode codepoints. Undeprecated API: hb_set_invert() (From OE-Core rev: 0a9d19f575fda7db2f768f77701a137da8f73a97) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gzip: upgrade 1.10 -> 1.11wangmy2021-10-112-2/+1
| | | | | | | | (From OE-Core rev: 67ee7aeaafcfdeeadcc3a7a33dd038de241b339f) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* iproute2: update to 5.14.0Changhyeok Bae2021-10-111-1/+1
| | | | | | | | (From OE-Core rev: 6c5d37fd42f7ed53c293717d815b4e2ebc1aa3fc) Signed-off-by: Changhyeok <changhyeok.bae@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libhandy: update 1.2.3 -> 1.4.0Alexander Kanavin2021-10-111-2/+2
| | | | | | | (From OE-Core rev: 1254ba120600a7edd8a88ee8a37900cbf66365ee) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libssh2: update 1.9.0 -> 1.10.0Alexander Kanavin2021-10-115-284/+5
| | | | | | | | | | | 0001-configure-Conditionally-undefine-backend-m4-macro.patch no longer needed; code removed upstream. License-Update: copyright years (From OE-Core rev: 6547e565cc1685eb4e42f61d88203cf743a06284) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libgit2: update 1.1.1 -> 1.2.0Alexander Kanavin2021-10-111-4/+4
| | | | | | | | | | License-Update: includes portions of openssl headers https://github.com/libgit2/libgit2/commit/0903cac1d08817e87c556f5a3e6ec881be86c7f2 (From OE-Core rev: 81a101332e7e59848165b06b734056a385e8cc3f) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* rt-tests: update 2.1 -> 2.2Alexander Kanavin2021-10-112-5/+5
| | | | | | | (From OE-Core rev: dddc71a2060ebb5a73957becfcd3904d128608f5) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libpam: update 1.5.1 -> 1.5.2Alexander Kanavin2021-10-113-59/+4
| | | | | | | | | | | | Drop patches: issues fixed upstream. Move .pc files to correct place as libpam is instructed to install them in /lib via --libdir. (From OE-Core rev: b2aeaab36d7d46d47301d0729b634d182277cfbd) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lsof: update 4.91 -> 4.94.0Alexander Kanavin2021-10-112-32/+13
| | | | | | | | | | Drop all custom sourcedir handling as the source is now a standard git checkout. (From OE-Core rev: 13965426b79e8c32f800a4317454321cfd2d06d1) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* systemd: update 249.3 -> 249.4Alexander Kanavin2021-10-1127-33/+34
| | | | | | | (From OE-Core rev: 14c6e5a4b72d0e4665279158a0740dd1dc21f72f) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* inetutils: drop CVE-2021-40491 patchAlexandre Belloni2021-10-112-89/+0
| | | | | | | | | This CVE is already fixed in inetutils 2.2 (From OE-Core rev: d0c64bd9aef5fa4bf60cac922b1d5e43652f7919) Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* inetutils: update 2.1 -> 2.2Alexander Kanavin2021-10-112-7/+7
| | | | | | | (From OE-Core rev: c5095396909e6b1450ba2020472b5eb7d14a4751) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* shaderc: update 2021.1 -> 2021.2Alexander Kanavin2021-10-111-1/+1
| | | | | | | (From OE-Core rev: 82d3acd5bdc8821c07b754ae1abf49c544c4de19) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* glslang: update 11.5.0 -> 11.6.0Alexander Kanavin2021-10-111-1/+1
| | | | | | | (From OE-Core rev: 15eeaa54c2b8c2c159cd3b4cb7db0b6f0ebb3630) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* spirv-tools: update 2021.2 -> 2021.3Alexander Kanavin2021-10-113-35/+3
| | | | | | | | | | | | Drop 0001-fix-strncpy-bound-error.patch; issue fixed upstream. Bump spirv-headers revision to avoid outdated headers causing build errors. (From OE-Core rev: b1a6ac721fba17afa09f4da6c0c01730228b129c) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* pinentry: update 1.1.1 -> 1.2.0Alexander Kanavin2021-10-114-56/+74
| | | | | | | | | Rebase patches. (From OE-Core rev: dbb0e50375a5720d38c966fc4c5810eea1ec0203) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* gnupg: update 2.3.1 -> 2.3.2Alexander Kanavin2021-10-113-28/+19
| | | | | | | | | Drop chunk from relocate.patch, the upstream code no longer exists. (From OE-Core rev: 8f268f981d53615d8ac9ee3ee64d840dc7051ced) Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* runqemu: correct vga-virtio option to keep virgl enabledAlexander Kanavin2021-10-111-1/+1
| | | | | | | | | | qemu 6.1 has (perhaps unintentionally) disabled virgl in -vga virtio: https://gitlab.com/qemu-project/qemu/-/issues/586 (From OE-Core rev: 2c6c7f0ff24da7060cea35f8ff89f2cabd96f2fb) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* qemu: update 6.0.0 -> 6.1.0Alexander Kanavin2021-10-1121-731/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Recipe changes: qemu-plugin.h is installed by both qemu-native and qemu-system-native qmp.py module is now provided in a module directory (no other files from that directory are necessary to use it though) additional host-specific info is stripeed from ptest tests/tcg/*.mak Patches: drop all backports drop 0001-Add-enable-disable-udev.patch (change added upstream) drop 0001-linux-user-Tag-vsx-with-ieee128-fpbits.patch (issue fixed upstream) drop 0004-qemu-disable-Valgrind.patch (valgrind detection moved from configure to meson, and should be robust against host contamination) rebase 0010-configure-Add-pkg-config-handling-for-libgcrypt.patch (upstream moved libgcrypt handling from configure to meson, and using pkg-config is now a one-liner adjustment) rebase cross.patch (From OE-Core rev: b2710d25e3d8d79a35dbd4332ffc5cc8053d5eb8) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* package_rpm: use zstd instead of xzAlexander Kanavin2021-10-112-2/+6
| | | | | | | | | | | | | | | | | zstd has similar time and space performance in compression but is vastly faster in decompression, which benefits rootfs creation (especially when installing very large packages) and on-target package installation. Also, ensure ZSTD_THREADS doesn't change sstate checksums. The detailed explanation is in the commit making similar change for XZ_THREADS. (From OE-Core rev: e72c0b94554a9bc293844ec2bddb0c04ea19791d) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* perl: do not build berkeley db module by defaultAlexander Kanavin2021-10-111-1/+1
| | | | | | | | | | | | | | Bdb is unmaintained and altogether obsolete, the less dependencies we have on it, the better. This leaves only apt (specifically, apt-ftparchive) in core as a bdb consumer, sadly it has a hard dependency that isn't easy to patch out. Maybe apt upstream will get to it at some point. (From OE-Core rev: 0d9ca78951cfe98bfaaf426572c42dbbb6169cd6) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libsolv: disable rpm bdb format supportAlexander Kanavin2021-10-111-1/+1
| | | | | | | | | Otherwise this causes runtime errors when only sqlite is present. (From OE-Core rev: 190d9944383d525fa57a0fa9ac634480d50e56bb) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libdnf: fix the rpm sqlite-only target setupAlexander Kanavin2021-10-112-0/+38
| | | | | | | (From OE-Core rev: 8bbbcf9f8db1112a08c89ed8ee76c8c65f1ea179) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* rpm: update 4.16.1.3 -> 4.17.0Alexander Kanavin2021-10-118-197/+52
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The flagship features are migration from bdb to sqlite and zstd support, both are enabled and taken into use. The relationship and upstream preference between sqlite and ndb formats isn't quite clear. Lua is now a hard dependency. Added packageconfig option for r/o support for bdb (that doesn't need bdb itself), but not enabled it as upstream marks it EXPERIMENTAL in capital letters. Drop sed adjustment for a file that is not anymore installed. Adjust oeqa test to check for sqlite database instead of bdb. Drop 0001-Fix-build-with-musl-C-library.patch (nss support removed upstream) 0001-rpm-rpmio.c-restrict-virtual-memory-usage-if-limit-s.patch (difficult to undersand and rebase; obsolete with the move to zstd) 0011-Do-not-require-that-ELF-binaries-are-executable-to-b.patch (upstream made the same change) Portions of 0001-tools-Add-error.h-for-non-glibc-case.patch dropped (upstream moved the files to a separate component). Added 0001-docs-do-not-build-manpages-requires-pandoc.patch to avoid pandoc dependency. Added 0001-build-pack.c-do-not-insert-payloadflags-into-.rpm-me.patch to restore reproducibility when compression thread amount varies between hosts. (From OE-Core rev: 6080fcf7e4f64faedd98ed26b65a3bc29ef08238) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lua: update 5.3.6 -> 5.4.3Alexander Kanavin2021-10-115-379/+13
| | | | | | | | | | | | | Drop three backports and 0001-Allow-building-lua-without-readline-on-Linux.patch (feature added upstream, adjust the recipe accordingly). Adjust ar/ranlib flags for reproducibility on liblua.a. License-Update: lines moved around, formatting (From OE-Core rev: c2cad5ecfbbcee99b3cbe71efeeac9a875b6e5ff) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* lua: add a recipe from meta-oeAlexander Kanavin2021-10-119-0/+459
| | | | | | | | | Lua is a hard dependency in rpm 4.17. (From OE-Core rev: b06a2ffb5ded807dbb30078d10740ec294732cad) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* libcap: update 2.51 -> 2.54Alexander Kanavin2021-10-113-59/+7
| | | | | | | | | | | | Rebase patches. Delete 0001-tests-do-not-statically-link-a-test.patch as centos builds are now using their own buildtools. (From OE-Core rev: ecadaa08956f53dfedee908a0344f512673b770b) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* meson: update 0.58.1 -> 0.59.1Alexander Kanavin2021-10-116-149/+10
| | | | | | | | | | | | | | Drop 0003-native_bindir.patch: it doesn't seem to actually define anything where the use_native parameter is set to true. Also, the issue should be solved without invasive, custom patching of the code: via meson.cross, custom .pc files for the items in question or some other configuration mechanism. (From OE-Core rev: 191d6d1f614a78ef8496e4357d419c68d1e03170) Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* cmake: upgrade 3.21.1 -> 3.21.2wangmy2021-10-113-1/+1
| | | | | | | | (From OE-Core rev: 6f39d593687e7b90be8f7fdc671c539c3d95a57b) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* wayland-protocols: upgrade 1.21 -> 1.22Denys Dmytriyenko2021-10-111-1/+1
| | | | | | | | | | | | | | | | | | wayland-protocols 1.22 is now available. This release includes a new staging protocol: DRM object leasing. Besides that, various test and build system improvements are included, as well as a set of clarifications to the xdg-activation protocol and other protocols. https://lists.freedesktop.org/archives/wayland-devel/2021-September/041972.html (From OE-Core rev: 17c59e425148c3b9e8110c79442c7f3e0dea198a) Signed-off-by: Denys Dmytriyenko <denis@denix.org> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* diffoscope: upgrade 181 -> 182wangmy2021-10-111-1/+1
| | | | | | | | (From OE-Core rev: 0410d639bb1b54feddd790e7ac71fa949f7151d8) Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* layer.conf: Extend recipes not to install without explict dependenciesRichard Purdie2021-10-111-1/+11
| | | | | | | | | | | | | | | | There are several dependencies which recipes have which are not needed at runtime, only at build time. Extend the list of these from bison to include quilt, patch, meson, autoconf, automake and ninja which should reduce the amount of data being included in native sysroots. This speeds up and reduces the sstate needed for image builds for example. If this change breaks recipes, it probably means they're missing an explicit DEPENDS on something in this list which is a bug in the recipe. (From OE-Core rev: 8e26252b45b7660c7c67c702411bdec187a76ffc) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* build-appliance-image: Update to honister head revisionyocto-3.4honister-3.4Richard Purdie2021-10-111-1/+1
| | | | | | (From OE-Core rev: bb1dea6806f084364b6017db2567f438e805aef0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bitbake: bitbake: Bump to version 1.52.0Richard Purdie2021-10-112-2/+2
| | | | | | (Bitbake rev: c78ebac71ec976fdf27ea24767057882870f5c60) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* build-appliance-image: Update to honister head revisionRichard Purdie2021-10-111-2/+2
| | | | | | (From OE-Core rev: b3c387547c8b73ef134e6665e18bd4724d943133) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* poky.conf: Bump version for 3.4 honister releaseRichard Purdie2021-10-111-3/+3
| | | | | | (From meta-yocto rev: fc8c4b3b6bb0798edd4ac32c3c19a553a15b5749) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bitbake: hashserv: Improve behaviour for better determinism/sstate reuseRichard Purdie2021-10-112-8/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | We have a choice of policy with hashequivalence - whether to reduce sstate duplication in the sstate feed to a minimum or have maximal sstate reuse from the user's perspective. The challenge is that non-matching outhashes are generated due to determinism issues, or due to differences in host gcc version, architecture and so on and the question is how to reconcile then. The approach before this patch is that any new match is added and matches can update. This has the side effect that a queried value from the server can change due to the replacement and you may not always get the same value from the server. With the client side caching bitbake has, this can be suboptimal and when using the autobuilder sstate feed, it results in poor artefact reuse. This patch switches to the other possible behaviour, once a hash is assigned, it doesn't change. This means some sstate artefacts may be duplicated but dependency chains aren't invalidated which I suspect may give better overall performance. Update the tests to match the new behaviour. (Bitbake rev: 20d6ac753efa364349100cdc863e5eabec8e5b78) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bitbake: hashserv: Fix diverging report race conditionJoshua Watt2021-10-114-153/+314
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes the hashequivalence server to resolve the diverging report race error. This error occurs when the same task(hash) is run simultaneous on two different builders, and then the results are reported back but the hashes diverge (e.g. have different outhashes), and one outhash is equivalent to a hash and another is not. If taskhash was not originally in the database, the client will fallback to using the taskhash as the suggested unihash and the server will see reports come in like: taskhash: A unihash: A outhash: B taskhash: C unihash: C outhash: B taskhash: C unihash: C outhash: D Note that the second and third reports are the same taskhash, with diverging outhashes. Taskhash C should be equivalent to taskhash (and unihash) A because they share an outhash B, but the server would not do this when tasks were reported in the order shown. It became clear while trying to fix this that single large table to store all reported hashes was going to make these updates difficult since updating the unihash of all entries would be complex and time consuming. Instead, it makes more sense to split apart the database into two tables: One that maps taskhashes to unihashes and one that maps outhashes to taskhashes. This should hopefully improve the parsing query times as well since they only care about the taskhashes to unihashes table, at the cost of more complex INNER JOIN queries on the lesser used API. Note this change does delete existing hash equivlance data and starts a new database table rather than converting existing data. (Bitbake rev: dff5a17558e2476064e85f35bad1fd65fec23600) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bitbake: hashserv: Add tests for diverging reportsJoshua Watt2021-10-111-0/+53
| | | | | | | (Bitbake rev: 953c8d622c9d1bc1eb06bcaf1eaa3aa9f85d0bc2) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
* bitbake: async: Close sync client event loopJoshua Watt2021-10-112-2/+8
| | | | | | | | | | Prevents `ResourceWarning: unclosed event loop` warnings when using the synchronous client and python exits (Bitbake rev: 8b95972bc04ce52a98c7780184af15a5e95f987b) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>