Commit Graph

2076 Commits

Author SHA1 Message Date
Robert Marko
2116073f98 tools: libdeflate: backport fix for AVX-VNNI
Trying to compile with new new enough GCC but older binutils that dont
support AVX-VNNI will error out on the assembler, so backport an upstream
fix for it.

Fixes: 338b463e1e ("tools: libdeflate: update to 1.20")
Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-15 13:52:37 +02:00
Tony Ambardar
20c0dfb8e1 tools/dwarves: add myself as PKG_MAINTAINER
Missed setting this when first adding package.

Signed-off-by: Tony Ambardar <itugrok@yahoo.com>
2024-04-15 12:43:37 +02:00
Robert Marko
338b463e1e tools: libdeflate: update to 1.20
Changes:
* Improved CRC-32 performance on recent x86 CPUs by adding
VPCLMULQDQ-accelerated implementations using 256-bit and 512-bit vectors.

* Improved Adler-32 performance on recent x86 CPUs by adding
VNNI-accelerated implementations using 256-bit and 512-bit vectors.

* Improved CRC-32 and Adler-32 performance on short inputs.

* Optimized the portable implementation of Adler-32.

* Added some basic optimizations for RISC-V.

* Dropped support for gcc versions older than v4.9 (released in 2014) and
clang versions older than v3.9 (released in 2016).

* Dropped support for CRC-32 acceleration on 32-bit ARM using the ARMv8 pmull or crc32 instructions.
This code only worked on CPUs that also have a 64-bit mode, and it was
already disabled on many compiler versions due to compiler limitations.
CRC-32 acceleration remains fully supported on 64-bit ARM.

Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-14 19:52:46 +02:00
Robert Marko
e65800d948 tools: zstd: dont override CLI max level
Now that instead of relying on env variables for the GH download script
invoking ZSTD tarball compression it passes the full arguments via tar -I
we can drop the CLI max compression level override.

Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-09 18:39:36 +02:00
Christian Marangi
f2fabf7aaa
tools: zstd: add patch fixing wrong generated .pc with lib-mt
The current .pc generated by make build system for zstd is wrong and
always assume a single-threaded library is used.

This wasn't the case for the meson build system that used his own logic
to generate the pkg-config file.

Add a patch to fix this by introducing install-mt-pc make target to
generate the correct pkg-config gile.

Signed-off-by: Christian Marangi <ansuelsmth@gmail.com>
2024-04-06 14:58:48 +02:00
Nick Hainke
0a0d89265e Revert "tools/mkimage: update to v2024.04"
This reverts commit 8d934c1196.

The update seems to be causing issues that need to be further
explored [0]. Let's revert it.

[0] - https://github.com/openwrt/openwrt/pull/15078

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-04-06 14:52:06 +02:00
Robert Marko
076e860418 tools: zstd: install headers as well
We forgot to make sure install-includes is called for the libzstd in
order for it to install the required headers.

Fixes: 4b920e799f ("tools: zstd: convert to make and drop meson dependency")
Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-06 12:10:51 +02:00
Paul Spooren
b3c1c57a35 treewide: update PKG_MIRROR_HASH to zst
When using zst instead of xz, the hash changes. This commit fixes the
hash for packages and tools in core.

Signed-off-by: Paul Spooren <mail@aparcar.org>
2024-04-06 11:24:18 +02:00
Robert Marko
bab3ae2ee7 tools: prefer gz or bz2 tarballs
In the light of recent XZ events, and fundamental XZ issues lets work on
moving away from using XZ.

So, use gz compressed tarballs as sources whenever possible.

dwarves only offers bz2 compressed tarballs, so use those as size
difference is minor compared to XZ.

Signed-off-by: Robert Marko <robimarko@gmail.com>

dwarves
2024-04-06 11:24:18 +02:00
Robert Marko
4c7591c426 tools: libdeflate: fetch source as tarball
libdeflate is currently intentionally being fetched via GIT.

However, with the move to using ZSTD to compress the cloned GIT repo
tarballs it means that we would first need to compile ZSTD.
But that means that we need to be able to unpack gzipped tarballs first
which we currently do by using libdeflate-gzip.
So, in order to do so lets fetch libdeflate as a tarball, use gzip to
extract it and then use libdeflate as regular for all other tools.

Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-06 11:24:18 +02:00
Rosen Penev
e09d3fd290 tools: rework tools-core dependecies
ZSTD and libdeflate do not depend on SED nor flock, so instead of the whole
for loop that will filter 2 out of 4 core packages just specify that patch
and tar depend on sed explicitly.

ZSTD now depends on libdeflate since libdeflate-gzip will then be used to
unpack ZSTD as well as most tool archives.

Signed-off-by: Rosen Penev <rosenp@gmail.com>
Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-06 11:24:18 +02:00
Christian Marangi
c3e43b7e65 tools: make zstd tool core and xz tool non-core
Make zstd tool core and xz tool non-core since zstd is the new default
for compression format.

Signed-off-by: Christian Marangi <ansuelsmth@gmail.com>
2024-04-06 11:24:18 +02:00
Robert Marko
d5c4cb0a8d tools: zstd: dont override ZSTD_LEGACY_SUPPORT
We dont really have a reason to deviate from the upstream default for
ZSTD_LEGACY_SUPPORT value of 5, as it will save a bit of space but
prevent decompressing data compressed with legacy ZSTD versions.

Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-04-06 11:24:18 +02:00
Christian Marangi
ed149717ee tools: zstd: override max safe compression level
ZTSD limits the safe compression level to a max of 19 as 20 to 22 cause
increased RAM usage. Higher levels require --ultra arg passed.

There isn't currently a way to set --ultra using ENV options similar to
ZSTD_CLEVEL and ZSTD_CLEVEL is limited to 19.

To fix this, we can increase the max safe compression level by providing
a custom ZSTDCLI_CLEVEL_MAX value with CFLAGS.

The max safe level is increased to 20.

Signed-off-by: Christian Marangi <ansuelsmth@gmail.com>
2024-04-06 11:24:18 +02:00
Christian Marangi
4b920e799f tools: zstd: convert to make and drop meson dependency
Convert to make and drop meson dependency since it's not a core tools
and can't depend on advanced build system like cmake or meson.

On top of this make is the official build support and cmake/meson are
supported by 3rd parties.

Signed-off-by: Christian Marangi <ansuelsmth@gmail.com>
2024-04-06 11:24:18 +02:00
Nick Hainke
8d934c1196 tools/mkimage: update to v2024.04
Update to latest version.

Refresh patches:
- 030-allow-to-use-different-magic.patch
- 095-tools-disable-TOOLS_FIT_FULL_CHECK.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-04-06 08:02:40 +02:00
Felix Fietkau
1f3e0177d9 tools/bzip2: switch to cmake
Fixes portability issues on macOS.
CMakeLists.txt is a stripped-down backport from bzip2 upstream

Signed-off-by: Felix Fietkau <nbd@nbd.name>
2024-04-03 18:56:58 +02:00
Paul Spooren
004c853019 zstd: update to 1.5.6
Full changelog here:
https://github.com/facebook/zstd/releases/tag/v1.5.6

Signed-off-by: Paul Spooren <mail@aparcar.org>
2024-04-02 16:19:39 +02:00
Robert Marko
0c96d20bf9 tools: b43-tools: fix compilation with GCC14
GCC14 no longer treats integer types and pointer types as equivalent in
assignments (including implied assignments of function arguments and return
values), and instead fails the compilation with a type error.

So, as a workaround lets disable the newly introduced error
-Werror=int-conversion and just make it print a warning to enable compiling
with GCC14 as Fedora 40 now defaults to it.

Signed-off-by: Robert Marko <robimarko@gmail.com>
2024-03-30 10:42:47 +01:00
Rosen Penev
fcdc629144 tools/meson: update to 1.3.2
Add explicit setup as implicit is deprecated.

Rename pkgconfig as no hyphen is deprecated.

Signed-off-by: Rosen Penev <rosenp@gmail.com>
2024-03-29 23:42:22 +01:00
Petr Štetiar
d4b6b76443
Revert "tools/xz: update to 5.6.1" (CVE-2024-3094)
This reverts commit 714c91d1a6 as probably
the upstream xz repository and the xz tarballs have been backdoored.

References: https://www.openwall.com/lists/oss-security/2024/03/29/4.
Signed-off-by: Petr Štetiar <ynezz@true.cz>
2024-03-29 16:59:56 +00:00
Felix Fietkau
383b68e73c tools/cmake: disable xcode generator
Fixes build on latest macOS SDK

Signed-off-by: Felix Fietkau <nbd@nbd.name>
2024-03-29 15:40:25 +01:00
Felix Fietkau
c9ae8fd3d4 tools/e2fsprogs: disable building fuse2fs to avoid depending on libfuse
Signed-off-by: Felix Fietkau <nbd@nbd.name>
2024-03-29 15:39:04 +01:00
Nick Hainke
b05aad58e8 tools/cmake: update to 3.29.0
Changelog:
- https://www.kitware.com/cmake-3-29-0-available-for-download/

Refresh patches:
- 120-curl-fix-libressl-linking.patch
- 130-bootstrap_parallel_make_flag.patch
- 150-zstd-libarchive.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-03-29 07:18:07 +01:00
Nick Hainke
714c91d1a6 tools/xz: update to 5.6.1
Change mirror to github.

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-03-29 06:56:43 +01:00
Josef Schlehofer
80b2288ea3 tools/expat: update to version 2.6.2
Release notes:
https://github.com/libexpat/libexpat/blob/R_2_6_2/expat/Changes

Fixes:
CVE-2024-28757

Signed-off-by: Josef Schlehofer <pepe.schlehofer@gmail.com>
2024-03-26 10:37:37 +01:00
Hauke Mehrtens
2ac6fe6a88 tools: firmware-utils: update to git HEAD
6b24299 ptgen: fix limitation for active partition in GPT

Signed-off-by: Hauke Mehrtens <hauke@hauke-m.de>
2024-03-23 15:50:59 +01:00
Sander Vanheule
3b4cfb25bc tools: firmware-utils: update to git HEAD
Add the new 'zycast' tool for remote flashing of Zyxel devices, support
for factory image generation for two new TP-Link devices, and improved
compatibility with two other devices.

    17de36575f1e zycast: disable build on non-Linux OS
    a5dfb5fb5e6e tplink-safeloader: add TP-Link RE205 v3 support
    c1e06daf4622 tplink-safeloader: bump EAP225-V3 compat_level
    335d063cff23 tplink-safeloader: bump EAP225-Outdoor v1 compat
    c1e69e6f9c0d tplink-safeloader: show compat_level with FW info
    e87f23849790 zycast: new tool for ZyXEL bootloader flashing
    9067281d17da tplink-safeloader: add RE365 v1

Signed-off-by: Sander Vanheule <sander@svanheule.net>
2024-03-23 15:36:34 +01:00
Paul Spooren
e8725a932e treewide: use APK compatible version schema
Different from OPKG, APK uses a deterministic version schema which chips
the version into chunks and compares them individually. This enforces a
certain schema which was previously entirely flexible.

 - Releases are added at the very and end prefixed with an `r` like
`1.2.3-r3`.
- Hashes are prefixed with a `~` like `1.2.3~abc123`.
- Dates become semantic versions, like `2024.04.01`
- Extra tags are possible like `_git`, `_alpha` and more.

For full details see the APK test list:
https://gitlab.alpinelinux.org/alpine/apk-tools/-/blob/master/test/version.data

Signed-off-by: Paul Spooren <mail@aparcar.org>
2024-03-22 22:14:22 +01:00
Weijie Gao
53e3851646 tools: add util-linux
since kernel 6.4, commit bca2f3a9406b ("efi/zboot: Add BSS padding
before compression") introduces the use of hexdump to padding the
EFI kernel binary before compression.

util-linux which containing hexdump should then be compiled as a host
tool to guarantee not breaking the kernel build process.

Signed-off-by: Weijie Gao <hackpascal@gmail.com>
2024-03-11 20:17:25 +01:00
Tony Ambardar
043da3fe5a tools/dwarves: update to 1.26
Release Notes:
https://lore.kernel.org/dwarves/20240228193921.JWQp1Mc2M47ffhgIjnHKh8538u4uztVKuznlck9Pk9E@z/

Signed-off-by: Tony Ambardar <itugrok@yahoo.com>
2024-02-28 15:12:30 -08:00
Koen Vandeputte
f3cbdaec29 tools/expat: fix build error with ccache
Disable compilation of separate tests as it causes
a build error when combined with ccache

Fixes: 4a3f430d72 ("tools/expat: update to 2.6.0")
Signed-off-by: Koen Vandeputte <koen.vandeputte@citymesh.com>
2024-02-15 12:02:20 +01:00
Nick Hainke
4a3f430d72 tools/expat: update to 2.6.0
Changelog:
https://github.com/libexpat/libexpat/blob/R_2_6_0/expat/Changes

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-02-12 09:57:08 +01:00
Nick Hainke
b49a6f685b tools/ccache: update to 4.9.1
Release Notes:
https://ccache.dev/releasenotes.html#_ccache_4_9_1

Manually refresh patch:
- 100-honour-copts.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-02-12 09:51:03 +01:00
Nick Hainke
8b113bfc6e tools/cmake: update to 3.28.3
Release Notes:
https://www.kitware.com/cmake-3-28-3-available-for-download/

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-02-06 19:19:22 +01:00
Nick Hainke
c0c175e4fe tools/pkgconf: update to 2.1.1
Changes:
2edf954f3a/NEWS

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-02-06 19:18:55 +01:00
Nick Hainke
3595931934 tools/ccache: update to 4.9
Release Notes:
https://ccache.dev/releasenotes.html#_ccache_4_9

Manually refresh patch:
- 100-honour-copts.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-02-02 17:32:50 +01:00
Nick Hainke
906595c262 tools/cmake: update to 3.28.2
Release Notes:
https://www.kitware.com/cmake-3-28-2-available-for-download/

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-01-30 15:27:37 +01:00
Nick Hainke
dfb4babfdf tools/xz: update to 5.4.6
Changelog:
https://git.tukaani.org/?p=xz.git;a=blob;f=NEWS;h=d271dad2d3f1ec54e56ef8fa60275a88697a24aa;hb=0ef8192e8d5af4e6200d5d4aee22d1f177f7a2df

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-01-30 10:37:34 +01:00
Nick Hainke
25080a95dc tools/zlib: update to 1.3.1
Release Notes:
https://github.com/madler/zlib/releases/tag/v1.3.1

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-01-30 10:35:15 +01:00
Nick Hainke
ae7a7ef5da tools/mkimage: update to 2024.01
Update to latest version.

Refresh patch:
- 030-allow-to-use-different-magic.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-01-25 16:07:42 +01:00
Nick Hainke
6fbe36a618 tools/cpio: update to 2.15
Release Notes:
https://lists.gnu.org/archive/html/info-gnu/2024-01/msg00006.html

Signed-off-by: Nick Hainke <vincent@systemli.org>
2024-01-25 16:06:49 +01:00
Nick Hainke
659f027e69 tools/cmake: update to 3.28.1
Release Notes:
https://www.kitware.com/cmake-3-28-1-available-for-download/

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-18 12:55:28 +01:00
Sander Vanheule
090bb649ab tools: firmware-utils: update to git HEAD
Adds two changes improving compatibility with supported TP-Link devices.

5e14973d2199 tplink-safeloader: add Archer A6 v2 (RU)
d87b6c4b6423 tplink-safeloader: bump EAP615-Wall compat_level

Signed-off-by: Sander Vanheule <sander@svanheule.net>
2023-12-17 19:39:50 +01:00
Nick Hainke
0827fb8cc3 tools/cmake: update to 3.28.0
Release Notes:
- https://www.kitware.com/cmake-3-28-0-available-for-download/

Refresh patches:
- 120-curl-fix-libressl-linking.patch
- 130-bootstrap_parallel_make_flag.patch

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-12 00:44:31 +01:00
Nick Hainke
b9bd3feeb4 tools/bash: update to 5.2.21
Update to latest release.

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-08 16:28:40 +01:00
Nick Hainke
0c1cffd00e tools/pkgconf: update to 2.1.0
Changes:
5825e2c6d6/NEWS (L4)

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-08 09:30:40 +01:00
Nick Hainke
230a2b8a5e tools/cmake: update to 3.27.9
Release Notes:
- https://www.kitware.com/cmake-3-27-7-available-for-download/
- https://www.kitware.com/cmake-3-27-9-available-for-download/

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-07 11:55:06 +01:00
Nick Hainke
8bc448eff5 tools/mold: update to 2.3.2
Release Notes:
https://github.com/rui314/mold/releases/tag/v2.3.2

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-04 13:24:50 +01:00
Nick Hainke
39bdcec011 tools/xz: update to 5.4.5
* liblzma:
    - Use __attribute__((__no_sanitize_address__)) to avoid address
      sanitization with CRC64 CLMUL. It uses 16-byte-aligned reads
      which can extend past the bounds of the input buffer and
      inherently trigger address sanitization errors. This isn't
      a bug.
    - Fixed an assertion failure that could be triggered by a large
      unpadded_size argument. It was verified that there was no
      other bug than the assertion failure.
    - Fixed a bug that prevented building with Windows Vista
      threading when __attribute__((__constructor__)) is not
      supported.
* xz now properly handles special files such as "con" or "nul" on
  Windows. Before this fix, the following wrote "foo" to the
  console and deleted the input file "con_xz":
      echo foo | xz > con_xz
      xz --suffix=_xz --decompress con_xz
* Build systems:
    - Allow builds with Windows win95 threading and small mode when
      __attribute__((__constructor__)) is supported.
    - Added a new line to liblzma.pc for MSYS2 (Windows):
          Cflags.private: -DLZMA_API_STATIC
      When compiling code that will link against static liblzma,
      the LZMA_API_STATIC macro needs to be defined on Windows.
    - CMake specific changes:
        * Fixed a bug that allowed CLOCK_MONOTONIC to be used even
          if the check for it failed.
        * Fixed a bug where configuring CMake multiple times
          resulted in HAVE_CLOCK_GETTIME and HAVE_CLOCK_MONOTONIC
          not being set.
        * Fixed the build with MinGW-w64-based Clang/LLVM 17.
          llvm-windres now has more accurate GNU windres emulation
          so the GNU windres workaround from 5.4.1 is needed with
          llvm-windres version 17 too.
        * The import library on Windows is now properly named
          "liblzma.dll.a" instead of "libliblzma.dll.a"
        * Fixed a bug causing the Ninja Generator to fail on
          UNIX-like systems. This bug was introduced in 5.4.0.
        * Added a new option to disable CLMUL CRC64.
        * A module-definition (.def) file is now created when
          building liblzma.dll with MinGW-w64.
        * The pkg-config liblzma.pc file is now installed on all
          builds except when using MSVC on Windows.
        * Added large file support by default for platforms that
          need it to handle files larger than 2 GiB. This includes
          MinGW-w64, even 64-bit builds.
* Small fixes and improvements to the tests.
* Updated translations: Chinese (simplified) and Esperanto.

Signed-off-by: Nick Hainke <vincent@systemli.org>
2023-12-04 13:18:35 +01:00