Commit graph

315 commits

Author SHA1 Message Date
Roy Ivy III
a6e3564c5d fix/CICD ~ (GnuTests) be more precise about failing/passing tests 2022-03-31 23:32:28 +02:00
Roy Ivy III
cbe6396149 docs ~ (GnuTests) add reference and notes re GNU coreutils testing processes 2022-03-31 23:32:00 +02:00
Sylvestre Ledru
9e86e56668
Remove a comment to retrigger the CI 2022-03-25 15:28:45 +01:00
Sylvestre Ledru
22e06c2458 also fix coverage 2022-03-25 12:06:41 +01:00
Sylvestre Ledru
c4d89ab146 ci try to fix the error ? 2022-03-25 11:01:05 +01:00
Sylvestre Ledru
2acac0d558 CI: Force the rustc nightly version to fix issue 3305 2022-03-25 09:41:01 +01:00
Terts Diepraam
cf4a0fa5c8 also run unittests in codecov 2022-03-19 22:21:28 +01:00
Terts Diepraam
971f817a95 fix unittests not running in CI 2022-03-19 09:30:49 +01:00
Sylvestre Ledru
ad237f8fff
Merge pull request #3267 from sylvestre/gnu-size
GNU ci: compress logs before upload
2022-03-19 09:25:25 +01:00
Sylvestre Ledru
cb576effc2 GNU ci: compress logs before upload 2022-03-18 20:45:12 +01:00
Benjamin Bouvier
323f0ef993 Setup cargo-deny in CI too 2022-03-18 20:44:01 +01:00
Sylvestre Ledru
a5948ce11b
Merge pull request #3155 from jtracey/gecos-off-by-one
pinky: fix off-by-one in GECOS parsing
2022-03-17 13:35:05 +01:00
Sylvestre Ledru
0571434a75 ci: rename of the tracking size field to match the tracking project 2022-03-13 21:03:40 +01:00
Sylvestre Ledru
a22709aedd CI: Disable Windows job i686-pc-windows-gnu
Fails with:
error: linker `i686-w64-mingw32-gcc` not found
And the Windows GNU is covered by x86_64-pc-windows-gnu anyway
2022-03-08 22:57:32 +01:00
Sylvestre Ledru
9f5fad1e38 add a job to build with rust nightly 2022-03-08 22:57:32 +01:00
Sylvestre Ledru
2a48234c12 add a job to build with rust stable 2022-03-08 22:57:32 +01:00
Sylvestre Ledru
e3649e33c5 remove old comment 2022-03-08 22:57:32 +01:00
Sylvestre Ledru
f896834c77 Use min rust version as default 2022-03-08 22:57:28 +01:00
Justin Tracey
f52f655934 pinky: improve tests 2022-03-07 12:32:07 -05:00
Sylvestre Ledru
b85cc90586
Fix yaml syntax 2022-03-06 23:33:22 +01:00
Sylvestre Ledru
dfb794d37c
Run dependabot to update deps 2022-03-06 23:32:12 +01:00
xxyzz
6174cad334 Run GNU coverage job on pull requests
GNU coverage job now takes around one hour to finish thanks to contributors' work. Run it on pull requests to compare the GNU coverage report.
2022-03-05 13:49:35 +01:00
Sylvestre Ledru
91852d9768
Update to ubuntu latest until https://github.com/uutils/coreutils/issues/3210 is fixed 2022-03-04 12:52:57 +01:00
Sylvestre Ledru
f11ac4b076
Merge pull request #3166 from sylvestre/rust-cache
try to use rust-cache on github action to build faster
2022-02-21 17:35:22 +01:00
xxyzz
744592e221
Change the owner of gcda files to the current user 2022-02-20 19:15:48 +08:00
Sylvestre Ledru
9adaf5c288
Merge pull request #3045 from xxyzz/main
Create coverage report for GNU tests
2022-02-20 10:57:12 +01:00
Sylvestre Ledru
83d2f550ab try to use rust-cache on github action to build faster 2022-02-19 21:26:34 +01:00
Roy Ivy III
0af2c9bafb maint/CICD ~ (GnuTests) display sub-step test comparison failures more prominently 2022-02-17 15:14:51 -06:00
xxyzz
ce02eae14b
tests/misc/tty-eof.pl requires Perl's Expect package >=1.11 2022-02-14 16:29:39 +08:00
xxyzz
1dbd474339
There are four GNU tests require valgrind 2022-02-14 16:28:50 +08:00
xxyzz
18b11cb2cf
Create coverage report for GNU tests 2022-02-14 16:27:09 +08:00
Terts Diepraam
ac11d8793e docs: add page with test coverage 2022-02-13 23:14:13 +01:00
Terts Diepraam
1167d811d5
Merge pull request #2753 from sylvestre/gnu-locale
gnu/test: add the iso en_us locale to help with some tests
2022-02-13 12:59:33 +01:00
Roy Ivy III
38ac68ff33 maint/CICD ~ (GnuTests) remove unneeded GNULIB references 2022-02-12 15:26:59 -06:00
Roy Ivy III
29679ba337 maint/CICD ~ (GnuTests) refactor GnuTests GHA config
- combine gnu/gnulib into single repository checkout
- code consolidation
- DRY changes
- variable consolidation and renaming
- job/step naming normalization
2022-02-12 15:26:59 -06:00
Roy Ivy III
f75cfbdebc docs ~ (CICD/util) add/revise spell-checker exceptions 2022-02-12 15:26:59 -06:00
Roy Ivy III
fb4b523353 maint/CICD ~ (GnuTests) add 'repo_default_branch' to VARs 2022-02-12 15:26:59 -06:00
Roy Ivy III
ee40e99437 maint/CICD ~ (GnuTests) use last 'completed' GnuTests on default branch as reference 2022-02-12 15:26:59 -06:00
Sylvestre Ledru
25490b2100 gnu/test: add the iso en_us locale to help with some tests 2022-02-12 19:20:17 +01:00
Roy Ivy III
578e5c8aba maint/CICD ~ implement 'GnuTests' workflow fixes/refactor
- consolidate configuration
- DRY improvements
- improve flexibility/robustness in the face of missing reference test info
- add reference test info IDs and additional logging to help diagnose testing failures
- includes parallel refactor of 'util/run-gnu-test.sh'
2022-02-05 14:21:15 -06:00
Roy Ivy III
cc61ea807e docs/CICD ~ add spell-checker exceptions 2022-02-05 14:21:15 -06:00
Roy Ivy III
f01c3ef46a maint/polish ~ whitespace normalization 2022-02-03 15:00:05 -06:00
Roy Ivy III
caad4db712 maint/CICD ~ add MSRV check for '.clippy.toml' 2022-02-03 15:00:05 -06:00
Sylvestre Ledru
a20bf22592
Merge pull request #2974 from sylvestre/ci-size
Run the release builds and store the size
2022-01-30 22:17:05 +01:00
Sylvestre Ledru
90949ae045 Run the release builds and store the size 2022-01-30 19:58:47 +01:00
Sylvestre Ledru
6112ac5750 ci: Remove the sphinx legacy 2022-01-30 19:50:59 +01:00
Sylvestre Ledru
170975aeaa run the build of the doc in the ci 2022-01-29 00:35:14 +01:00
Justin Tracey
2ccea4666d
update GNU coreutils version in GnuTests workflow 2022-01-26 05:23:28 +00:00
Jeffrey Finkelstein
bfc0d81481 ci: update default branch to "main" in workflows 2022-01-21 23:07:16 -05:00
Terts Diepraam
783170c9d8 change msrv to 1.54 2022-01-15 11:08:07 +01:00
Roy Ivy III
cd79bc49bc maint/CICD ~ ignore 'vendor' for CodeCov 2022-01-01 17:50:30 -06:00
Roy Ivy III
790884b177 maint/CICD ~ add dependencies between CI job steps (using 'needs')
- the build and test steps won't run until/unless Dependency and MSRV checks pass
- code coverage won't run until/unless the build steps all pass

## [why]

This helps make more efficient use of CI resources and can help more easily visualize
build issues from the resultant GHA dashboard flow diagram.
2021-11-19 18:04:55 -06:00
Roy Ivy III
39a6e6c75b maint/CICD ~ (GHA) normalize setup sub-step ordering 2021-11-19 17:55:02 -06:00
Roy Ivy III
047c17dd31 maint/CICD - (GHA) standardize job step ordering (install, vars, prereq, toolchain, ...) 2021-11-19 17:55:02 -06:00
Roy Ivy III
0b10e69f56 maint/CICD ~ (GHA) repair broken cspell by pinning it to version v4.2.8
## [why]

`cspell` in CI started mysteriously failing mid-2021. Tracking down the
error took some time as it was not obvious from `cspell` feedback where
the issue lay. Ultimately, it was discovered that `cspell` had deprecated
use on NodeJS versions < v12 for `cspell` v5+.

`cspell` is now pinned to v4.2.8, with a maintenance note to allow an
upgrade to the `cspell` version when a version of NodeJS >= v12 is being
used in the CI.

An issue requesting better tool feedback for similar situations was also
opened on the `cspell` repo.[*]

[*]: [🙏🏻 Add warning (or error) when used on deprecated/outdated JS platform versions](https://github.com/streetsidesoftware/cspell/issues/1984)
2021-11-19 17:55:02 -06:00
Roy Ivy III
aba1c8f596 maint/CICD ~ (GHA) disable tool cache use for 'action-rs/install'
# [why]

The tool cache is currently failing and seems to be getting further behind current
versions. The [actions-rs/install#12] issue addresses this but seems to be
languishing without any proposed solution.

[ref]: <actions-rs/install#12>
2021-11-19 17:55:02 -06:00
Roy Ivy III
12419b3ee2 maint/CICD ~ (GHA) reform 'unused dependency check' (cargo udeps ...) into a style warning 2021-11-19 17:55:02 -06:00
Roy Ivy III
a6635d62c7 maint/CICD ~ (GHA) use 'feat_os_unix' consistently for ubuntu jobs 2021-11-19 17:55:01 -06:00
Roy Ivy III
37a3c68f3a maint/CICD ~ (GHA) add style fault configurability (fail vs warn)
- add individual job-step control for 'style' step faults (build failure vs only a warning)
2021-11-19 17:55:01 -06:00
Roy Ivy III
c951806e70 maint/CICD ~ (GHA) fix cargo clippy lint
- fixes conversion of new `cargo clippy` output style to GHA annotations

## [why]

`cargo clippy` output formatting changed, using relative instead of absolute paths.
2021-11-19 17:55:01 -06:00
Sylvestre Ledru
c0af58881e remove some unused codecov declarations 2021-11-16 10:10:30 +01:00
Tom Parker-Shemilt
0c33905e60 Fix FreeBSD build by downgrading MacOS version 2021-11-02 18:56:01 +00:00
Sylvestre Ledru
7eaae75bfc add a github action job to identify unused deps 2021-09-15 12:06:50 +02:00
Sylvestre Ledru
7acdf31e2b freebsd: also fails the script when the tests fail 2021-09-05 18:54:43 +02:00
Michael Debertol
1e78a40e20 CICD: use nightly rust for code coverage 2021-08-30 23:13:31 +02:00
Sylvestre Ledru
3ed74df4a6 Update to freebsd-vm@v0.1.5 2021-08-29 18:35:08 +02:00
Jan Verbeek
ea16cc72c7
Make clippy workspace selection more finegrained (#2598)
* Make clippy workspace selection more finegrained

* fixup! Make clippy workspace selection more finegrained

* fixup! Make clippy workspace selection more finegrained

* fixup! Make clippy workspace selection more finegrained

* fixup! Make clippy workspace selection more finegrained

* fixup! Make clippy workspace selection more finegrained
2021-08-25 01:41:25 +02:00
Jan Verbeek
d06c074829 Run clippy on the full workspace
These lints were cluttering up the "problems" tab in my VS
Code. `--workspace` fixes the disparity.
2021-08-24 17:10:16 +02:00
Sylvestre Ledru
86c610a84b enable freebsd in the CI on gh actions
and use --features feat_os_unix (wasn't done before)
2021-08-24 09:32:18 +02:00
James Robson
882b5ad1f1 Display changes in the failing GNU tests
Co-authored-by: Michael Debertol <michael.debertol@gmail.com>
2021-08-10 19:29:23 +01:00
James Robson
81a5f0a4dc Add step to GnuTest workflow to compare results against master 2021-08-10 19:29:23 +01:00
Jan Scheer
010565c8fb
Merge branch 'master' into id_selinux_context 2021-08-02 10:40:45 +02:00
Sylvestre Ledru
f34505df54 bump the minimal version for coverage to 1.52
Drivers:
https://github.com/rust-lang/rust/issues/71395
https://github.com/rust-lang/rust/pull/80470
needed by grcov
2021-07-30 14:54:45 +02:00
Jan Scheer
6111cd6e1b
id: add note about conditional compiling to README section 2021-07-13 14:38:46 +02:00
Jan Scheer
7abc6a665e
id: add conditional compilation for selinux 2021-07-13 00:22:10 +02:00
Jan Scheer
e53f4db33a Merge branch 'master' into id_selinux_context 2021-07-06 13:29:50 +02:00
Sylvestre Ledru
bd0ca4513e
update min rust to 1.51
Co-authored-by: Roy Ivy III <rivy.dev@gmail.com>
2021-06-27 07:52:07 +02:00
Sylvestre Ledru
f421761333
Merge pull request #2448 from sylvestre/gnu-fail-early
CI/GNU: if an error is detected, don't generate the json file
2021-06-24 10:23:25 +02:00
Roy Ivy III
42fed9186d maint/docs ~ add ToDO for change from cargo-tree to cargo tree 2021-06-23 12:03:35 -05:00
Roy Ivy III
17a959853e maint/CICD ~ suppress useless rustup notices 2021-06-23 10:05:49 -05:00
Roy Ivy III
8884666ce0 maint/CICD ~ fix dependency display errors (relax network lockout) 2021-06-23 10:00:27 -05:00
Sylvestre Ledru
34db1c5916
Simple dash, not double 2021-06-22 18:03:12 +02:00
Sylvestre Ledru
ed8d390ca7 CI/GNU: if an error is detected, don't generate the json file
Avoid to generate incorrect json files
2021-06-22 14:32:26 +02:00
Jan Scheer
f1d317147b id: add support for showing SELinux context (--context/-Z) 2021-06-20 13:44:41 +02:00
Roy Ivy III
b4a06cfdba maint/CICD ~ refactor; improve logging for outputs shell script 2021-06-19 18:40:22 -05:00
Sylvestre Ledru
2cb97c81ed maint/CICD ~ add GHA 'FixPR' to auto-fix issues for merging PRs
- auto-fix formatting
- auto-fix incompatible/out-of-date 'Cargo.lock'
2021-06-19 18:40:22 -05:00
Roy Ivy III
dd46c2f03b maint/CICD ~ (GHA) rename 'GNU' workflow to 'GnuTests' 2021-06-19 18:37:13 -05:00
Roy Ivy III
5682cf3032 maint/CICD ~ (GHA) update 'GNU' workflow
- show dashboard warnings only when tests FAIL or ERROR
- improve comments
- fix spelling and spelling exceptions
2021-06-19 18:37:13 -05:00
Roy Ivy III
92630a0690 maint/CICD ~ (GHA) add 'Style/dependencies' checks 2021-06-19 18:37:13 -05:00
Roy Ivy III
db621c7d7a maint/CICD ~ (GHA) change/refactor CICD (convert most warnings to errors)
- adds additional instruction to error message showing how to fix the error
2021-06-19 18:37:13 -05:00
Roy Ivy III
298851096e maint/CICD ~ (GHA) remove deprecated 'ubuntu-16.04' environment 2021-06-19 18:37:13 -05:00
Sylvestre Ledru
90bf26a51c maint/CICD ~ (GHA) update to checkout@v2 2021-06-19 18:37:13 -05:00
Jan Scheer
39aa5312ed id/tests: skip tests for multiple_user feature if there's not at least coreutils id version 8.31 in $PATH 2021-06-16 23:52:55 +02:00
Jan Scheer
54cbb69d37 id/tests: fix tests if run on macOS 2021-06-16 19:16:29 +02:00
Jan Scheer
052202ca19 Merge branch 'master' into id_zero_2351 2021-06-13 11:30:43 +02:00
Jan Scheer
60124b8fbd CICD/GNU: only run/compile tests for id 2021-06-13 10:09:24 +02:00
Roy Ivy III
2ff46a78b1 maint/CICD ~ summarize BusyTest output for dashboard 2021-06-06 19:28:25 -05:00
Roy Ivy III
c192550f22 refactor ~ polish spelling + add spelling exceptions 2021-06-06 19:28:22 -05:00
Roy Ivy III
114844d9cd maint/CICD ~ refactor; use a shell script (outputs) for step outputs 2021-06-06 19:17:18 -05:00
Roy Ivy III
4d5880f098 maint/CICD ~ temporarily disable failing tool cache for actionrs/install
# [why]

The tool cache is currently failing and seems to be getting further behind current
versions. The [actions-rs/install#12] issue addresses this but seems to be
languishing without any proposed solution.

[ref]: <https://github.com/actions-rs/install/issues/12>
2021-06-06 19:16:50 -05:00
Michael Debertol
8de42ed18e maint: actually run spellcheck on all files
**/* must be quoted, otherwise it is expanded by the shell and not
literally passed to cspell.
2021-05-31 22:40:12 +02:00
Roy Ivy III
691f03b9ae maint/CICD ~ improve visibility of spell check during testing 2021-05-31 08:23:58 -05:00
Roy Ivy III
c392cd1cb4 maint/CICD ~ cspell-check all repository files 2021-05-31 08:23:58 -05:00
Roy Ivy III
3140be7c1b docs/CICD ~ add spell-checker exceptions 2021-05-31 08:23:58 -05:00
Roy Ivy III
5182365f8f docs/polish ~ (GH/stale) add spell-checker exceptions 2021-05-31 08:23:58 -05:00
Jan Scheer
141a92c965 CI: set clippy targets to 'all' 2021-05-30 10:13:31 +02:00
Sylvestre Ledru
6e1a68ce9a
Merge pull request #2298 from jhscheer/fix_clippy
Major clippy overhaul.
2021-05-29 23:23:26 +02:00
Michael Debertol
4058caa3e6 maint: add spell checker to CICD 2021-05-29 22:30:02 +02:00
Jan Scheer
52ea9c4a48 CI: set MSRV and "--target" for clippy
* add "clippy.toml" in order to set MSRV for clippy linting
    this works only if clippy is invoked with "+nightly"
* add "--target" to clippy in order to also lint tests
2021-05-29 14:21:32 +02:00
Terts Diepraam
052ee22ce0 Bump MSRV to 1.43.1 2021-05-27 18:20:15 +02:00
Sylvestre Ledru
1860e61f83 Workaround the Windows CI install issue.
Fails trom time to time with:
```
info: installing component 'rustc'
memory allocation of 16777216 bytes failed
Error: The process 'C:\Rust\.cargo\bin\rustup.exe' failed with exit code 3221226505
```

on  Build (windows-latest, i686-pc-windows-gnu, feat_os_windows)
2021-05-23 10:35:46 +02:00
Sylvestre Ledru
9f0ef3ba54 gnu/ci: also store the hash in the json 2021-05-22 21:59:54 +02:00
Sylvestre Ledru
4d3be19de3
Merge pull request #2240 from jhscheer/macos_test_coreutils
who/stat/pinky: adjust tests to be compatible with running on macOS
2021-05-22 12:39:05 +02:00
Sylvestre Ledru
adaba54026 gnu/ci: move the operations into script to run them locally 2021-05-22 09:33:15 +02:00
Sylvestre Ledru
73b47b8c76 gnu/ci: install the dep into a separate task 2021-05-21 18:33:05 +02:00
Jan Scheer
6ed080cf97 CICD: install GNU coreutils on macOS (Code Coverage) 2021-05-21 12:39:48 +02:00
Sylvestre Ledru
52a7e07b3e
Merge pull request #2226 from nbraud/pin-GNU-tests
CI: Stabilise the version of GNU tests used in CI
2021-05-20 16:30:32 +02:00
Sylvestre Ledru
0c6a848314
gnu results: also add the date (#2236) 2021-05-19 20:33:28 +02:00
Sylvestre Ledru
7bf342fa52 publish the results of the gnu testsuite as a json file too 2021-05-18 23:05:49 +02:00
Jan Scheer
dc93f29fe3 CICD: install GNU coreutils on macOS 2021-05-17 22:22:18 +02:00
Sylvestre Ledru
047d775e5e gh action: fix the GNU testsuite job 2021-05-17 21:24:58 +02:00
nicoo
f46b119493 CI: Stabilise the version of GNU tests used in CI
The “GNU tests” task is routinely broken on `master`.
Broken CI is worse than no CI, as it teaches people to ignore errors.

This PR pins the versions of the GNU testsuite (and GNUlib) used,
to current stable versions, so this task stops breaking unexpectedly.

Presumably, someone will update `GNU.yml` when a new stable version
of the GNU coreutils is released, but I'm not volunteering.
2021-05-17 21:07:05 +02:00
jaggededgedjustice
fb2ae04b8f
Remove broken GNU test for printf (#2095) 2021-04-21 14:22:05 +02:00
ReggaeMuffin
3bfb1afe5c
uucore: Start testing uucore
Before this change we never ran tests on uucore itself
meaning that is was not possible to test
functions of the shared core, only their usage
in the different binaries

This change adds running uucore to our ci, which will increase coverage for the few doctests that exist

and is extracted from #1988 where first tests for uucore will be introduced
2021-04-05 16:16:00 +01:00
Sylvestre Ledru
2ef1b25d85 Create a new job to test make build 2021-04-02 23:30:24 +02:00
jaggededgedjustice
88d0bb01c0
Add shuf tests (#1958)
* Add tests for shuf

* Fixup GNU tests for shuf
2021-03-28 17:52:01 +02:00
Sylvestre Ledru
4f6041e39d Only close if stale for one year 2021-03-27 14:58:16 -07:00
Sylvestre Ledru
4845b3f5dc
Enable the stale bot to close issues/PR without any activity (#1926) 2021-03-27 10:29:46 +01:00
Sylvestre Ledru
f431f58dd8
Bump min rustc to 1.40 (#1909) 2021-03-25 15:28:47 -07:00
James Robson
56da6b4a2c Fix test setup 2021-03-22 17:48:12 +00:00
James Robson
027d5e6d9d Fix yaml syntax 2021-03-21 22:31:15 +00:00
James Robson
40677bdc7a Fix more problems with utils that aren't being tested 2021-03-21 20:49:15 +00:00
James Robson
0f77b54aeb Fix typo 2021-03-21 15:11:48 +00:00
James Robson
4352d47ac3 Don't fail the job if test-suite.log is missing 2021-03-21 14:45:34 +00:00
James Robson
0a661a6da2 Remove use of which to set system binaries 2021-03-20 22:15:47 +00:00
James Robson
c804ec3ba3 Merge branch 'master' into polish-gnu-tests 2021-03-18 20:59:41 +00:00
Theophile Trunck
0ac5dbe44d Add CICD for busytest 2021-03-14 20:30:53 +01:00
James Robson
570e456496 clean up workflow script 2021-03-14 15:59:17 +00:00
James Robson
7c219fd128 clean up sed commands 2021-03-14 15:34:22 +00:00
James Robson
d8c3d1d51d Use system utils 2021-03-14 15:32:30 +00:00
James Robson
78ec6d1e5a Revert "Revert "Remove unbuffer""
This reverts commit 8dae8b798a.
2021-03-06 21:24:28 +00:00
James Robson
64e0b0018a Merge branch 'master' into polish-gnu-tests 2021-03-06 16:51:33 +00:00
James Robson
8dae8b798a Revert "Remove unbuffer"
This reverts commit bbce179115.
2021-03-06 16:35:22 +00:00
James Robson
b098bd5ec2 Fix tests still failing for the wrong reason 2021-03-05 21:40:16 +00:00
James Robson
e42479b79b fail tests for any binary not built 2021-03-04 20:50:57 +00:00
James Robson
3b93995132 generate all factor scripts 2021-03-04 19:11:38 +00:00
James Robson
20082971be Use system sha1sum in factor tests 2021-03-04 17:33:31 +00:00
James Robson
a395af7ee7 Create *sum binaries for tests 2021-02-27 14:35:31 +00:00
James Robson
bbce179115 Remove unbuffer
This causes the make process to hang for some reason, and it itsn't providing any real advantage so it's taken out
2021-02-27 13:25:13 +00:00
James Robson
03619d867e More tight timeouts 2021-02-25 18:18:30 +00:00