Commit graph

248 commits

Author SHA1 Message Date
Sylvestre Ledru
0c6a848314
gnu results: also add the date (#2236) 2021-05-19 20:33:28 +02:00
Sylvestre Ledru
7bf342fa52 publish the results of the gnu testsuite as a json file too 2021-05-18 23:05:49 +02:00
Jan Scheer
dc93f29fe3 CICD: install GNU coreutils on macOS 2021-05-17 22:22:18 +02:00
Sylvestre Ledru
047d775e5e gh action: fix the GNU testsuite job 2021-05-17 21:24:58 +02:00
nicoo
f46b119493 CI: Stabilise the version of GNU tests used in CI
The “GNU tests” task is routinely broken on `master`.
Broken CI is worse than no CI, as it teaches people to ignore errors.

This PR pins the versions of the GNU testsuite (and GNUlib) used,
to current stable versions, so this task stops breaking unexpectedly.

Presumably, someone will update `GNU.yml` when a new stable version
of the GNU coreutils is released, but I'm not volunteering.
2021-05-17 21:07:05 +02:00
jaggededgedjustice
fb2ae04b8f
Remove broken GNU test for printf (#2095) 2021-04-21 14:22:05 +02:00
ReggaeMuffin
3bfb1afe5c
uucore: Start testing uucore
Before this change we never ran tests on uucore itself
meaning that is was not possible to test
functions of the shared core, only their usage
in the different binaries

This change adds running uucore to our ci, which will increase coverage for the few doctests that exist

and is extracted from #1988 where first tests for uucore will be introduced
2021-04-05 16:16:00 +01:00
Sylvestre Ledru
2ef1b25d85 Create a new job to test make build 2021-04-02 23:30:24 +02:00
jaggededgedjustice
88d0bb01c0
Add shuf tests (#1958)
* Add tests for shuf

* Fixup GNU tests for shuf
2021-03-28 17:52:01 +02:00
Sylvestre Ledru
4f6041e39d Only close if stale for one year 2021-03-27 14:58:16 -07:00
Sylvestre Ledru
4845b3f5dc
Enable the stale bot to close issues/PR without any activity (#1926) 2021-03-27 10:29:46 +01:00
Sylvestre Ledru
f431f58dd8
Bump min rustc to 1.40 (#1909) 2021-03-25 15:28:47 -07:00
James Robson
56da6b4a2c Fix test setup 2021-03-22 17:48:12 +00:00
James Robson
027d5e6d9d Fix yaml syntax 2021-03-21 22:31:15 +00:00
James Robson
40677bdc7a Fix more problems with utils that aren't being tested 2021-03-21 20:49:15 +00:00
James Robson
0f77b54aeb Fix typo 2021-03-21 15:11:48 +00:00
James Robson
4352d47ac3 Don't fail the job if test-suite.log is missing 2021-03-21 14:45:34 +00:00
James Robson
0a661a6da2 Remove use of which to set system binaries 2021-03-20 22:15:47 +00:00
James Robson
c804ec3ba3 Merge branch 'master' into polish-gnu-tests 2021-03-18 20:59:41 +00:00
Theophile Trunck
0ac5dbe44d Add CICD for busytest 2021-03-14 20:30:53 +01:00
James Robson
570e456496 clean up workflow script 2021-03-14 15:59:17 +00:00
James Robson
7c219fd128 clean up sed commands 2021-03-14 15:34:22 +00:00
James Robson
d8c3d1d51d Use system utils 2021-03-14 15:32:30 +00:00
James Robson
78ec6d1e5a Revert "Revert "Remove unbuffer""
This reverts commit 8dae8b798a.
2021-03-06 21:24:28 +00:00
James Robson
64e0b0018a Merge branch 'master' into polish-gnu-tests 2021-03-06 16:51:33 +00:00
James Robson
8dae8b798a Revert "Remove unbuffer"
This reverts commit bbce179115.
2021-03-06 16:35:22 +00:00
James Robson
b098bd5ec2 Fix tests still failing for the wrong reason 2021-03-05 21:40:16 +00:00
James Robson
e42479b79b fail tests for any binary not built 2021-03-04 20:50:57 +00:00
James Robson
3b93995132 generate all factor scripts 2021-03-04 19:11:38 +00:00
James Robson
20082971be Use system sha1sum in factor tests 2021-03-04 17:33:31 +00:00
James Robson
a395af7ee7 Create *sum binaries for tests 2021-02-27 14:35:31 +00:00
James Robson
bbce179115 Remove unbuffer
This causes the make process to hang for some reason, and it itsn't providing any real advantage so it's taken out
2021-02-27 13:25:13 +00:00
James Robson
03619d867e More tight timeouts 2021-02-25 18:18:30 +00:00
James Robson
1cef9aa046 Add timeouts to other tests that hang 2021-02-24 17:47:30 +00:00
James Robson
4cca2b651a Keep producing logs even if make hangs 2021-02-24 17:28:20 +00:00
James Robson
e89387c089 Try removing seq-precision 2021-02-23 19:49:11 +00:00
James Robson
b19afebad8 Shorten the timeout on seq-precision 2021-02-23 09:58:06 +00:00
Chad Brewbaker
bb54669a5d
Fix macOS aarch64 compile errors (#1724) 2021-02-23 10:25:06 +01:00
James Robson
dc49415829 Stop seq-precision.sh causing jams in make 2021-02-22 19:29:45 +00:00
James Robson
b92b88a822 Add 4 hour global timeout for protection 2021-02-22 19:29:00 +00:00
James Robson
16c8b3cbba Use system timeout command 2021-02-22 09:19:43 +00:00
James Robson
89f74948e0 Typo 2021-02-21 15:52:18 +00:00
James Robson
4e90de44cc Move timeout to per-test script
Move to a timeout applied to each script and re add the tests that are hanging so they show as failing
2021-02-21 15:51:03 +00:00
James Robson
cebb58c5b4 Rename install for testing 2021-02-21 13:36:16 +00:00
James Robson
f2013e47b3 Use which to find system utils 2021-02-21 11:14:14 +00:00
James Robson
910f6d102f Fix script name 2021-02-21 09:53:11 +00:00
James Robson
b3dea739f4 Fix script name 2021-02-21 09:36:03 +00:00
James Robson
a73c34c735 Stop tests failing on utils that aren't the focu of the test 2021-02-20 17:17:03 +00:00
James Robson
eb8cdcf44a Re-add fixed test 2021-02-20 15:07:47 +00:00
Sylvestre Ledru
842b6dd75f Remove tests checking for --version & --help
Not really interesting for us and logs are too big
2021-02-13 19:31:47 +01:00
Sylvestre Ledru
091cdd6a8d
Extract the result of the GNU testsuite executions as a warning (#1718) 2021-02-11 15:42:41 +01:00
James Robson
d4a30fdff0 Skip sort test that will hang 2021-02-04 18:42:43 +00:00
James Robson
4573ce44e1 Kill make on timeout so it can't delete the running log 2021-02-04 18:08:00 +00:00
James Robson
96219692a4 Archive logs 2021-02-03 21:43:34 +00:00
James Robson
7fe5a08b23 Use timeout to protect against hangs 2021-02-03 21:43:34 +00:00
James Robson
5808d56f12 Skip tests that hang 2021-02-03 21:43:34 +00:00
James Robson
84b0573f7d Fix $PATH in tests 2021-02-03 21:43:34 +00:00
James Robson
84965ad8c3 Use make to build all binaries 2021-02-03 21:43:34 +00:00
jaggededgedjustice
20046013fb
Cleanup gnu test script (#1701) 2021-01-21 23:56:02 +01:00
jaggededgedjustice
4eb6edaf52
Add gnu tests (#1699) 2021-01-21 08:19:08 +01:00
Roy Ivy III
07d52c7741 docs ~ add corrective spell-checker global exceptions 2020-11-08 20:00:11 -06:00
Roy Ivy III
b6cafa9e10 fix ~ remove extraneous step within GHA MinRSV 2020-11-08 20:00:11 -06:00
Roy Ivy III
daa5868da4 maint/CICD ~ add 'Cargo.lock' format testing and protection 2020-10-24 20:56:41 -05:00
Roy Ivy III
3a4f12c2fb maint/CICD ~ improve robustness of MinRustV package dependency calculation 2020-10-14 21:42:09 -05:00
Roy Ivy III
72a5d93a4d maint/CICD ~ remove old/unneeded grcov setup scripting 2020-08-19 09:13:09 -05:00
Roy Ivy III
63315747a5 maint/CICD ~ job naming improvement (decreased jargon) + feature name normalization 2020-08-16 17:02:19 -05:00
Roy Ivy III
bb4b20db81 maint/CICD ~ use alternate grcov configuration recipe (direct CLI options)
- `ignore` and `excl-br-line` options used to target code coverage analysis
- direct/repeated (non-DRY) CLI options are used by necessity (`grcov` is ignoring command line env variables)
2020-08-16 17:02:19 -05:00
Roy Ivy III
9711e5ad42 maint/CICD ~ update CICD code coverage recipe 2020-08-10 10:20:15 -05:00
Roy Ivy III
1c9b12c0d2 maint/CICD ~ add individual uutil/sub-crate testing to CICD code coverage 2020-08-10 10:19:42 -05:00
Roy Ivy III
137b26def6 maint/CICD ~ add individual uutil/sub-crate testing to CICD 2020-08-10 10:19:41 -05:00
nicoo
dc6b9a8d62
CI: Improve annotations (#1584)
* CI: Only run rustfmt in one environment

- This displays clippy warnings even when rustfmt fails.
- This avoids displaying 3 copies of the same rustfmt warning as Github
  annotations.
- Avoids duplicated work.

* CI: Suppress warnings when building for the oldest toolchain version

We had cases of warnings emitted due to `rustc` bugs that were fixed
in non-obsolete versions.

* factor: Remove a workaround for warnings on obsolete rustc
2020-08-10 16:53:32 +02:00
Roy Ivy III
d3ef4bd7da maint/CICD ~ update 'actions/upload-artifact' to 'v2' 2020-07-25 11:09:10 -05:00
Roy Ivy III
51cb023cd7 maint/CICD ~ pass CI from environment to cross containers 2020-06-13 21:54:21 -05:00
Sylvestre Ledru
5926315507 bump the minimal version of rustc to 1.32 2020-06-08 22:54:28 +02:00
Sylvestre Ledru
78c04a254e refactor ~ rename MinSRV => MinRustV 2020-06-02 12:23:48 -05:00
Roy Ivy III
1d327d31c0 docs ~ add comments (based on PR feedback) 2020-06-01 09:10:21 -05:00
Roy Ivy III
a7cbf6c9fd maint/CICD ~ remove cargo fmt gating for 'windows'
- unneeded after reorg
- but issue still remains; see GH:/rust-lang/rustfmt#3590
2020-05-30 01:16:21 -05:00
Roy Ivy III
cc8a2be6f5 maint/CICD ~ add support for DPKG generation and extra ARM-CPU build targets 2020-05-30 01:15:35 -05:00
Roy Ivy III
16840f8cd4 maint/CICD ~ update GHA for 'coreutils' name change 2020-05-29 22:59:47 -05:00
Roy Ivy III
d9de816757
maint/build ~ allow code coverage upload failures without breaking the build (warning instead of error) (#1526) 2020-05-25 22:47:42 +02:00
Sylvestre Ledru
157dc38492 quick fix(coverage): grcov arg 'output-file' has been renamed to 'output-path' 2020-05-13 11:01:41 +02:00
Roy Ivy III
7a64ad1ebc maint/CICD ~ add commentary for 'Style' warning output => annotation conversions 2020-05-02 23:12:50 -05:00
Roy Ivy III
a57214fa10 maint/CICD ~ change 'Style' job to a more robust, "allow-failure"-type, state
## [why]

Compiler and clippy warnings will change over time. To avoid build failures due to some
updated allow/warn categories for more future rust versions, the tests using the
toolchain utilities are converted to a form which will always "pass" but will push any
errors/warnings to the GHA UI as annotations.

Additional build-breaking tests utilizing more stable tools (or local scripts) can be
added at a later date if/when desired.

This should prevent CI failures for already known-working builds.
2020-05-02 17:02:25 -05:00
Roy Ivy III
312d9b9543 maint/CICD ~ fix coverage build failures by pinning to known-working nightly toolchain
## [why]

Code coverage must currently use some unstable features in nightly rust builds. The
nightly builds are, by definition, unstable and subject to frequent breaking changes.
To prevent CI build breakage, the toolchain is pinned to a specific known working set.

Note: (maint!) this will require periodic review until code coverage is more fully
implemented/integrated into Rust and moved into the stable channel.

- refs: <https://github.com/mozilla/grcov/issues/427>, <https://github.com/newsboat/newsboat/issues/916>
2020-05-02 16:53:08 -05:00
Roy Ivy III
dfc0617a2e maint/CICD ~ update x86_64-pc-windows-gnu build target to 'stable' (for use with rust v1.43.0+) 2020-05-02 16:44:36 -05:00
Roy Ivy III
0ab6e6a19a maint/CICD ~ refactor MacOS feature use (aline with feature reorg) 2020-04-25 01:57:21 -05:00
Roy Ivy III
4813e97a71 maint/CICD ~ add work-around for absorption of cargo tree into cargo
- see [GH:rust-lang/cargo#8062](https://github.com/rust-lang/cargo/pull/8062) for more information
2020-04-15 10:10:40 -05:00
Roy Ivy III
0d355d1073 maint/CICD ~ enable testing for beta-x86_64-pc-windows-gnu to GHA:CICD 2020-04-15 10:09:48 -05:00
Roy Ivy III
58a0ed2a4f maint/CICD ~ show cargo tree tool version information during CICD 2020-04-15 10:08:30 -05:00
Roy Ivy III
48dd6a2c81 maint/CICD ~ improve code coverage process and tooling 2020-04-14 13:46:18 -05:00
Roy Ivy III
aea98a40e0 maint/CICD ~ add cargo fmt style testing of tests 2020-04-14 00:07:00 -05:00
Roy Ivy III
7eeb58ae3a maint/docs ~ add spell-checker exceptions 2020-04-12 16:57:11 -05:00
Roy Ivy III
ab9da0aa63 maint/CICD ~ fix GITHUB_REF parsing 2020-04-12 16:56:03 -05:00
Roy Ivy III
4cf8487053 maint/CICD ~ improve tooling info display and include build dependency info 2020-04-12 16:56:03 -05:00
Roy Ivy III
05c829471e maint/CICD ~ generalize README and LICENSE matches for use in dpkg builds 2020-04-12 16:56:03 -05:00
Roy Ivy III
69408fc8cc maint/CICD ~ fix MinSRV testing (use correct toolchain) 2020-04-12 16:56:03 -05:00
Roy Ivy III
b57ee7e131 maint/CICD ~ fix features option for GHA 2020-04-12 16:56:03 -05:00
Roy Ivy III
ebc29e813b maint/CICD ~ add GitHub:Actions (GHA) CICD 2020-04-11 18:50:09 -05:00