Commit graph

231 commits

Author SHA1 Message Date
Miah Johnson
05380a654e sum coverage from parallelized tests
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-12-03 19:08:45 -08:00
Ryan Davis
14e835e4cc Attempt to fix bundle caching.
Unfortunately, I can only test this via commits to BK...

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-12-03 15:36:06 -08:00
Ryan Davis
c73569fe6b Updated vars for minitest changes.
N -> MT_CPU

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-12-03 15:01:35 -08:00
Ryan Davis
e1966973cc Added SKIP_BUNDLE_CACHE var to .expeditor/buildkite/verify.sh
This lets me test our docker setup locally much quicker as I don't
have to time out on the aws s3 push/pull steps.

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-12-03 15:00:21 -08:00
Miah Johnson
7a837e16d1
Merge pull request #4745 from inspec/mj/cc-coverage
Enable Codeclimate Test Coverage
2019-12-02 13:27:00 -08:00
Miah Johnson
fe8f868504 dont set a default simplecov format; we do that elsewhere.
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-28 00:53:22 -08:00
Miah Johnson
64e444883c change order?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 22:43:27 -08:00
Miah Johnson
6d0abf2980 clean up output
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 22:38:32 -08:00
Miah Johnson
12329cf48a this was listed twice?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 22:38:20 -08:00
Miah Johnson
9db7b70e30 remove coveralls; all we need is simplecov
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 22:12:48 -08:00
Miah Johnson
d3b7a82cd6 trigger coverage on pull requests
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 21:04:44 -08:00
Miah Johnson
144081eab5 execute test
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:51:53 -08:00
Miah Johnson
726be2fa7a update perm
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:45:57 -08:00
Miah Johnson
b985ddc041 this uses chefes/buildkite
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:43:03 -08:00
Miah Johnson
67a4ff060a update path
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:36:32 -08:00
Miah Johnson
4878df9e0d let releng own the docker image
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:30:23 -08:00
Miah Johnson
38a027350a Set up our coverage secrets
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:27:16 -08:00
Miah Johnson
2a00b2b6a7 Clean up variable usage, and use download_s3_file
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 20:27:16 -08:00
Ryan Davis
5f13819ca5 Make 2.7 failures real
Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-11-27 15:42:52 -08:00
Miah Johnson
8d19c65eb1 Use codeclimate for test coverage, v1
Adds a coverage.sh to be executed by the coverage pipeline.

Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-27 13:40:13 -08:00
Ryan Davis
38e1eb9355 Update expeditor to skip with new labels
Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-11-26 11:33:42 -08:00
Miah Johnson
a636f6bdc9
Merge pull request #4678 from inspec/mj/artifact_tests
Add several tests to our artifact suite
2019-11-25 11:53:57 -08:00
Miah Johnson
de2a70decb trigger our habitat tests
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-22 12:58:31 -08:00
Miah Johnson
45070c15c0 Fixup tests
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-21 17:01:10 -08:00
Ryan Davis
5dab3e0bbf Switch to test:parallel K=4 on windows.
Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-11-12 14:51:56 -08:00
Miah Johnson
549e3c196e
Merge pull request #4675 from inspec/mj/hab1101
Get artifact/habitat starting tests on both Windows and Linux
2019-11-07 12:13:31 -08:00
Miah Johnson
13a1c30ba6 Corret build scripts
correct path to hab artifact
Rather than throwing, lets try to install the version
Make sure hab is in the path
we use -b on windows. lets be consistent
export project_root too
picardface
fix regex
execute rake _through_ habitat
make test vrooom
test presence of inspec
strip out clixml bs
... no which on bk.
full path to which
export PATH
test exist on linux/windows

Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-07 10:09:35 -08:00
Miah Johnson
9eff871be1 crossing fingers
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-06 14:20:27 -08:00
Ryan Davis
bbba778980 Tentative buildkite setup. Not activated yet.
Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-11-05 16:05:18 -08:00
Ryan Davis
d608cc54b0
Merge pull request #4660 from inspec/zenspider/artifact-caching-fixes
Fix false positives on bundle caching check in buildkite.
2019-11-04 13:12:24 -08:00
Miah Johnson
8e4a00693f lets try to reuse these?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 18:32:54 -07:00
Miah Johnson
df113b92d2 comet
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
503ac7dd7d are we getting our ps1 sourced?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
388f761720 use $project_root in powershell
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
d4badc6ad3 set up binlink in shell script
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
c6b488c62f the last_build.env script doesn't expor its variables..
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
26a46cc886 debug windows
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
a2122753f0 does it execute?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
b8c96fb928 let sudo call a program instead of shell magic
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
10bce134e8 will probably need to quote this but...
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
155aa3ee1b nightmare in /bin/sh
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
414a0df21e sHELL scripts
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
cedc866d29 finish!
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
4ea5d4bfb1 quotes are hard
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
1d5ee76c75 timing
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
0619d85ba6 d
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
d26b43fdd2 c
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
df7b1a404f bad
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
22735fa1b2 bad movies
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
85aa6d4142 .
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
9a04b34d2a ...
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
d2c823fae6 plah
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
f0fca98964 please
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
a79120900f terrible movies
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
954815fc0f i lost hab?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
7caa1fb8d2 hi
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
1c93fba32c import key from ci user
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
75a9692dbe im lost
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
cbb1ae8593 Lets try importing our key
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
8e5a63bf6b Make sure sudo passes our ENV
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
a96075cfe1 HAB_LICENSE too
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
f012c6438c correct path on windows
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
ce16c93d97 accept license
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
e8dc525375 sudo make me a installed package
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
003972ed32 I thought I was in a priviledged environment:
```
but ✗✗✗ Permission denied (os error 13)
```

Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
d09c5cb9aa This should be .env
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
35fc664184 .sh -> .env
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
36763a6026 maybe?
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
f9a8fd84da further debug
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
34c13c7732 don't have tree
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
32521c098c debug a bit
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
af66adc6db I think last_build.sh should be last_build.env..
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
44384b6c13 results is in /src/results; update path.
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Miah Johnson
44aedcf3bd Fix path to test scripts
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-11-01 17:58:08 -07:00
Ryan Davis
d6843db397 Fix false positives on bundle caching check in buildkite.
+ This adds RESET_BUNDLE_CACHE so we can forcibly reset.
+ Now computes the sha against the Gemfile.lock.
+ Other minor fixes as pointed out by shellcheck.

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-10-31 16:53:20 -07:00
Ryan Davis
40f54eb98b
Merge pull request #4626 from inspec/zenspider/root-user
Create a user 'normal' and use it to run tests. Also bundle caching.
2019-10-29 13:13:39 -07:00
Miah Johnson
1e292adc42
Merge pull request #4600 from inspec/mj/4588
Add ruby 2.7 preview
2019-10-23 17:19:06 -07:00
Ryan Davis
3cc4b4d0b4 Add buildkite caching to our verify pipeline.
I'm not sure why we're doing this ourselves instead of using
buildkite's own artifact caching, but that's fine.

This speeds up the "bundle install" phase from ~3m to ~20s.

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-10-22 17:44:41 -07:00
Ryan Davis
c93d61da1c Add a non-root user for testing on BK.
Unfortunately, we have a lot of failing tests when we run as a
non-root user and the files are owned by root. We can't chmod the
checkout to the non-root user as it is a shared mount in docker and
that's not allowed to the outside world.

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-10-22 17:40:41 -07:00
Miah Johnson
3c908b4c1b Make our 2.7 test always return true
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-22 14:08:52 -07:00
Miah Johnson
6aac679c54
Merge pull request #4620 from inspec/mj/hfp
Fix the path for our scripts, I don't know where I got /workdir
2019-10-18 15:12:46 -07:00
Miah Johnson
cb4007c15f Fix the path for our scripts, I don't know where I got /workdir
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-18 15:10:53 -07:00
Miah Johnson
b5bd3b42f7 Make shell script executable
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-18 13:48:47 -07:00
Miah Johnson
a0ef46ccf4 Stop using reserved pipelines with default triggers.
The pipeline prefixes: deploy, habitat, omnibus, and verify all have default
triggers associtated with them.

https://expeditor.chef.io/docs/reference/configuration/#pipelines

Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-18 12:14:26 -07:00
Miah Johnson
8968f89d5d Dont trigger yet
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-17 14:37:14 -07:00
Miah Johnson
cb001d8654 Empty resources yml until I build it.
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-17 14:26:51 -07:00
Miah Johnson
0ccd26ef84
Merge pull request #4599 from inspec/mj/habitat-pipeline
Add habitat/test pipeline for testing our habitat builds.
2019-10-17 13:55:04 -07:00
Miah Johnson
406d9e4d59 We only need to install a specific hab version on Windows
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-17 12:57:03 -07:00
Miah Johnson
427d8dbac0 By not declaring a version we get the default, which is 2019.
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-17 10:41:59 -07:00
Miah Johnson
227a97991d Add blank pipeline to allow iteration in next PR
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 22:53:05 -07:00
Miah Johnson
633a1a1d79 Add pipeline to manage test kitchen builds and a trigger
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 22:43:15 -07:00
Miah Johnson
bcca77d6a4 Add ruby 2.7 preview
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 21:25:30 -07:00
Miah Johnson
005bca0f45 copy-pasta
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 20:13:54 -07:00
Miah Johnson
544db45c5e Untested and probably broken test scripts =)
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 20:05:12 -07:00
Miah Johnson
002e274d8e Pipeline definition for testing habitat builds
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 19:56:47 -07:00
Miah Johnson
498cbb7e84 Add a test pipeline for habitat builds.
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-10-16 18:25:29 -07:00
Miah Johnson
5591733c2a
Merge pull request #4544 from inspec/mj/please
Pass access token
2019-09-30 15:40:05 -07:00
Miah Johnson
ae54ada65e Pass access token
Signed-off-by: Miah Johnson <miah@chia-pet.org>
2019-09-30 15:37:50 -07:00
Ryan Davis
9671f75f9a Let's see how our BK setup likes parallelization.
According to @tom, we have some seriously beefy aws instances on both
linux and windows (4 times beefier than linux!). Let's see what this does.

Signed-off-by: Ryan Davis <zenspider@chef.io>
2019-09-18 14:47:41 -07:00
Ryan Davis
6b72ca2655
Merge pull request #4480 from inspec/zenspider/isolate
Added test:isolate task that runs tests isolated but in parallel.
2019-09-16 17:01:54 -07:00