trufflehog/pkg/sources
ahrav cbf299aa77
Add gcs scanning integration (#1153)
* Setup for GCS scanning.

* Update GCS engine w/ projectID req.

* Add concurrency field to gcsManager.

* add errgroup to gcsManager.

* Update gcs manager.

* Use defautl ADC.

* use ADC.'

* Add TOOD.

* add log to iterator completion.

* use a BinaryReader instead of concrete object for channel type.

* initial test for Chunks.

* Add tests for chunking objects.

* Add concurrency.

* update metadata to include content type and acls.

* Add object reading code.

* Add integration test.

* Add entrypoint.

* Add removed wg.Wait().

* remove dead code.

* remove build.

* Remove period from file extension.

* remove used.

* Add comment.

* Setup for GCS scanning.

* Update GCS engine w/ projectID req.

* Add concurrency field to gcsManager.

* add errgroup to gcsManager.

* Update gcs manager.

* Use defautl ADC.

* use ADC.'

* Add TOOD.

* add log to iterator completion.

* use a BinaryReader instead of concrete object for channel type.

* initial test for Chunks.

* Add tests for chunking objects.

* Add concurrency.

* update metadata to include content type and acls.

* Add object reading code.

* Add integration test.

* Add entrypoint.

* Add removed wg.Wait().

* remove dead code.

* remove build.

* remove used.

* Add file type for objects.

* Add check for file type and size.

* Add default file size.

* Add additinoal auth options and remaining CLI flags.

* Handle errors in go routines.

* Handle resuming for buckets.

* Remove redundant words in comment.

* remove ok check on bool check.

* remove extra blank line.

* Add return if handler handles chunk.

* Add comment.

* remove extra blank line.

* cleanup comment.

* Add comment.

* move up fxn.

* go mod tidy.

* Add exclusion to perf testing buckets.

* Handle blocking the channel.

* remove unused const.

* fix tests.

* fix tests.

* Handle gcs manger options better.

* update fxn name.

* Remove arg name.

* ignore buckets in gcsManager test.

* fix test.

* propulate gsManagerOpts.

* inline err check.

* Add readme.

* update readme spelling.

* fix test.
2023-03-07 17:32:04 -08:00
..
circleci [chore] Remove logrus from circleci, filesystem, gitlab, and s3 sources (#1089) 2023-02-10 11:02:55 -06:00
filesystem Support file scanning in filesystem source (#1030) 2023-02-27 12:15:05 -06:00
gcs Add gcs scanning integration (#1153) 2023-03-07 17:32:04 -08:00
git Only scanned staged git changes. (#1143) 2023-03-01 08:58:36 -08:00
github Fix nil scan options (#1107) 2023-02-14 12:09:45 -06:00
gitlab [chore] Remove logrus from circleci, filesystem, gitlab, and s3 sources (#1089) 2023-02-10 11:02:55 -06:00
s3 [chore] Remove logrus from circleci, filesystem, gitlab, and s3 sources (#1089) 2023-02-10 11:02:55 -06:00
syslog [chore] Remove logrus from trufflehog (#1095) 2023-02-14 17:00:07 -06:00
chunker.go [chore] Remove logrus from trufflehog (#1095) 2023-02-14 17:00:07 -06:00
chunker_test.go Change chunker test source (#959) 2022-12-06 12:45:08 -08:00
errors.go Implement String for ScanErrors (#1131) 2023-02-27 21:02:59 -06:00
errors_test.go Implement String for ScanErrors (#1131) 2023-02-27 21:02:59 -06:00
resume.go [chore] Remove logrus from circleci, filesystem, gitlab, and s3 sources (#1089) 2023-02-10 11:02:55 -06:00
resume_test.go [chore] Remove logrus from circleci, filesystem, gitlab, and s3 sources (#1089) 2023-02-10 11:02:55 -06:00
sources.go Add gcs scanning integration (#1153) 2023-03-07 17:32:04 -08:00
test_helpers.go fix github integration tests (#1042) 2023-01-25 08:57:39 -08:00