trufflehog/pkg/engine
Charlie Gunyon 311494e86e
Elastic adapter (#2727)
* Add stub source and elastic API funcs

* Spawn workers and ship chunks

* Now successfully detects a credential

- Added tests
- Added some documentation comments
- Threaded the passed context through to all the API requests

* Linting fixes

* Add integration tests and resolve some bugs they uncovered

* Logstash -> Elasticsearch

* Add support for --index-pattern

* Add support for --query-json

* Use structs instead of string building to construct a search body

* Support --since-timestamp

* Implement additional authentication methods

* Fix some small bugs

* Refactoring to support --best-effort-scan

* Finish implementation of --best-effort-scan

* Implement scan catch-up

* Finish connecting support for nodes CLI arg

* Add some integration tests around the catchup mechanism

* go mod tidy

* Fix some linting issues

* Remove some debugging Prints

* Move off of _doc

* Remove informational Printf and add informational logging

* Remove debugging logging

* Copy the index from the outer loop as well

* Don't burn up the ES API with rapid requests if there's no work to do in subsequent scans

* No need to export UnitOfWork.AddSearch

* Use a better name for the range query variable when building the timestamp range clause in searches

* Replace some unlocking defers with explicit unlocks to make the synchronized part of the code clearer

* found -> ok

* Remove superfluous buildElasticClient method

---------

Co-authored-by: Charlie Gunyon <charlie@spectral.energy>
2024-05-24 09:38:20 -05:00
..
ahocorasick Postman Source (#2579) 2024-03-20 11:36:20 -05:00
testdata Polite Verification (#2356) 2024-02-02 09:29:18 -08:00
circleci.go Update Source interface to use SourceID and JobID types (#1774) 2023-09-14 11:28:24 -07:00
defaults.go adding Groq detector (#2873) 2024-05-22 15:46:14 -04:00
defaults_test.go [chore] Add test to check all versioned detectors are non-zero (#2272) 2024-01-05 12:06:59 -08:00
docker.go [feat] - Support bearer auth for docker scans (#2848) 2024-05-14 11:30:11 -07:00
elasticsearch.go Elastic adapter (#2727) 2024-05-24 09:38:20 -05:00
engine.go chore(engine): remove verbose log line (#2860) 2024-05-16 22:25:16 -07:00
engine_test.go Use fake detectors in versioned detectors test (#2847) 2024-05-14 13:15:06 -04:00
filesystem.go [feat] - Allow for the use of include/exclude path files for filesystem scans (#2297) 2024-01-11 15:41:50 -08:00
filesystem_integration_test.go [chore] Add filesystem integration test (#2358) 2024-01-31 08:27:57 -08:00
gcs.go Update Source interface to use SourceID and JobID types (#1774) 2023-09-14 11:28:24 -07:00
gcs_test.go Remove verify flag from Aho-Corasick core (#2010) 2023-10-30 09:52:51 -04:00
git.go [feat] - Make skipping binaries configurable (#2226) 2023-12-15 11:46:27 -08:00
git_test.go concurrency uint8 to int (#2488) 2024-02-20 09:35:40 -06:00
github.go Scan GitHub wikis #2233 2024-01-31 10:52:24 -05:00
gitlab.go [feat] - Make skipping binaries configurable (#2226) 2023-12-15 11:46:27 -08:00
gitlab_integration_test.go Implement SourceUnitEnumChunker for GitLab (#2367) 2024-02-09 11:06:31 -08:00
postman.go pkg: fix function names in comment (#2761) 2024-04-29 11:21:26 -05:00
s3.go Add naive S3 ignorelist (#2536) 2024-03-05 08:01:20 -05:00
syslog.go Update Source interface to use SourceID and JobID types (#1774) 2023-09-14 11:28:24 -07:00
travisci.go Add TravisCI source (#1877) 2023-10-30 07:28:25 -07:00