ahrav
41301bec8a
move clenaup outside the engine ( #2475 )
2024-02-17 08:06:24 -08:00
Dustin Decker
a9817a3292
Remove some noisy / less useful detectors ( #2467 )
2024-02-14 15:27:03 -08:00
Miccah
9642d4c8fd
Add flag to write job reports to disk ( #2298 )
...
* Add flag to write job reports to disk
* Fix nil pointer / non-nil interface bug
* Synchronize job report writer goroutine
* Log when the report has been written
2024-02-09 12:30:28 -08:00
Miccah
aace92b64d
Implement SourceUnitEnumChunker for GitLab ( #2367 )
...
* Implement SourceUnitEnumChunker for GitLab
* Add GitLab engine integration test
* Use a SliceReporter instead of checking for nil reporters
* Use more generic VisitorReporter
* Merge logic from getReposFromGitlab into getAllProjectRepos
* Update integration test to have a lower bound
Unfortunately, the GitLab integration test does not appear to be
deterministic. Sometimes 36390 chunks are found, sometimes 36312, or
even lower.
2024-02-09 11:06:31 -08:00
Ryan Jacobchick
7296bcdc5d
Allow CLI version pinning in GHA ( #2397 ) ( #2398 )
...
* Allow CLI version pinning in GHA (#2397 )
* prevent segfault in test-community
2024-02-07 16:58:04 -06:00
ahrav
28d079bdad
use only the DetectorKey as a map field ( #2374 )
2024-02-05 06:53:08 -08:00
ahrav
382990a6bd
[bug] - use DetectorKey as the key in the detectorKeysWithResults map ( #2366 )
...
* use DetectorKey as the key in the map
* nil check
* update comment
2024-02-02 13:43:56 -08:00
ahrav
b2074ad05d
Polite Verification ( #2356 )
...
* draft reverify chunks
* remove
* remove
* reduce dupe map cap
* do not verify chunk
* cli arg and use val for dupe lut
* remove counter
* skipp empty results]
* working on test and normalizing val for comparison
* forgot to save file
* optimize normalize
* reuse map
* remove print
* use levenshtein distance to check dupes
* forgot to leave in emptying map
* use slice
* small tweak
* comment
* use bytes
* praise
* use ctx logger
* add len check
* add comments
* use 8x concurrency for reverifier workers
* revert worker count
* use more workers
* process result directly for any collisions
* continue after decoder match for reverifying
* use map
* use map
* otimization and fix the bug.
* revert worker count
* better option naming
* handle identical secrets in chunks
* update comment
* update comment
* fix test
* use DetecotrKey
* rm out of scope tests and testdata
* rename all reverification elements
* don't re-write map entry
* use correct key
* rename worker, remove log val
* test likelydupe, add eq detector check in loop
* add test
* add comment
* add test
* Set verification error
* Update tests
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-02-02 09:29:18 -08:00
Miccah
24d0680f5c
[chore] Add filesystem integration test ( #2358 )
2024-01-31 08:27:57 -08:00
Richard Gomez
8e90c4e669
Scan GitHub wikis #2233
2024-01-31 10:52:24 -05:00
Richard Gomez
232032410c
feat(detectors): update template ( #2342 )
2024-01-29 21:21:23 -08:00
Dustin Decker
453792de76
Azure function key is throwing FPs ( #2352 )
...
* Merge branch 'main' of github.com:trufflesecurity/trufflehog
* AZF throwing FPs
* update snifftest script
2024-01-29 15:32:12 -05:00
roxanne-tampus
303e191f38
added azuresearchquerykey detector ( #2349 )
...
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-01-29 10:19:51 -08:00
roxanne-tampus
06b7ebf824
added azuresearchadminkey detector ( #2348 )
...
* added azuresearchadminkey detector
* additional update
* update import
* fix raw fields for new detectors and entropy check
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-01-29 09:55:46 -08:00
roxanne-tampus
83dc986b07
added azurefunctionkey detector ( #2337 )
...
* added azurefunctionkey detector
* update raw field to include url
* clean up and added prefix on key pattern
* update bench script
* update imports, snifftest, and gen proto
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-01-29 09:20:33 -08:00
faktas2
76fcdae3a0
Add the new MaxMind license key format ( #2181 )
...
* Add the new MaxMind license key format
* feedback
* reorg rules
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-01-26 11:49:47 -08:00
Richard Gomez
d4a0645c29
Add Google oauth2 token detector ( #2274 )
...
* feat(google): add oauth2 token detector
* update pr
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2024-01-25 21:32:03 -08:00
Cody Rose
e0a1b11a8e
Narrow Postgres detector to only look for URIs ( #2314 )
2024-01-23 14:42:31 -05:00
Dustin Decker
2596331bca
Disable recently added postgres detector because it it too sensitive ( #2303 )
2024-01-13 19:52:57 -08:00
ahrav
651beff492
[feat] - Allow for the use of include/exclude path files for filesystem scans ( #2297 )
...
* Allow for the use of include/exclude path files for filesystem scans
* remove oopsie
2024-01-11 15:41:50 -08:00
dylanTruffle
3b4518cbab
adding postgres detector ( #2108 )
...
* adding postgres detector
---------
Co-authored-by: Chair <chair@Chairs-MacBook-Pro.local>
Co-authored-by: ahmed <ahmed.zahran@trufflesec.com>
2024-01-10 16:19:45 -05:00
Miccah
5e78ad402e
[chore] Add test to check all versioned detectors are non-zero ( #2272 )
2024-01-05 12:06:59 -08:00
ahrav
39f0310f1f
[fixup] - Refactor to Pass Reader for Binary Diffs and Archived Data; Optimize /tmp Directory Cleanup ( #2253 )
2023-12-22 07:41:54 -08:00
ahrav
5c6ce693c1
[feat] - Make skipping binaries configurable ( #2226 )
...
* Make skipping binaries configurable
* remove ioutil
* fix
* address comments
* address comments
* use multi-reader
* remove print
* use const
* fix test
* fix my stupidness
2023-12-15 11:46:27 -08:00
Dustin Decker
3167dde8a1
Deprecate some detectors ( #2186 )
2023-12-06 16:57:55 -08:00
ahrav
cb81f7d11a
[feat] - Remove go-git dependency ( #2174 )
...
* remove use of go-git for binary files
* fix it
* use limit reader
* fix comment
* fix test
* address comments
* address comments
* address comments
2023-12-06 13:38:01 -08:00
ahrav
52ffab1034
[chore] - fix import name clashes ( #2143 )
...
* fix import name clashes
* fix missing var
2023-12-01 06:53:15 -08:00
Miccah
7ecd43ab1e
[chore] Minor cleanup of source_manager.go ( #2134 )
2023-11-29 11:08:25 -08:00
Dustin Decker
a7d330a2a5
import missing detectors ( #2119 )
2023-11-21 10:30:11 -08:00
ahrav
d334b3075e
move all Git setup into Init method ( #2105 )
...
* add proto fields for git
* add uri to proto
* move all git setup into Init method
* fix logic for when to use repoPath
2023-11-16 13:59:53 -08:00
Damanpreet Singh
d066a3fa78
Detector-Competition-Feat: Added Replicate API token detector ( #2021 )
...
* Detector-Competition-Feat: Added Replicate API token detector
* fix fullstory
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-07 12:16:39 -06:00
Damanpreet Singh
bcde7856c3
Detector-Competition-Feat: Added Ngrok API token detector ( #2024 )
...
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-07 09:28:05 -06:00
Ankush Goel
1b93c0545c
Competition-Detector-New:added v2 version for fullstory ( #2067 )
...
* added v2 version for fullstory
* added versioner to the v1 fullstory detector
2023-11-07 08:55:06 -06:00
Corben Leo
1094190ff5
Detector-Competition-Feat: Add Overloop detector ( #2080 )
...
* Detector-Competition-Feat: Add Overloop detector
* add protos and to defaults.go
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-06 16:43:31 -06:00
Damanpreet Singh
da59b72735
Detector-Competition-Feat: Added Request.Finance API token detector ( #2020 )
...
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-06 16:13:33 -06:00
Ankush Goel
703e158648
Detector-Competition-New : created grafana service account detector ( #1960 )
...
* created grafana service account detector
* add import
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-06 15:41:37 -06:00
Ankush Goel
6259b179b9
Grafana ( #2096 )
...
* Created Grafana Cloud API Key detector
* made the regex more bounded
* added boundary to regex
2023-11-06 11:13:06 -06:00
Ankush Goel
aabfec4cdf
Competition-Detector-New: added eventbrite detector ( #2072 )
...
* added eventbrite detector
* added packagename to defaults.go
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-03 16:42:13 -05:00
Ankush Goel
1371512ff3
logz.io detector ( #2076 )
...
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-03 16:32:35 -05:00
Ankush Goel
06b5fc25ef
Coda Detector ( #2075 )
...
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-03 15:50:05 -05:00
dylanTruffle
0b90265802
pulling short lived AWS keys into their own thing, fixes #1224 ( #2088 )
...
* pulling short lived AWS keys into their own thing, fixes #1224
* Update awssessionkey.go
* fmt
---------
Co-authored-by: Chair <chair@Chairs-MacBook-Pro.local>
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-03 11:58:49 -05:00
Cody Rose
7a156330b5
Support multiple detectors per match ( #2065 )
...
#1711 inadvertently removed the ability to match multiple custom detectors, or multiple detectors of the same type but different version, to a given keyword. (#2060 re-added support for multiple versions of detectors globally, and #2064 re-added support for multiple custom detectors globally, but neither fixed trufflehog's inability to support multiple such detectors for a given keyword match.) This PR re-adds the removed functionality (and narrows the AhoCorasickCore interface in the process.)
2023-11-03 12:26:18 -04:00
Corben Leo
3b9ecaa704
Detector-Competition-Fix: Fix ScraperSite (deprecated) ( #2074 )
...
Co-authored-by: āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d <13666360+0x1@users.noreply.github.com>
2023-11-03 11:15:53 -04:00
Corben Leo
41e9cc59e2
Detector-Competition-Fix: Fix PassBase (acquired, deprecated) ( #2079 )
2023-11-03 08:59:32 -05:00
Ankush Goel
b95ed3b41a
Detector-Competition-New - Created Grafana Cloud API Key detector ( #1959 )
...
* Created Grafana Cloud API Key detector
* made the regex more bounded
* added boundary to regex
2023-11-03 09:25:54 -04:00
Corben Leo
9e52e3e86f
Detector-Competition-Fix: Fix/Deprecate Prospect.io ( #2081 )
...
* Detector-Competition-Feat: Fix/Deprecate Prospect.io
* Detector-Competition-Fix: fix defaults.go
2023-11-03 07:04:42 -05:00
Corben Leo
b5cc6c196c
Detector-Competition-Fix: Fix FakeJSON (deprecated) ( #2073 )
2023-11-02 15:43:49 -05:00
dylanTruffle
4106ce7bf0
Detector-Competition-Feat: Adding Azure Container Registry Password Detector ( #1958 )
...
* implementing azure container registry password detector
* Fixing boundry feedback
* whoops
* update verification code
* fix regex
---------
Co-authored-by: Chair <chair@Chairs-MacBook-Pro.local>
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-11-02 11:17:01 -05:00
Corben Leo
07f6c84aa4
Detector-Competition-Fix: Fix SentimentInvestor (deprecated) ( #2078 )
2023-11-01 11:54:40 -05:00
dylanTruffle
8bac2b15ba
Detector-Competition-Feat: Adding Azure Batch keys ( #1956 )
...
* adding azure batch
* fmt
* fix lint
---------
Co-authored-by: Chair <chair@Chairs-MacBook-Pro.local>
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2023-10-31 10:49:04 -05:00
