ahrav
8f172b23ac
[chore] - Reduce VerificationOverlapWorkers ( #3082 )
...
* reduce worker count
* reduce detector worker count
2024-07-19 18:09:57 -07:00
ahrav
7a36e89c61
add verify check ( #3079 )
2024-07-19 18:09:26 -07:00
Abdul Basit
c20ca0d6a1
Added Twitter v2 Detector ( #3016 )
...
* implemented a newer version of twitter included a test.
moved old twitter detector to as V1.
* added version information in twitter test
2024-07-18 12:15:22 -04:00
ahrav
42b3a9d999
[perf] - Optimize MIME Type Detection to Reduce Allocations ( #3048 )
...
* Streaming file handling.
* cleanup
* update tests
* lint
* defer close on input io.ReadCloser's
* remove redundant mime type detection
* Reduce allocations
* fix test
* update comment
* fix seek bug
* address comment
* undo
2024-07-17 14:04:29 -07:00
ahrav
f865482025
[feat] - Streamlined File Handling with BufferedReaderSeeker ( #3041 )
...
* Streaming file handling.
* cleanup
* update tests
* lint
* defer close on input io.ReadCloser's
* fix seek bug
* fix hanging
* clarify errors
* update
* address comments
* revert
* update
* address
* add check to prevent seek without buffering
* revet
* revert
* update comment to make buffer usage more clear
2024-07-17 13:52:18 -07:00
Ankush Goel
e2e3b870b6
Atlassian Token Detector ( #3065 )
...
* atlassian token
* Update atlassian.go
Fixed version
* fixed regex
2024-07-17 12:44:39 -07:00
āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d
2a626c4dab
update package name ( #3020 )
2024-07-09 16:51:46 -05:00
Cody Rose
296379d5a0
Log more GitLab stuff ( #3040 )
...
Our GitLab happy path logging could use some love.
go.sum also needed a little love, for some reason.
2024-07-09 10:53:40 -04:00
Cody Rose
1a73442088
Order GitLab repos by ID ( #3047 )
2024-07-09 10:39:47 -04:00
ahrav
7d349ac7f3
remove dead code ( #3044 )
2024-07-07 08:59:40 -07:00
dylanTruffle
47535830c4
Elevenlabs detector ( #3023 )
...
* adding v1 eleven labs
* updating elevenlabs to support old and new version
* fixing status codes
* lint fixes
* adding test for v2
* adding test for v1
* return err
---------
Co-authored-by: Dylan Ayrey <dylan@Dylans-MacBook-Pro.local>
Co-authored-by: āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d <13666360+0x1@users.noreply.github.com>
2024-07-03 10:53:20 -04:00
Richard Gomez
b883645856
fix(detectors): avoid race ( #3028 )
2024-07-02 10:36:20 -05:00
Patrick Kaeding
4e04687712
update LaunchDarkly detector to use the caller-identity API instead of the tokens API, and instantiating an SDK ( #3018 )
2024-07-01 12:20:37 -07:00
joeleonjr
01a1499600
New Source: HuggingFace ( #3000 )
...
* initial spike on hf
* added in user and org enum
* adding huggingface source
* updated with lint suggestions
* updated readme
* addressing resources that require org approval to access
* removing unneeded code
* updating with new error msg for 403
* deleted unused code + added resource check in main
2024-06-27 13:22:06 -04:00
Shreyas Sriram
e9206c66bb
Add endorlabs detector ( #3015 )
...
* Add endorlabs detector
* Remove unrelated changes
* Addrss comments
* remove prefix regex
---------
Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2024-06-26 21:28:19 -07:00
orionooooo
b9dd330365
added "example" ( #3010 )
2024-06-25 14:01:22 -05:00
Abdul Basit
dddeca5224
Adding Larksuite Detectors + Tests ( #3008 )
...
* implemented larksuite detectores for tokens and api keys.
test implemented for larksuite token based detectors.
* implemented test for larksuiteapikey detector
* load credentials from GCP secret manager for larksuite api keys
2024-06-24 11:05:56 -05:00
Richard Gomez
3c20b000e1
fix(git): set GIT_DIR based on ScanOptions.Bare ( #3004 )
2024-06-24 07:37:45 -07:00
Cody Rose
de19a39f2c
Return targeted scan errors ( #2995 )
...
Targeted scans should return their errors so that consumers can process them. By creating a type that combines an error with a targeted secret ID, we can return these errors without having to modify the Source interface.
2024-06-21 13:50:56 -04:00
Zachary Rice
d5b9157d2b
clone more refs ( #2988 )
2024-06-20 09:40:03 -05:00
ahrav
347e8a6683
[feat] - Add Option to Retain False Positives During Detection ( #2967 )
...
* provide a mechanism to retain false positive findings
* update
* reorganzie
* revert comment
* update test
* typo
* fix test
* fix test
* update
* update
2024-06-18 09:40:21 -07:00
ahrav
a0618348fe
[fix] - implement MaxSecretSizeProvider for auth0managementapitoken detector ( #2953 )
...
* updates
* remove ey as a keyword
2024-06-14 14:21:17 -07:00
Cody Rose
15719c2c4f
Fix integration tests ( #2970 )
...
The recent engine changes (#2887 ) broke some integration tests. This PR fixes them. I also fixed an unrelated linter issue.
2024-06-14 14:30:18 -04:00
Richard Gomez
2964b3b2d2
feat(detectors): log falsepositive reason ( #2969 )
2024-06-14 08:26:05 -07:00
Richard Gomez
235b27964b
fix(handlers): workaround for max archive depth ( #2965 )
2024-06-14 08:18:05 -07:00
ahrav
523a915143
add metrics to the pipeline ( #2968 )
2024-06-14 07:57:52 -07:00
āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d
7bf3a9b5e2
adding eraser ai detector ( #2961 )
...
* adding eraser ai detector
* add eraser to defaults
2024-06-14 10:10:37 -04:00
ahrav
cb072603dc
Modularize scanning engine ( #2887 )
...
* POC: Modularize scanning engine.
* fix typo
* update interface name
* fix tests
* update test
* fix moar tests
* fix bug
* fixes.
* fix merge
* add detector verification overrides
* handle --no-verification flag
* support fp
* add test
* update name
* filter
* update test
* explicit use of detector
* updates
2024-06-13 13:47:09 -07:00
Richard Gomez
4addd81e29
test: fix compile errors ( #2964 )
2024-06-13 08:22:25 -07:00
Abdul Basit
cb4d332cbf
adding twitter + Consumer key detector ( #2963 )
...
* updated the twitter regex.
* updated regex for bearer token.
* clean up the code for existing twitter detector
added and Implemented new detector for twitter consumer key & secrets with test.
proto generated.
* string updated.
* written test for twitter consumer key detector
* reverted the file to avoid conflicts
* corrected the regex library in twitter detector
2024-06-13 09:32:24 -04:00
ahrav
bf77251543
[feat] - Update span calculation logic to use offset magnitude ( #2957 )
...
* Add a default start offset
* update
* use keywordIdx
2024-06-11 09:12:31 -07:00
ahrav
68bea576db
[fix] - Refactor Filtering Logic to Fix Known False Positive Handling in Overlapping Cases ( #2946 )
...
* Filter results for verification overlap results
* add test
2024-06-11 07:25:12 -07:00
ahrav
11b80dbdf9
[chore] - Update discordwebhook detector keyword ( #2954 )
...
* update keyword
* use stdlib var
2024-06-11 07:24:34 -07:00
Richard Gomez
6b52d5ad40
fix(maxmind): prevent npd panic ( #2948 )
2024-06-11 08:27:42 -04:00
Richard Gomez
ca67a8aa83
refactor(filesystem): change symlink err handling ( #2941 )
2024-06-10 13:05:42 -07:00
ahrav
2f7a0d0699
[bug] - Ensure BufferedFileWriter Flushes Buffer Contents to File Correctly ( #2943 )
...
* flush butter before writing to file
* revert
* remove redundant Reset
* add test case
2024-06-10 07:27:01 -07:00
Richard Gomez
3be4661f34
feat(extensions): ignore dia diagrams ( #2939 )
2024-06-07 07:37:33 -07:00
Miccah
a330aa6f53
[chore] Polish channelmetrics package ( #2938 )
2024-06-06 17:29:23 -07:00
Richard Gomez
5216142960
refactor(cache): use generics ( #2930 )
2024-06-06 13:08:00 -04:00
ahrav
ea9f8ace9f
[chore] - address comments ( #2920 )
...
* address comments
* fix test
* address comments
* update comments
* fix tests
* lint
* do the thing
2024-06-06 07:58:08 -07:00
Richard Gomez
40fa304a3a
feat(git): improve scan logging ( #2923 )
2024-06-06 05:12:59 -04:00
ahrav
bef4a46b65
[fix] - Correctly calculate EntireSpanChunkCalculator span ( #2924 )
...
* fix bug when calculating the span for the entire span chunk calculator
* fix rename
2024-06-05 19:21:57 -07:00
ahrav
babe48fdd1
remove stutter in naming ( #2926 )
2024-06-05 18:36:08 -07:00
Hon
4b3f834859
Update Jenkins in tui ( #2925 )
2024-06-05 18:34:01 -07:00
ahrav
b0fd70c0ff
continue on error ( #2921 )
2024-06-05 15:20:55 -07:00
ahrav
ce1ce29b90
[feat] - Optimize detector performance by reducing data passed to regex ( #2812 )
...
* optimize maching detetors
* update method name
* updates
* update naming
* updates
* update comment
* updates
* remove testcase
* update default match len to 512
* update
* update test
* add support for multpart cred provider
* add ability to scan entire chunk
* encapsulate matches logic within FindDetectorMatches
* use []byte directly
* nil chunk data
* use []byte
* set hidden flag to true
* remove
* [refactor] - multi part detectors (#2906 )
* Detectors beginning w/ a
* Detectors beginning w/ b
* Detectors beginning w/ c
* Detectors beginning w/ d
* Detectors beginning w/ e
* Detectors beginning w/ f
* Detectors beginning w/ f&g
* fix
* Detectors beginning w/ i-l
* Detectors beginning w/ m-p
* Detectors beginning w/ r-s
* Detectors beginning w/ t
* Detectors beginning w/ u-z
* revert alconst
* remaining fixes
* lint
* [feat] - Add Support for `compareDetectionStrategies` Mode (#2918 )
* Detector comparison mode
* remove else
* return error if results dont match
* update default hidden flag to not scan entire chunks
* fix tests
* enhance encapsulation by including methods on DetectorMatch to handle merging and extracting
* remove space
* fix
* update detector
* updates
* remove else
* run comparison concurrently
2024-06-05 13:28:19 -07:00
ahrav
aa91acc86b
[feat] - Introduce channelmetrics Package for Channel Metrics Collection ( #2889 )
...
* Add pkg for channel metrics
* Use map for different channel metrics
* go mod tidy
* use CacnellableWrite
2024-06-05 12:00:48 -07:00
Hon
c1a2019d5b
Add flag to get information if trufflehog being ran from TUI ( #1644 )
...
* Add flag to get information if trufflehog being ran from TUI
Co-authored-by: mcastorina <m.castorina93@gmail.com>
* Always use version.BuildVersion
---------
Co-authored-by: mcastorina <m.castorina93@gmail.com>
2024-06-05 10:07:50 -07:00
Richard Gomez
024b219dfb
feat(openai): add project and service account keys ( #2863 )
...
Co-authored-by: āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d <13666360+0x1@users.noreply.github.com>
2024-06-05 11:11:50 -04:00
Richard Gomez
4d2c8c6e11
refactor(github): improve wiki err handling ( #2917 )
2024-06-05 08:06:01 -04:00
