ahrav
347e8a6683
[feat] - Add Option to Retain False Positives During Detection ( #2967 )
...
* provide a mechanism to retain false positive findings
* update
* reorganzie
* revert comment
* update test
* typo
* fix test
* fix test
* update
* update
2024-06-18 09:40:21 -07:00
ahrav
a0618348fe
[fix] - implement MaxSecretSizeProvider for auth0managementapitoken detector ( #2953 )
...
* updates
* remove ey as a keyword
2024-06-14 14:21:17 -07:00
Cody Rose
15719c2c4f
Fix integration tests ( #2970 )
...
The recent engine changes (#2887 ) broke some integration tests. This PR fixes them. I also fixed an unrelated linter issue.
2024-06-14 14:30:18 -04:00
Richard Gomez
2964b3b2d2
feat(detectors): log falsepositive reason ( #2969 )
2024-06-14 08:26:05 -07:00
āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d
7bf3a9b5e2
adding eraser ai detector ( #2961 )
...
* adding eraser ai detector
* add eraser to defaults
2024-06-14 10:10:37 -04:00
ahrav
cb072603dc
Modularize scanning engine ( #2887 )
...
* POC: Modularize scanning engine.
* fix typo
* update interface name
* fix tests
* update test
* fix moar tests
* fix bug
* fixes.
* fix merge
* add detector verification overrides
* handle --no-verification flag
* support fp
* add test
* update name
* filter
* update test
* explicit use of detector
* updates
2024-06-13 13:47:09 -07:00
Richard Gomez
4addd81e29
test: fix compile errors ( #2964 )
2024-06-13 08:22:25 -07:00
Abdul Basit
cb4d332cbf
adding twitter + Consumer key detector ( #2963 )
...
* updated the twitter regex.
* updated regex for bearer token.
* clean up the code for existing twitter detector
added and Implemented new detector for twitter consumer key & secrets with test.
proto generated.
* string updated.
* written test for twitter consumer key detector
* reverted the file to avoid conflicts
* corrected the regex library in twitter detector
2024-06-13 09:32:24 -04:00
ahrav
bf77251543
[feat] - Update span calculation logic to use offset magnitude ( #2957 )
...
* Add a default start offset
* update
* use keywordIdx
2024-06-11 09:12:31 -07:00
ahrav
11b80dbdf9
[chore] - Update discordwebhook detector keyword ( #2954 )
...
* update keyword
* use stdlib var
2024-06-11 07:24:34 -07:00
Richard Gomez
6b52d5ad40
fix(maxmind): prevent npd panic ( #2948 )
2024-06-11 08:27:42 -04:00
ahrav
ce1ce29b90
[feat] - Optimize detector performance by reducing data passed to regex ( #2812 )
...
* optimize maching detetors
* update method name
* updates
* update naming
* updates
* update comment
* updates
* remove testcase
* update default match len to 512
* update
* update test
* add support for multpart cred provider
* add ability to scan entire chunk
* encapsulate matches logic within FindDetectorMatches
* use []byte directly
* nil chunk data
* use []byte
* set hidden flag to true
* remove
* [refactor] - multi part detectors (#2906 )
* Detectors beginning w/ a
* Detectors beginning w/ b
* Detectors beginning w/ c
* Detectors beginning w/ d
* Detectors beginning w/ e
* Detectors beginning w/ f
* Detectors beginning w/ f&g
* fix
* Detectors beginning w/ i-l
* Detectors beginning w/ m-p
* Detectors beginning w/ r-s
* Detectors beginning w/ t
* Detectors beginning w/ u-z
* revert alconst
* remaining fixes
* lint
* [feat] - Add Support for `compareDetectionStrategies` Mode (#2918 )
* Detector comparison mode
* remove else
* return error if results dont match
* update default hidden flag to not scan entire chunks
* fix tests
* enhance encapsulation by including methods on DetectorMatch to handle merging and extracting
* remove space
* fix
* update detector
* updates
* remove else
* run comparison concurrently
2024-06-05 13:28:19 -07:00
Richard Gomez
024b219dfb
feat(openai): add project and service account keys ( #2863 )
...
Co-authored-by: āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d <13666360+0x1@users.noreply.github.com>
2024-06-05 11:11:50 -04:00
Dustin Decker
ef410873f2
Add Jenkins scanning ( #2892 )
...
* add jenkins
* whoops
* adding unauthenticated jenkins scanning
* update docs
---------
Co-authored-by: Joe Leon <joe.leon@trufflesec.com>
2024-06-04 07:13:14 -04:00
jinjiadu
911ea4d678
chore: fix some comments ( #2903 )
...
Signed-off-by: jinjiadu <jinjiadu@aliyun.com>
2024-06-03 18:26:33 -04:00
Abdul Basit
e5a5b63845
integration testing for mongodb. ( #2907 )
...
* integration testing for mongodb.
* add more test cases.
remove dead code/comments
2024-06-03 12:59:25 -07:00
Abdul Basit
2b3284e650
Redis integration test ( #2901 )
...
* implemented redis integration test using docker container
* rename the function and use the redis:7.0 image
2024-05-31 11:59:06 -05:00
Richard Gomez
5575514174
fix(falsepositives): remove 'www' ( #2896 )
2024-05-31 11:37:27 -04:00
Abdul Basit
ddd861d4c7
consistent image of MSSQL for integration testing. ( #2898 )
2024-05-31 10:56:02 -04:00
Abdul Basit
d93c428b54
Update metadata for DataDog for API + APPKey ( #2879 )
...
* put emails from response in metadata for datadog.
* removed unused type in user structure.
* filter user information based on verified, is service account and disabled boolean
also include organization detail if it is available in response.
2024-05-31 10:50:23 -04:00
Abdul Basit
18b81013b8
Added extra data for LaunchDarkly ( #2836 )
...
* added extra data for LaunchDarkly
- Token type like api or sdk
- name and role of First token in response of api-tokens
- total token counts associated with api-token
* renamed total_count to total_token_count
* updated & renamed fields of metadata for launchdarkly, specifically for API based tokens
2024-05-28 14:08:53 -04:00
āh̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d
b9ea2f5d4e
adding Groq detector ( #2873 )
...
* adding Groq detector
* using prefix as keyword
2024-05-22 15:46:14 -04:00
ahrav
fccf7c9a41
[chore] - Use http.NewRequestWithContext ( #2870 )
2024-05-22 06:58:12 -07:00
Abdul Basit
4b10b8a009
made changes in organization regex for azure devops. ( #2866 )
2024-05-20 15:02:12 -05:00
Abdul Basit
5dff334ffa
Update azure storage extra data ( #2808 )
...
Blob service of Azure storage returns containers name in response. From that, containers name is added in extra data.
2024-05-20 13:42:54 -04:00
Abdul Basit
15c6333987
deprecated Integromat detector becuase they are gone. ( #2856 )
...
remove the package as well.
2024-05-16 08:29:36 -07:00
Abdul Basit
7025b0aa35
added email and location in metadata. ( #2850 )
2024-05-15 12:36:22 -05:00
cuiyourong
ead4e8fa2d
chore: fix some typos in comments ( #2851 )
...
Signed-off-by: cuiyourong <cuiyourong@gmail.com>
2024-05-15 07:36:21 -07:00
Alexandre GUIOT--VALENTIN
0d8c3335ed
Add "Intra42" detector ( #2835 )
...
* Add basic intra42 detector (lacks verification)
* Improve keywords/prefixes for intra42 detector
* Un-lint pkg/pb/detectorspb/detectors.pb.go to avoid bloating PR
* Add client_id match and secret verification
* Improve PrefixRegex
* Add missing entry in DetectorType_name in detectors.pb.go
* Add Intra42 to proto/detectors.proto
* Remove PrefixRegex
* Keep only identifiers as keywords
* Factorize regex (a-f0-9)
2024-05-14 11:33:54 -07:00
ahrav
f82cf8d76d
[bug] - Fix case-sensitivity issue in PrefixRegex function ( #2811 )
...
* correctly remove case insensitivity for the capture group
* update
2024-05-14 08:55:36 -05:00
Richard Gomez
a00587673a
feat(sendgrid): update detector ( #2833 )
2024-05-13 18:44:37 -07:00
ahrav
9873c144ee
[chore] - Update GitlabV2 detector ( #2840 )
...
* replace keyword and replace prefix
* address comment
2024-05-13 14:13:23 -07:00
Abdul Basit
f527da9ecc
Update results's extra data for Twilio ( #2807 )
...
* Response structure added for service api of Twilio.
added two response fields in extra data:
1) friendly_name
2) account_sid
* mark credentials verified for non-fatal errors.
also check for atleast one service in response before extracting metadata.
2024-05-13 10:09:35 -04:00
ahrav
27eae925de
Use custom fp logic for private keys ( #2793 )
2024-05-06 14:41:00 -07:00
Abdul Basit
bf25b74224
Update result's extra data for Slack ( #2779 )
...
* add name of team and user in extra data of results, received from slack'api
* adding token type in extra data for slack
2024-05-02 15:16:30 -05:00
NIKHIL PANWAR
94a165390b
Update rabbitmq.go regex detect amqps protocol ( #2609 )
...
* Update rabbitmq.go regex detect amqps protocol
Old one couldn't detect amqps:// connection string, and only the amqp://
* [Revised] Update rabbitmq.go regex detect amqps protocol
Co-authored-by: Richard Gomez <32133502+rgmz@users.noreply.github.com>
---------
Co-authored-by: Richard Gomez <32133502+rgmz@users.noreply.github.com>
2024-05-01 13:20:54 -05:00
ahrav
7bd1fb1dcc
update imports ( #2772 )
2024-05-01 11:41:43 -05:00
Ankush Goel
79687683ff
Detector-Competition-Fix - fixed the alchemy detector regex ( #1821 )
...
* fixed the alchemy detector
* added the chunk filtering for alcht_
2024-04-30 17:01:13 -05:00
Ankush Goel
770459eb57
Detector-Fix: Reintroduce Cloudflareglobalapikey ( #2101 )
...
* fixed cloudflare code
* readd email check
---------
Co-authored-by: Zachary Rice <zachary.rice@trufflesec.com>
2024-04-30 15:11:04 -05:00
Cody Rose
2f7029bc4d
Expose detector-specific false positive logic ( #2743 )
...
This PR:
Creates an optional interface that detectors can use to customize their false positive detection
Implements this interface on detectors that have custom logic
In most cases this "custom logic" is simply a no-op because the detector does not participate in false positive detection
Eliminates inline (old-style) false positive exclusion in a few detectors that #2643 missed
2024-04-30 16:10:26 -04:00
Ankush Goel
dc930f9594
fixed calendly api key ( #2368 )
2024-04-30 14:47:36 -05:00
mountcount
1d92655d97
pkg: fix function names in comment ( #2761 )
...
Signed-off-by: mountcount <cuimoman@outlook.com>
2024-04-29 11:21:26 -05:00
Cody Rose
ba5ad5d8a9
Fix SQL Server detector tests ( #2716 )
...
These tests were broken so I fixed them and updated them to use testcontainers, which is more robust and used in the JDBC detector tests.
2024-04-25 10:40:46 -04:00
Dustin Decker
0ce02fc827
Make connection issues less jarring ( #2730 )
...
* Make connection issues less jarring
* lint
* fix lint issue
* print just the connection issue in yellow
* update terminology
2024-04-23 14:29:38 -07:00
Dustin Decker
14e44db2be
Move detectors.IsKnownFalsePositive from the detectors and into the engine ( #2643 )
...
* Remove detectors.IsKnownFalsePositive from detectors
* Centralize false positive removal in engine
* Don't apply fp filtering on custom regex to preserve previous behavior.
* fix empty branch
* update excludes
* update filtering
* Add result flag option and exclude some detectors
2024-04-22 15:18:04 -07:00
Ankush Goel
3fa86a1008
added onfleet api key detector ( #2375 )
...
* added onfleet detector
* use organization get endpoint
---------
Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2024-04-21 10:06:51 -07:00
Julien Doutre
32652a7498
Detect Slack workflows webhook ( #2569 )
2024-04-19 07:21:40 -07:00
Luska
e5575cd6f2
Adding Pagarme API key detection ( #2665 )
...
* Adding support to Pagarme API key detection
* adding scanner
---------
Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2024-04-10 17:57:25 -07:00
ahrav
867434331b
[refactor] - template detector ( #2692 )
...
* refactor template detector to only check for 200 status code
* Replace ldap.DialTLS w/ ldap.DialURL since the former is deprecated
* sort imports
2024-04-10 17:46:07 -07:00
fml09
c6b454e736
Remove unnecessary space in Vultr regex pattern ( #2689 )
...
* Fix incorrect regular expression with missing closing bracket
* Remove unnecessary space in Vultr regex pattern
2024-04-10 17:12:55 -07:00
