Dustin Decker
ede0c39589
Add new auth method to source ( #2132 )
2023-11-28 10:58:11 -08:00
ahrav
fd33198ad8
add proto fields for Git ( #2104 )
...
* add proto fields for git
* add uri to proto
* add comment
2023-11-16 13:52:38 -08:00
ahrav
76a0468580
update protos so we can use the git source for CI ( #2102 )
2023-11-08 09:07:29 -08:00
Dustin Decker
05fae156e1
Add TravisCI source ( #1877 )
...
* Add TravisCI source
* update test to use sourcestest
* Remove jobPage loop
ListByBuild does not support pagination, so this was infinitely
repeating. https://developer.travis-ci.com/resource/jobs#find
* Continue chunking on error
* review updates
* update readme
---------
Co-authored-by: Miccah Castorina <m.castorina93@gmail.com>
2023-10-30 07:28:25 -07:00
Damanpreet Singh
2189dc9b0f
Detector-Competition-Feat: Added Portainer Detector ( #1936 )
...
Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2023-10-25 06:32:57 -07:00
ahrav
5901a92acb
deprecate scan_interval field ( #1984 )
...
* deprecate scan_interval field
* rename
* add link to docs
2023-10-25 06:18:27 -07:00
Miccah
273f1077af
Add include and ignore list to Artifactory ( #1857 )
...
* Add include and ignore list to Artifactory proto
* Generate protos
2023-10-03 16:48:30 -07:00
ahrav
cee456f484
support insecure TLS for Jira and Jenkins ( #1856 )
...
* support insecure TLS for Jira and Jenkins
* lint
2023-10-03 09:55:38 -07:00
joeleonjr
699547b7d3
consolidated pr and issue descr/comment flags ( #1827 )
2023-09-27 15:54:02 -04:00
joeleonjr
1e42dae734
added PR and Issue body scanning ( #1816 )
...
* added PR and Issue body scanning; adjusted CLI args to fit
* removed print statement from debugging
* removed exclude-commits; adjusted CLI flags
* minor changes to match main branch
* fixing logic
* updating README for --issues and --prs
2023-09-26 12:25:48 -04:00
Mike Vanbuskirk
64dd49f9ce
add role assumption for s3 source ( #1477 )
...
* add role assumption for s3 source
* refactor role assumption to repeatable string
user can pass array of roles to assume
* refactor s3 chunks to handle passed roleARNs
* add role-session name
use timestamp to make dynamic
* add docstring for rolearn strings()
* make sure role ars are passed into source
* refactor role assumption functionality
break s3 bucket scanning into sep. function
* add log check on assume role
* fix role iteration
- Make sure s3 struct is populated with roles
- add separate new client instantiation for role-based access
- iterates through each role
* add comment
* protobuf revert for merge
* re-run make proto
* lint cleanup
* cleanup TODOs
* drop redundant switch case in assumerole client
* use less verbose 'ctx' designator
* breakout functionality from Chunks
- separate functions for:
- enumerating buckets to scan
- scanning objects within the buckets
* remake protobuf defs
* allow scan to continue on single bucket err
* add readme docs
* minor fixups
2023-08-17 20:30:20 -04:00
Richard Gomez
e0faac8d1c
Fix runtime error when scanning Gist comments ( #1552 )
...
* fix(github): fix runtime error from gist comments
* fix(github): add flag to scan Gist comments
2023-07-31 08:57:42 -05:00
ahrav
ade5d91d5c
Add azure repos protos. ( #1559 )
2023-07-26 19:53:10 -07:00
Zubair Khan
4334af4d34
scan GitHub PR and issue comments ( #1435 )
...
* issue comment scanning
* save progress
* test
* test for pr comment and issue comment
* add pagination support
* linter stuff
* make linter happy
* remove debug log
* readd logging
* github issue resolved
* var const block and handle rate limit
* remove magic number
* make gitURLParse a public function to use more generally
* fix test bug
* make comment scanning OPT-IN
2023-07-11 15:13:33 -04:00
Dustin Decker
e856a6890d
🎉 Add Docker image scanning 🎉 ( #1412 )
...
* Add Docker source
* Add metrics
* Add test
* Add debugging, address PR comments, fix path output
* review suggestions
2023-06-22 08:02:25 -07:00
Dustin Decker
4250773e92
GitHub basic auth ( #1337 )
2023-05-15 22:04:42 -07:00
Brendan Shaklovitz
10902f802a
Add max object size flag for s3 bucket scanning ( #1294 )
...
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2023-04-26 15:39:43 -07:00
ahrav
622700b6ec
update proto to allow for ignoring projects. ( #1289 )
2023-04-26 07:30:43 -07:00
Zubair Khan
6dd24d17d4
Switch Endpoint Field to Client ID ( #1270 )
...
* no longer using endpoint, but do need client id
* use oauth2 credential type
2023-04-19 16:54:37 -04:00
ahrav
5b2b434a8a
Allow multipel team IDs. ( #1259 )
2023-04-19 11:47:25 -07:00
Miccah
562f3aaa2a
Generate protos ( #1250 )
2023-04-10 17:15:53 -05:00
Zubair Khan
2c1d8fbba4
THOG-920/add oss proto ( #1240 )
...
* add sharepoint source proto
* create sharepoint oss protos
* add email field, remove oauth2 type, update token to refresh_token
* rename path to link
* restore clientcredentials
* restore s3 and confluence proto changes from make command
2023-04-10 10:30:47 -07:00
iamjpotts
b3d917f9c7
Resolve #1167 by adding support for the AWS_SESSION_TOKEN ( #1170 )
...
* Resolve #1167 by adding support for the AWS_SESSION_TOKEN environment variable and adding a --session-token cli arg
* fix error message
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2023-04-03 14:56:43 -07:00
ahrav
dfc38a135a
Add oauth2 cred as auth type for Teams. ( #1221 )
2023-03-29 19:37:41 -07:00
ahrav
b8467ee17e
Add Oauth creds to GCS. ( #1212 )
2023-03-27 10:29:21 -07:00
garg472
3e4496156c
added new detectors and fixed mesibo detector ( #1166 )
...
* added new detectors and fixed mesibo detector
* added bscscan.com API detector
* added coinmarketcap detector
* update alchemy
* update blocknative
* update bscscan test
* update cmc test
* update tests
---------
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2023-03-16 18:57:08 -07:00
ahrav
c617bd7a4e
Add resuming capability to GCS source ( #1161 )
...
* Add resuming capability to GCS source.
* Handle no auth scans.
* complete resume logic
* Use custom function type.
* remove functions.
* linter.
* fix test.
* fix test.
* Handle concurrent map writes.
* use string as CLI flag for include/exclude.
* handle emtpy buckets.
* Handle enumeration on initial job run.
* Rename stats to attributes.
* remove redundant return.
* If test fails due to 400, that is fine, it's expected.
* Add unauth GCS source type.
* comments.
* update proto.
* Use short flag.
* address comments.
2023-03-16 17:53:42 -07:00
ahrav
6193509098
add support for json service account and service account file. ( #1185 )
2023-03-16 13:04:36 -07:00
ahrav
17e8d7030e
Add unauth GCS source type. ( #1178 )
2023-03-13 16:54:45 -07:00
ahrav
cbf299aa77
Add gcs scanning integration ( #1153 )
...
* Setup for GCS scanning.
* Update GCS engine w/ projectID req.
* Add concurrency field to gcsManager.
* add errgroup to gcsManager.
* Update gcs manager.
* Use defautl ADC.
* use ADC.'
* Add TOOD.
* add log to iterator completion.
* use a BinaryReader instead of concrete object for channel type.
* initial test for Chunks.
* Add tests for chunking objects.
* Add concurrency.
* update metadata to include content type and acls.
* Add object reading code.
* Add integration test.
* Add entrypoint.
* Add removed wg.Wait().
* remove dead code.
* remove build.
* Remove period from file extension.
* remove used.
* Add comment.
* Setup for GCS scanning.
* Update GCS engine w/ projectID req.
* Add concurrency field to gcsManager.
* add errgroup to gcsManager.
* Update gcs manager.
* Use defautl ADC.
* use ADC.'
* Add TOOD.
* add log to iterator completion.
* use a BinaryReader instead of concrete object for channel type.
* initial test for Chunks.
* Add tests for chunking objects.
* Add concurrency.
* update metadata to include content type and acls.
* Add object reading code.
* Add integration test.
* Add entrypoint.
* Add removed wg.Wait().
* remove dead code.
* remove build.
* remove used.
* Add file type for objects.
* Add check for file type and size.
* Add default file size.
* Add additinoal auth options and remaining CLI flags.
* Handle errors in go routines.
* Handle resuming for buckets.
* Remove redundant words in comment.
* remove ok check on bool check.
* remove extra blank line.
* Add return if handler handles chunk.
* Add comment.
* remove extra blank line.
* cleanup comment.
* Add comment.
* move up fxn.
* go mod tidy.
* Add exclusion to perf testing buckets.
* Handle blocking the channel.
* remove unused const.
* fix tests.
* fix tests.
* Handle gcs manger options better.
* update fxn name.
* Remove arg name.
* ignore buckets in gcsManager test.
* fix test.
* propulate gsManagerOpts.
* inline err check.
* Add readme.
* update readme spelling.
* fix test.
2023-03-07 17:32:04 -08:00
Miccah
c5b4d6f28b
Support file scanning in filesystem source ( #1030 )
...
* Rename directories to paths
* Generate protos
* Add file scanning support to filesystem source
* Add directories back to filesystem proto
* Generate protos
* Combine paths and directories from in source
* Add filesystem filter
* Address comments
2023-02-27 12:15:05 -06:00
ah̳̕mͭͭͨͩ̐e̘ͬ́͋ͬ̊̓͂d
ee5b028c67
Adding initial protos for Google Drive scanner ( #1121 )
2023-02-22 10:04:46 -05:00
Dustin Decker
26c455d302
add more confluence options ( #1105 )
2023-02-13 13:58:02 -08:00
ahrav
3f30216356
Add incclude exclude spaces for confluence source. ( #1073 )
2023-02-06 08:49:45 -08:00
ahrav
936a139596
Allow using a glob for include list. ( #977 )
...
* Allow using a glob for include list.
* Update command flag.
* Make comment more clear.
* update comment.
* Allow scanning repo and org at the same time.
2022-12-16 13:28:16 -08:00
Dustin Decker
3a143f095b
add option to skip tls verification for confluence ( #900 )
2022-11-03 13:10:01 -07:00
ahrav
c203eef86f
[THOG-767] - Ignore Bitbucket and Gitlab repos ( #852 )
...
* Add messages to BB and Gitlab source protos to allow ignoring repos.
* remove unsued field in struct.j
* Fix casing.
2022-10-18 14:14:04 -07:00
ahrav
cea2a23c56
[THOG-768] - Add ignore repo list to Github proto ( #843 )
...
* Add ignore repo list to Github proto.
* Add proto.
* Add missing proto.
2022-10-11 15:41:33 -07:00
Miccah
2bc4985061
Add SSH config option for the git source ( #830 )
...
* Add SSH config option for the git source
The auth message is empty since we use the git binary underneath to
handle the SSH authentication.
* Import digitaloceanv2
2022-09-28 20:40:01 +02:00
trufflesteeeve
02310a64f3
Add token auth to JIRA proto ( #824 )
2022-09-27 15:39:51 -04:00
trufflesteeeve
57e46f9b76
Add SlackRealtime proto message ( #803 )
2022-09-16 16:49:51 -04:00
trufflesteeeve
176552b07a
Fix commit attribution, git tests, and run make protos ( #667 )
...
* Update dependency to fix commit attribution, fix git tests
* Run make protos to match code with current proto definitions
2022-07-25 11:44:15 -04:00
ahrav
59fc54b94a
[Thog-441] create public event monitoring source ( #599 )
...
* Add source for public event monitoring.
* Update protos.
* Add source for public event monitoring.
* Update metadata.
* Update proto.
* Update proto.
* Update pb files.
2022-06-03 14:46:31 -07:00
Miccah
d7d5db9e78
Replace AccessToken protobuf with a simpler string type ( #594 )
2022-05-31 14:28:07 -05:00
ahrav
d2605354fe
[THOG-332 ]Remove TokenSource interface from the init method of Source. ( #539 )
...
* Remove TokenSource interface from the init method of Source.
* Remove proto message.
* Remove proto message.
* Fix tests.
* Fix filesystem test.
2022-05-13 14:35:06 -07:00
ahrav
b0d79180f6
[THOG-314] Add new parameter to the Init method for the source interface. ( #529 )
...
* Add new parameter to the Init method for the source interface.
* Add Oauth Token service.
* remove .test file.
* remove .test file.
* Fix param spelling.
* fix tests with new param in init
* Add missing gock lib.
2022-05-10 11:11:43 -07:00
Bill Rich
c78120e56f
Syslog source ( #500 )
...
* Add syslog source
* only load cert/key with tls
* Cleanup
* Linting
Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-05-04 15:08:11 -07:00
ahrav
ad82a8e52c
Update the Teams message proto to include access token auth. ( #389 )
...
* Update the Teams message proto to include access token auth.
* Add team_id field to the Teams message proto.
2022-04-12 10:55:17 -07:00
Miccah
c6b537feb3
Change Artifactory credential to AccessToken ( #387 )
...
* Change Artifactory credential to AccessToken
* Generate protos
2022-04-12 10:54:45 -05:00
Bill Rich
bf5c757cd3
Add head and base support to github ( #346 )
2022-04-08 14:32:54 -07:00
