Commit graph

909 commits

Author SHA1 Message Date
marlon pamisa
3210926697 added discordbottoken detector 2022-03-11 10:24:36 -08:00
marlon pamisa
43c8ab7c9b added digitaloceantoken detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
8a37c3620e added diffbot detector 2022-03-11 10:24:36 -08:00
Mildred Tosoc
6cc8b6de6e added dfuse detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
b3079dfea0 added detectlanguage detector 2022-03-11 10:24:36 -08:00
Danee Arquero
4a510159fe added deputy detector 2022-03-11 10:24:36 -08:00
marlon pamisa
ca2044777d added delighted detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
4228a55d7e added deepgram detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
91d34eeee4 added deepai detector 2022-03-11 10:24:36 -08:00
marlon pamisa
02876dc76a added debounce detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
2d96783355 added datafire detector 2022-03-11 10:24:36 -08:00
marlon pamisa
022aa3e1c8 added datadogtoken detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
9e4d3ecc43 added dandelion detector 2022-03-11 10:24:36 -08:00
marlon pamisa
1d5d64f8db added dailyco detector 2022-03-11 10:24:36 -08:00
marlon pamisa
2de56dcbd3 added d7network detector 2022-03-11 10:24:36 -08:00
Dustin Decker
56a9ab453a added customerio detector 2022-03-11 10:24:36 -08:00
marlon pamisa
668ff790e5 added customerguru detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
8abfdce625 added currentsapi detector 2022-03-11 10:24:36 -08:00
Danee Arquero
418ff2a746 added currencyscoop detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
b46f431154 added currencylayer detector 2022-03-11 10:24:36 -08:00
marlon pamisa
309d4e451a added currencyfreaks detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
6707e8c21b added currencycloud detector 2022-03-11 10:24:36 -08:00
Mildred Tosoc
8500b6fa41 added cryptocompare detector 2022-03-11 10:24:36 -08:00
marlon pamisa
1af343b28c added crowdin detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
589271a7de added coveralls detector 2022-03-11 10:24:36 -08:00
Mildred Bernardo
8b11c92481 added courier detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
deabd0b5ce added countrylayer detector 2022-03-11 10:24:36 -08:00
Dustin Decker
56a8670e54 added copper detector 2022-03-11 10:24:36 -08:00
marlon pamisa
d0efe4db42 added convertkit detector 2022-03-11 10:24:36 -08:00
marlon pamisa
afe9ed64f9 added contentfulpersonalaccesstoken detector 2022-03-11 10:24:36 -08:00
marlon pamisa
8e53572ed1 added confluent detector 2022-03-11 10:24:36 -08:00
marlon pamisa
fd40eb3714 added companyhub detector 2022-03-11 10:24:36 -08:00
Mildred Tosoc
eb9784bbdb added commodities detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
eb9b94a8ae added commercejs detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
6b74916974 added coinlib detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
232f5da99d added coinlayer detector 2022-03-11 10:24:36 -08:00
marlon pamisa
b013a09804 added coinbase detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
edb5f48046 added coinapi detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
484506b94f added codacy detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
bd15032ebc added clustdoc detector 2022-03-11 10:24:36 -08:00
Valerie Gale
b257ccce2b added cloze detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
b5b3f5e003 added cloverly detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
791e33e5f5 added cloudplan detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
80879fbedf added cloudmersive detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
c23abec3c1 added cloudimage detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
b6b5c73258 added cloudflareglobalapikey detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
a76e780caf added cloudflarecakey detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
2496612594 added cloudflareapitoken detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
6da9413c5b added cloudelements detector 2022-03-11 10:24:36 -08:00
Dustin Decker
38f958c111 added closecrm detector 2022-03-11 10:24:36 -08:00
Danee Arquero
2eafda79a9 added clockworksms detector 2022-03-11 10:24:36 -08:00
marlon pamisa
87c48c4788 added clockify detector 2022-03-11 10:24:36 -08:00
marlon pamisa
85df6060e5 added clinchpad detector 2022-03-11 10:24:36 -08:00
Valerie Gale
1e34f41bf2 added clickuppersonaltoken detector 2022-03-11 10:24:36 -08:00
Dustin Decker
0278680a39 added clicksendsms detector 2022-03-11 10:24:36 -08:00
Danee Arquero
11d3f90258 added clickhelp detector 2022-03-11 10:24:36 -08:00
marlon pamisa
00ff8e76d5 added clearbit detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
56d56d78eb added clarifai detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
9f8b498b83 added cicero detector 2022-03-11 10:24:36 -08:00
Valerie Gale
8e556645ec added checkvist detector 2022-03-11 10:24:36 -08:00
Valerie Gale
fe339a5013 added checkout detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
5795d5659d added checklyhq detector 2022-03-11 10:24:36 -08:00
marlon pamisa
23e4c3594d added checio detector 2022-03-11 10:24:36 -08:00
marlon pamisa
2a761a89d3 added chatbot detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
63502fd44f added centralstationcrm detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
48ca2bc4a9 added censys detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
e022447f60 added caspio detector 2022-03-11 10:24:36 -08:00
Danee Arquero
490aa4ebbd added cashboard detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
db3d584c98 added carboninterface detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
8b728db2a5 added captaindata detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
6e878ad082 added capsulecrm detector 2022-03-11 10:24:36 -08:00
marlon pamisa
b2d48b5427 added cannyio detector 2022-03-11 10:24:36 -08:00
marlon pamisa
a2ec7e6e7d added campayn detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
1181d8a6fb added calorieninja detector 2022-03-11 10:24:36 -08:00
marlon pamisa
6be5787a83 added calendlyapikey detector 2022-03-11 10:24:36 -08:00
marlon pamisa
9404272006 added calendarific detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
929b270e1c added caflou detector 2022-03-11 10:24:36 -08:00
marlon pamisa
b3ffc76afb added buttercms detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
ec809e3e3d added bulbul detector 2022-03-11 10:24:36 -08:00
marlon pamisa
78770b5c33 added buildkite detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
29893ca733 added bugsnag detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
c43f68ba23 added bugherd detector 2022-03-11 10:24:36 -08:00
Danee Arquero
72dc990b58 added buddyns detector 2022-03-11 10:24:36 -08:00
Mildred Tosoc
a0972f8b8f added browshot detector 2022-03-11 10:24:36 -08:00
marlon pamisa
e1c5cb7075 added brandfetch detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
a1d91b3a12 added borgbase detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
057d53fbd9 added boostnote detector 2022-03-11 10:24:36 -08:00
Mildred Tosoc
1b570df895 added bombbomb detector 2022-03-11 10:24:36 -08:00
marlon pamisa
1dcdd528c2 added blogger detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
88f0bcb55d added blitapp detector 2022-03-11 10:24:36 -08:00
Danee Arquero
69183d2574 added blazemeter detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
8f3386fa51 added blablabus detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
df271f96ef added bitmex detector 2022-03-11 10:24:36 -08:00
marlon pamisa
ad2a59364e added bitlyaccesstoken detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
683d316a08 added bitcoinaverage detector 2022-03-11 10:24:36 -08:00
Danee Arquero
b68c090220 added bitbar detector 2022-03-11 10:24:36 -08:00
Danee Arquero
12acd89dc0 added billomat detector 2022-03-11 10:24:36 -08:00
marlon pamisa
761248051b added besttime detector 2022-03-11 10:24:36 -08:00
Danee Arquero
26ec51b10f added beebole detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
2f0069f84a added beamer detector 2022-03-11 10:24:36 -08:00
marlon pamisa
043f81eaea added baseapiio detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
5684f6b5b4 added baremetrics detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
8fbfb5bc3c added bannerbear detector 2022-03-11 10:24:36 -08:00
marlon pamisa
a7b10ac043 added ayrshare detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
5b03d6059e added aylien detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
5be33cce05 added axonaut detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
40b5341a3f added aviationstack detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
417f96a4bb added avazapersonalaccesstoken detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
e409399551 added autopilot detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
f3b18d3404 added autoklose detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
3131d53313 added autodesk detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
30d4116ba9 added auth0managementapitoken detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
feaefe80e1 added audd detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
b0467cabe2 added assemblyai detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
1bf4e4e729 added asanapersonalaccesstoken detector 2022-03-11 10:24:36 -08:00
marlon pamisa
0bb9463a43 added asanaoauth detector 2022-03-11 10:24:36 -08:00
marlon pamisa
05a4d31b92 added artsy detector 2022-03-11 10:24:36 -08:00
Alemhar Salihuddin
3e83103824 added artifactory detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
186dc5c629 added apptivo detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
c0437d5ba4 added appsynergy detector 2022-03-11 10:24:36 -08:00
marlon pamisa
3da920616b added appfollow detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
c8960a6d9e added appcues detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
633005d4d7 added apollo detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
f6307e6a41 added apiscience detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
70a9764504 added apimatic detector 2022-03-11 10:24:36 -08:00
Mildred Bernardo
60761f5e60 added apify detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
b670a72453 added apifonica detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
0dd2d19b3f added apiflash detector 2022-03-11 10:24:36 -08:00
marlon pamisa
84851da369 added apideck detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
334d852742 added api2cart detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
232fdb7137 added apacta detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
acc54a4c5f added anypoint detector 2022-03-11 10:24:36 -08:00
Marlon Pamisa
bb0dbdb68b added amplitudeapikey detector 2022-03-11 10:24:36 -08:00
valeriegaleguimmayen
12991244f4 added ambee detector 2022-03-11 10:24:36 -08:00
Danee Arquero
829f290267 added amadeus detector 2022-03-11 10:24:36 -08:00
marlon pamisa
c7895b9b5d added allsports detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
1271c451f0 added alienvault detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
c5b86d9b80 added aletheiaapi detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
710dd12958 added alegra detector 2022-03-11 10:24:36 -08:00
marlon pamisa
0bf12a2bec added alconost detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
964fd8c536 added airvisual detector 2022-03-11 10:24:36 -08:00
Jonee Ryan Ty
e3ee74bf80 added airtableapikey detector 2022-03-11 10:24:36 -08:00
marlon pamisa
b223d4472c added airship detector 2022-03-11 10:24:36 -08:00
marlon pamisa
e108d3ecb1 added airbrakeuserkey detector 2022-03-11 10:24:36 -08:00
marlon pamisa
cd6a56a9f7 added airbrakeprojectkey detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
2a5607ff0c added adzuna detector 2022-03-11 10:24:36 -08:00
marlon pamisa
e0060b1756 added adobeio detector 2022-03-11 10:24:36 -08:00
Mildred Bernardo
1368a8288e added adafruitio detector 2022-03-11 10:24:36 -08:00
marlon pamisa
4525b2c109 added accuweather detector 2022-03-11 10:24:36 -08:00
Roxanne Tampus
402545c1ea added abuseipdb detector 2022-03-11 10:24:36 -08:00
DANEE ARQUERO
76383466a8 added abstract detector 2022-03-11 10:24:36 -08:00
marlon pamisa
8c50226879 added abbysale detector 2022-03-11 10:24:36 -08:00
Dustin Decker
8d754a88d4 update dependency 2022-03-09 15:49:57 -08:00
Bill Rich
55b839fc5a
Only scan files that changed from base to head (#68)
* Only scan files that changed from base to head

* Acknowledge ignored errors
2022-03-08 08:48:00 -08:00
Bill Rich
2a0ece9eef
Wait until rate limit reset (#69) 2022-03-08 08:47:37 -08:00
Bill Rich
bdbc7e80d1
Use sync.Map to avoid concurrent map writes (#66) 2022-03-05 22:42:06 -08:00
Bill Rich
665b0bf928 Add timestamp (#61)
* Add timestamp to sources

* Include timestamp in sources
2022-03-04 08:39:23 -08:00
trufflesteeeve
fa57727370 190 Add spaces scope to confluence - default to all spaces (#62) 2022-03-04 08:39:23 -08:00
Dustin Decker
c80bd5e905 Fix linting and dogfood in CI 2022-03-04 08:39:23 -08:00
Bill Rich
9f378b8cb3 Resolve a ref as arg for --since_commit (#57) 2022-03-04 08:39:23 -08:00
Dustin Decker
6f32b108a3 Disable GetEmails 2022-03-04 08:39:22 -08:00
trufflesteeeve
9cb99e5aa4 578 Fix gitlab basic auth with access tokens (#54) 2022-03-04 08:39:22 -08:00
Bill Rich
c144630c54 Add parent results to ignore list (#47)
* Add parent results to ignore list

* Force concurrency to 1 when base commit is set
2022-03-04 08:39:22 -08:00
Bill Rich
b25295580a Actually save the normalized repos (#50) 2022-03-04 08:39:22 -08:00
Dustin Decker
7f7e2665a0 Change BasicAuthWithHeader to just Header 2022-03-04 08:39:22 -08:00
Dustin Decker
1da3e0f723 turn off getemail scanner 2022-03-04 08:39:22 -08:00
Bill Rich
c742f6a816 Do not continue if semaphore can't be acquired (#49) 2022-03-04 08:39:22 -08:00
Bill Rich
30034f5d28 Use metadata specific to source type (#48) 2022-03-04 08:39:22 -08:00
Dustin Decker
8b500219f8 Add new credential type for Jenkins 2022-03-04 08:39:22 -08:00
Bill Rich
56dc1b109c Check commit order, dedupe results, and support using a head commit. (#44)
* Check commit order and support using a head commit.

* Only apply dedupe to git bases source
2022-03-04 08:39:22 -08:00
Dustin Decker
b054739984 Not all prefixes are credentials for AWS, fix capturing group 2022-03-04 08:39:22 -08:00
Dustin Decker
86c2eb507b Adding detectors (#46)
* rename secret

* Add supporting docs and tooling for adding new detectors
2022-03-04 08:39:22 -08:00
Dustin Decker
b2a9d5b0a9 Update AWS prefixes 2022-03-04 08:39:22 -08:00
Dustin Decker
c20e9f4732 improvements 2022-03-04 08:39:17 -08:00
Dustin Decker
77418fb3f8 module v3 2022-02-15 18:54:47 -08:00
Dustin Decker
79496b8142 Add context timeout to scanners 2022-02-15 18:54:47 -08:00
Dustin Decker
ee99f0c9a2 Record avg detector time 2022-02-15 18:54:47 -08:00
Dustin Decker
ee90ab344f Use sane http client instead of retryable 2022-02-15 18:54:47 -08:00
Bill Rich
2d8756938d Fast git scanning (#40)
* Fast git scanning

* Use original tests

* Use committer time

Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Dustin Decker
152ef6d4e1 add include forks option (#37) 2022-02-15 18:54:47 -08:00
Dustin Decker
c131a6e4ae add debug pprof server and metrics server 2022-02-15 18:54:47 -08:00
Dustin Decker
8a03899b43 use sane http client for spotifykey 2022-02-15 18:54:47 -08:00
Bill Rich
1fb767247f Add missing pagination on github calls (#30)
* Add missing pagination on github calls

Includes some refactoring to improve readability and code reuse.

* Close response body and handle rate limit

* Re-include support for including users as repos to github scans

* Fix gist test to match new func signature

* Add current test name to logging

* Support username as org use case

* Also include no-auth user as org

Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Bill Rich
6b183424f5 Match expected chunks to actual 2022-02-15 18:54:47 -08:00
Bill Rich
2cc34f4633 Make tests more resilliant and more coverage 2022-02-15 18:54:47 -08:00
Dustin Decker
a96de1a2cd update docs and support multi platform docker images 2022-02-15 18:54:47 -08:00
Dustin Decker
e15fa3a5be helpful logging 2022-02-15 18:54:47 -08:00
Dustin Decker
44d113c408 Add concurrency to gitlab source integration 2022-02-15 18:54:47 -08:00
Dustin Decker
7e38e699f6 GitHub concurrency (#25)
* GitHub scan concurrency

* Add raw result to plain output

* Fix flakey test (still flakey)

* Fix race
2022-02-15 18:54:47 -08:00
Bill Rich
206b99704b Change log order and path filtering. 2022-02-15 18:54:47 -08:00
Dustin Decker
26184dc2cd Fix incorrect commit skipped error 2022-02-15 18:54:47 -08:00
Dustin Decker
3da3f1ec94 Add gitlab pagination support (#26) 2022-02-15 18:54:47 -08:00
Bill Rich
28ed0c3b7c Complete support for existing git scan flags (#13)
* Add `since_commit` to git scan

* Support `max_depth` option for git scan

* Use new options in github and gitlab sources

* Address review feedback

Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Dustin Decker
089b5c9063 improved plain output 2022-02-15 18:54:47 -08:00
Bill Rich
d5f3bd75ef Add --json-legacy flag to make output match pre-v3.0 2022-02-15 18:54:47 -08:00
Dustin Decker
03ead2f7ed Integrate GitHub source 2022-02-15 18:54:47 -08:00
Dustin Decker
533f6d1e20 updates 2022-02-15 18:54:43 -08:00
Dustin Decker
5596025b0b more detectors 2022-02-15 18:46:28 -08:00
marlon pamisa
0f6210df14 added zonkafeedback detector 2022-02-15 18:45:55 -08:00
Roxanne Tampus
7a778ba9d5 added zipcodeapi detector 2022-02-15 18:45:55 -08:00