Bill Rich
d78c929385
Actually skip file ( #299 )
2022-04-06 09:48:40 -07:00
Bill Rich
33aa6f9cab
Log error and skip file when stat fails ( #296 )
2022-04-05 18:58:05 -07:00
Dustin Decker
d41d18af3a
fix cli parsing and improve github user scanning error handling
2022-04-03 13:42:23 -07:00
ahrav
cedb3393d1
[THOG-128] Code cleanup/ OSS onboarding ( #117 )
...
* Small amount of code clean up.
* Rename sem to concurrency for better readability and to remove an extra comment.
* fix stashing issue.
Co-authored-by: Ahrav Dutta <ahrav.dutta@trufflesec.com>
2022-04-01 16:47:27 -07:00
Bill Rich
6ed01500f8
Only add trailing slash when endpoint populated ( #120 )
2022-04-01 11:47:59 -07:00
Bill Rich
62ed0878a5
Improve git clone error logging ( #114 )
2022-03-30 14:27:13 -07:00
Bill Rich
155566bbd5
make sure url ends with slash ( #110 )
2022-03-28 09:56:44 -07:00
steeeve
a770f643df
Add placeholder for encoded resume info in SetProgressComplete
2022-03-24 12:43:36 -04:00
Bill Rich
c2b4f0bc39
Include line numbers in git metadata ( #97 )
...
* Include line numbers in git metadata
* Update tests for fragments and line numbers
2022-03-22 09:27:15 -07:00
Bill Rich
0ea3b93238
Use git cmd for clone ( #96 )
...
* Use git command to clone
* Check for git command when cloning
2022-03-22 09:26:58 -07:00
Bill Rich
5ab5c6f9d9
Only scan regular files ( #87 )
...
* Only scan regular files
* Remove IsDirectory func
2022-03-16 16:04:10 -07:00
Bill Rich
faf30fe8fe
Use author email ( #85 )
2022-03-15 17:54:03 -07:00
Bill Rich
6354b16810
Use patched go-gitdiff ( #84 )
2022-03-15 17:02:45 -07:00
Bill Rich
e8234c3514
Remove unused code and add git binary check ( #80 )
2022-03-14 17:47:18 -07:00
Dustin Decker
72c13c4b8f
Update detector process and readme ( #79 )
2022-03-14 17:27:14 -07:00
Bill Rich
0ee34a5be6
Use gitleaks git cmd stream ( #75 )
...
* Switch to git cmd stream
* Fix rebase issues
2022-03-14 17:12:58 -07:00
Bill Rich
6486c18565
Add s3 support to CLI ( #76 )
...
* Add s3 support to CLI
* Clean up comments
Co-authored-by: Dustin Decker <dustin@trufflesec.com>
2022-03-14 17:07:07 -07:00
Dustin Decker
794a082b6c
Fix Dockerfiles, readme example, and github rate limit handling
2022-03-12 07:36:42 -08:00
Dustin Decker
b0e0c26137
update detectors
2022-03-11 10:24:36 -08:00
Dustin Decker
8d754a88d4
update dependency
2022-03-09 15:49:57 -08:00
Bill Rich
55b839fc5a
Only scan files that changed from base to head ( #68 )
...
* Only scan files that changed from base to head
* Acknowledge ignored errors
2022-03-08 08:48:00 -08:00
Bill Rich
2a0ece9eef
Wait until rate limit reset ( #69 )
2022-03-08 08:47:37 -08:00
Bill Rich
665b0bf928
Add timestamp ( #61 )
...
* Add timestamp to sources
* Include timestamp in sources
2022-03-04 08:39:23 -08:00
Dustin Decker
c80bd5e905
Fix linting and dogfood in CI
2022-03-04 08:39:23 -08:00
trufflesteeeve
9cb99e5aa4
578 Fix gitlab basic auth with access tokens ( #54 )
2022-03-04 08:39:22 -08:00
Bill Rich
c144630c54
Add parent results to ignore list ( #47 )
...
* Add parent results to ignore list
* Force concurrency to 1 when base commit is set
2022-03-04 08:39:22 -08:00
Bill Rich
b25295580a
Actually save the normalized repos ( #50 )
2022-03-04 08:39:22 -08:00
Bill Rich
c742f6a816
Do not continue if semaphore can't be acquired ( #49 )
2022-03-04 08:39:22 -08:00
Bill Rich
56dc1b109c
Check commit order, dedupe results, and support using a head commit. ( #44 )
...
* Check commit order and support using a head commit.
* Only apply dedupe to git bases source
2022-03-04 08:39:22 -08:00
Dustin Decker
c20e9f4732
improvements
2022-03-04 08:39:17 -08:00
Dustin Decker
77418fb3f8
module v3
2022-02-15 18:54:47 -08:00
Bill Rich
2d8756938d
Fast git scanning ( #40 )
...
* Fast git scanning
* Use original tests
* Use committer time
Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Dustin Decker
152ef6d4e1
add include forks option ( #37 )
2022-02-15 18:54:47 -08:00
Dustin Decker
c131a6e4ae
add debug pprof server and metrics server
2022-02-15 18:54:47 -08:00
Bill Rich
1fb767247f
Add missing pagination on github calls ( #30 )
...
* Add missing pagination on github calls
Includes some refactoring to improve readability and code reuse.
* Close response body and handle rate limit
* Re-include support for including users as repos to github scans
* Fix gist test to match new func signature
* Add current test name to logging
* Support username as org use case
* Also include no-auth user as org
Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Bill Rich
6b183424f5
Match expected chunks to actual
2022-02-15 18:54:47 -08:00
Bill Rich
2cc34f4633
Make tests more resilliant and more coverage
2022-02-15 18:54:47 -08:00
Dustin Decker
e15fa3a5be
helpful logging
2022-02-15 18:54:47 -08:00
Dustin Decker
44d113c408
Add concurrency to gitlab source integration
2022-02-15 18:54:47 -08:00
Dustin Decker
7e38e699f6
GitHub concurrency ( #25 )
...
* GitHub scan concurrency
* Add raw result to plain output
* Fix flakey test (still flakey)
* Fix race
2022-02-15 18:54:47 -08:00
Bill Rich
206b99704b
Change log order and path filtering.
2022-02-15 18:54:47 -08:00
Dustin Decker
26184dc2cd
Fix incorrect commit skipped error
2022-02-15 18:54:47 -08:00
Dustin Decker
3da3f1ec94
Add gitlab pagination support ( #26 )
2022-02-15 18:54:47 -08:00
Bill Rich
28ed0c3b7c
Complete support for existing git scan flags ( #13 )
...
* Add `since_commit` to git scan
* Support `max_depth` option for git scan
* Use new options in github and gitlab sources
* Address review feedback
Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-02-15 18:54:47 -08:00
Dustin Decker
03ead2f7ed
Integrate GitHub source
2022-02-15 18:54:47 -08:00
Dustin Decker
d6ffadb1ee
Initial docs and release automation ( #5 )
2022-01-18 16:59:18 -08:00
Bill Rich
a70937bfe6
Support remote git repos using https ( #9 )
...
Co-authored-by: Bill Rich <bill.rich@trufflesec.com>
2022-01-14 16:07:45 -08:00
Bill Rich
1422cc303a
Include and exclude paths args for gitscan ( #6 )
...
* include and exclude paths gitscan args
Add support for include_paths and exclude_paths arguments when scanning
git sources.
* Improve variable name
Co-authored-by: Bill Rich <hrich@Bills-MacBook-Pro.local>
2022-01-14 12:40:50 -08:00
Dustin Decker
4218c39d99
Initial CLI w/ partially implemented Git source and demo detector ( #1 )
2022-01-13 12:02:24 -08:00
