Christopher K. Hoadley
|
33e8beb5b4
|
Add command line option to only run a report on specified sites (as opposed to all of them). Move loading of JSON file out of the query logic proper: we need to keep the database and the query logic separate anyway for future changes, so this is a first step in the refactoring. Update readme file with latest information.
|
2019-01-05 22:52:53 -06:00 |
|
Christopher K. Hoadley
|
4596f7121e
|
Specify the encoding to be UTF-8 for the csv file. The Rajče.net site was causing this to fail.
|
2019-01-05 20:39:56 -06:00 |
|
Yahya SayadArbabi
|
81d15482f7
|
bump version
|
2019-01-06 00:30:32 +03:30 |
|
Yahya SayadArbabi
|
0d85703093
|
bump version
|
2019-01-05 16:57:31 +03:30 |
|
QuantumSheep
|
2e4b3a32ad
|
Stops opening the file at each writing
|
2019-01-05 13:43:03 +01:00 |
|
Yahya SayadArbabi
|
f27d2b2aed
|
bump version
|
2019-01-05 11:14:13 +03:30 |
|
Yahya SayadArbabi
|
cc22d88679
|
bump version
|
2019-01-05 09:38:28 +03:30 |
|
nil0x42
|
2791e1553a
|
Fix incorrect file save notification
When username argument was provided with uppercase chars, sherlock
said that file was saved into "UserName.txt" instead of "username.txt" (fname var)
|
2019-01-04 23:59:58 +00:00 |
|
Yahya SayadArbabi
|
683ca99316
|
bump version
|
2019-01-05 01:20:41 +03:30 |
|
Yahya SayadArbabi
|
de1d0d643c
|
bump version
|
2019-01-04 19:34:00 +03:30 |
|
Yahya SayadArbabi
|
a63c14071b
|
Merge branch 'Use_Colorama_syntax_for_better_readability'
|
2019-01-04 19:33:25 +03:30 |
|
Yahya SayadArbabi
|
30eb9c76ec
|
bump version
|
2019-01-04 11:51:07 +03:30 |
|
Yahya SayadArbabi
|
287305a12c
|
bump version
|
2019-01-04 11:42:00 +03:30 |
|
Yahya SayadArbabi
|
3b5263c5bd
|
Add Wikipedia
|
2019-01-04 11:02:19 +03:30 |
|
Jen-Chieh
|
df1f35bc88
|
Use Colorama for better readability.
|
2019-01-04 13:17:23 +08:00 |
|
Andrew Yatzkan
|
2d50409428
|
Changed error code from 404 to not 2XX
|
2019-01-03 18:04:52 -06:00 |
|
Andrew Yatzkan
|
ab99ee016e
|
Made .txt file case insensitive
|
2019-01-03 17:44:24 -06:00 |
|
Yahya SayadArbabi
|
ffbd5b3d4b
|
Fix versioning
|
2019-01-04 01:20:59 +03:30 |
|
Yahya SayadArbabi
|
992e22059a
|
bump version
|
2019-01-04 01:18:10 +03:30 |
|
Yahya SayadArbabi
|
f4c490d25e
|
run "isort"
|
2019-01-04 01:16:55 +03:30 |
|
Yahya SayadArbabi
|
853008c075
|
Merge branch 'jcs-PR/color'
|
2019-01-04 01:05:26 +03:30 |
|
Yahya SayadArbabi
|
f984b447c0
|
Run "isort"
|
2019-01-04 01:05:12 +03:30 |
|
Jonas Tranberg
|
e51da5b712
|
If only status_code is needed use HEAD instead of GET request to avoid body download
|
2019-01-03 18:39:43 +01:00 |
|
Yahya SayadArbabi
|
e6256e70a6
|
Bump version
|
2019-01-03 17:44:35 +03:30 |
|
jenchieh
|
43f4e893f3
|
Initialize Colorama and import it.
|
2019-01-03 18:18:04 +08:00 |
|
Jon Ander Oribe
|
005e9591c1
|
Adding a counter of resources
At the end of the process we can see how many results we have
|
2019-01-02 16:43:38 +01:00 |
|
Yahya SayadArbabi
|
f7daae14e3
|
Merge branch 'cclauss_patch-3'
|
2019-01-02 13:25:47 +03:30 |
|
Yahya SayadArbabi
|
85c80952c9
|
Merge branch 'simplify_print_error'
|
2019-01-02 13:18:54 +03:30 |
|
Christopher K. Hoadley
|
448f072e36
|
Merge branch 'pr/n49_cblument'
|
2018-12-31 09:59:15 -06:00 |
|
Chris Blumentritt
|
ce53663331
|
Use os.path.join to build file path for data file
fixes #47
|
2018-12-31 09:46:42 -06:00 |
|
Christopher K. Hoadley
|
8090a96c57
|
Fix merge problem in pull request #43. Previously, there was just one for loop that iterated thru all of the sites. But, with the addition of the parallel functionality, there are now two for loops. The dictionary changes were not done in the second loop, which caused bogus results.
|
2018-12-31 06:08:20 -06:00 |
|
cclauss
|
05cbeb5c2c
|
Add a shebang line: #! /usr/bin/env python3
|
2018-12-31 08:32:35 +01:00 |
|
cclauss
|
c0ac0d9f9d
|
Update sherlock.py
|
2018-12-31 07:44:27 +01:00 |
|
cclauss
|
96c3ce7625
|
Simplify print_error()
|
2018-12-31 07:40:05 +01:00 |
|
cclauss
|
3200eb3ad5
|
Run isort on the imports
[isort](https://github.com/timothycrosley/isort/blob/develop/README.rst) cleans up the imports for readability.
|
2018-12-31 07:27:54 +01:00 |
|
Chris Blumentritt
|
cf7ec54f23
|
Script can now load the data.json file when invoked from different directory
If the script is run from a different directory than the where it
resides then it would fail to load because it could not find data.json.
fixes #47
|
2018-12-30 23:52:23 -06:00 |
|
Christopher K. Hoadley
|
f9d59270a3
|
Merge branch 'pr/n43_cclauss'. Use new pattern for getting "urlMain" data as well.
|
2018-12-30 18:22:30 -06:00 |
|
Christopher K. Hoadley
|
e2c4dbf1ef
|
Merge branch 'pr/n4_svisser'
|
2018-12-30 17:46:02 -06:00 |
|
cclauss
|
28f023a339
|
Use dict.get() on optional parameters
|
2018-12-30 23:39:08 +01:00 |
|
cclauss
|
60555eeda7
|
Use dict.items() to simplify interaction with dict (again)
#20 again...
|
2018-12-30 23:22:29 +01:00 |
|
Siddharth Dushantha
|
03c41ee555
|
Version bump
From now on, the version will be the date and the format is from big to small. Year, Month, Day.
Just like youtube-dl does it.
|
2018-12-30 21:39:45 +01:00 |
|
Siddharth Dushantha
|
57a4448264
|
modified the comment about the user agent #41
|
2018-12-30 21:25:04 +01:00 |
|
Christopher K. Hoadley
|
55b6ffa5ba
|
Simeon Visser noticed that "enforce utf-8 encoding when we open data.json" (#8) got undone in the previous merge. Include it again.
|
2018-12-30 11:16:15 -06:00 |
|
Tejasvi Nareddy
|
78a3451c03
|
Merge remote-tracking branch 'upstream/master' into async-requests
# Conflicts:
# .gitignore
# requirements.txt
# sherlock.py
|
2018-12-30 00:10:31 -05:00 |
|
mpieters93
|
51ce9fc10b
|
Merge branch 'master' into tor
|
2018-12-29 15:59:30 +01:00 |
|
Christopher K. Hoadley
|
d9e600d05d
|
Add support for writing to Comma-Separated Values (CSV) File with all of the results. Unfortunately, the request text is so long that it is not visible in spreadsheet programs. So, I am leaving this off for now.
|
2018-12-28 22:32:30 -06:00 |
|
Christopher K. Hoadley
|
b17072b3cd
|
Change sherlock method to return dictionary summarizing all results. This will allow the caller to have raw information for other reports.
|
2018-12-28 22:28:47 -06:00 |
|
Mike Pieters
|
feef27b2e4
|
Removed accidental whitespace
|
2018-12-29 02:45:19 +01:00 |
|
Mike Pieters
|
49f65021bb
|
Adds option to use new TOR circuit for each request
|
2018-12-29 02:31:31 +01:00 |
|
Mike Pieters
|
b2cb0506a3
|
Adds option to connect over TOR
|
2018-12-29 01:50:25 +01:00 |
|