Commit graph

215 commits

Author SHA1 Message Date
Eliran Gonen
0d1b5e91d5
--headless not to require args
make the required True argument redundant
2020-11-29 06:55:28 +02:00
Eliran Gonen
adc7a005b7
--chromium not to require args
I've modified the --chromium argument to be enough in itself to provide 'True' with no need to add CLI argument to it.
2020-11-29 06:45:48 +02:00
sickcodes
7b136e9796 Add --chromium & --headless optional flags 2020-10-04 11:41:43 +00:00
Haris Muneer ⚡️
4f54d8473d
Merge pull request #170 from Hassaan-Elahi/patch-1
Update README.md
2020-09-25 14:59:49 +05:00
Hassaan Elahi
00c168bea9
Update README.md 2020-09-25 11:19:51 +05:00
Haris Muneer ⚡️
7c7832fdee
Update README.md 2020-09-19 17:38:14 +05:00
Haris Muneer ⚡️
97afc82585
Update README.md 2020-09-14 05:03:54 +05:00
Haris Muneer ⚡️
41aa6fa449
Update README.md 2020-07-21 03:50:11 +05:00
Haris Muneer ⚡️
d3eabce9b0
Merge pull request #149 from DeDe43ISR/fix_post_content
fix #91 - fixed posts.txt contains no text
2020-07-21 03:45:13 +05:00
DeDe Ubuntu Lap
678b592e86 fix #91 update status selectors id
Signed-off-by: DeDe Ubuntu Lap <yarden984321@gmail.com>
2020-07-19 20:10:40 +03:00
Haris Muneer ⚡️
f6aee6db36
Update .gitignore 2020-07-14 18:16:12 +05:00
Haris Muneer ⚡️
01d07e1fa6
Update setup.py 2020-05-22 12:56:26 +05:00
Haris Muneer ⚡️
dd6b3e47fe
Update README.md 2020-05-22 12:55:53 +05:00
Haris Muneer ⚡️
38d3b35c30
Update README.md 2020-05-22 12:51:57 +05:00
Haris Muneer ⚡️
d7c8eb6810
Update README.md 2020-05-22 12:37:31 +05:00
Haris Muneer ⚡️
48483a4019
Update .gitignore 2020-04-18 00:38:10 +05:00
Haris Muneer ⚡️
dc18b20a47
Delete ufs_icon.png 2020-04-17 21:00:32 +05:00
Haris Muneer ⚡️
58769c413d
Delete screenshot.png 2020-04-17 21:00:22 +05:00
Haris Muneer ⚡️
bf616112dc
Delete main.png 2020-04-17 21:00:11 +05:00
Haris Muneer ⚡️
a5b8c10246
Update README.md 2020-04-17 20:59:32 +05:00
Haris Muneer ⚡️
dd4a0541d3
Merge pull request #104 from aayaffe/feature/page_scraper
Scraping group posts
2020-04-17 20:55:21 +05:00
Amit Yaffe
d5861f643f Added the new features to readme.md.
Fixed a few mistakes in output file headers, and removed redundant if.
2020-04-16 19:08:40 +03:00
Amit Y
d654c55344 Added gitgnore entries used during dev.
Added the option to set comments in input.txt file
Added options to scrape group posts and single group post (automatically identify the link)
2020-04-14 17:06:05 +03:00
Amit Y
67f2be02f6 Added support for more languages (UTF-8) 2020-04-14 16:14:33 +03:00
Haris Muneer ⚡️
d9dc89ef3a
Merge pull request #102 from aayaffe/v2.0
Added support for automatic chromedriver management. Removed chrome d…
2020-04-11 18:26:45 +05:00
Haris Muneer ⚡️
3cb987c25b
Update .gitignore 2020-04-11 18:26:06 +05:00
Amit Yaffe
991f036d10 Formatted with black 2020-04-11 16:13:05 +03:00
Amit Yaffe
c23669c65f Ignore data files and scraped data under Scraper directory 2020-04-11 10:58:06 +03:00
Amit Yaffe
a0f9c17c65 Added support for automatic chromedriver management. Removed chrome driver binaries 2020-04-06 11:01:59 +03:00
Haris Muneer ⚡️
4ed08fe3d2
Merge pull request #96 from elyesmanai/enhancements
refactoring
2020-03-28 21:32:49 +05:00
Elyes Manai
bc3cc0db82 updated readme for real this time 2020-03-28 17:29:29 +01:00
Elyes Manai
43d626514e parameters collection for scrapping automated & tested \ command line arguments added & tested \ some enhancements to 2 functions \ utils.py addded, code refactored & tested \ updated readme 2020-03-28 17:24:26 +01:00
Haris Muneer ⚡️
e64ed73afb
Merge pull request #90 from FrostFlame/89-refactoring
89-refactoring (xpaths and selectors are now in selectors.json)
2020-03-18 15:15:04 +05:00
Haris Muneer ⚡️
98b3f23bb3
Update README.md 2020-03-08 19:16:15 +05:00
Haris Muneer ⚡️
160d8c21f9
Update README.md 2020-03-08 19:14:35 +05:00
Haris Muneer ⚡️
e3153ac8f0
Update README.md 2020-03-08 19:07:25 +05:00
Haris Muneer ⚡️
b3f1ed4172
Update README.md 2020-03-08 19:02:46 +05:00
Haris Muneer ⚡️
8b12e1c2df
Update README.md 2020-03-08 18:51:38 +05:00
Haris Muneer ⚡️
04d32cfe67
Update README.md 2020-03-08 18:49:07 +05:00
Haris Muneer ⚡️
ca2c26ca62
Update README.md 2020-03-08 18:42:54 +05:00
Haris Muneer ⚡️
24ec672d19
Update README.md 2020-03-08 18:32:07 +05:00
Haris Muneer ⚡️
90fedb48a0
Update README.md 2020-03-08 18:28:31 +05:00
FrostFlame
59801b4ea5 89-refactoring all xpaths and selectors were taken out into a separate json file. Also changed scrapper into scraper in a couple of places fixing issue #84 2020-03-07 21:40:54 +03:00
Haris Muneer ⚡️
a2be42ce32
Update README.md 2020-03-07 20:42:58 +05:00
Haris Muneer ⚡️
69ac49ae3c
Update README.md 2020-03-07 20:42:17 +05:00
Haris Muneer ⚡️
ebd9a92ce3
Delete FUNDING.yml 2020-03-07 18:20:32 +05:00
Haris Muneer ⚡️
5909e5d463
Update README.md 2020-03-07 18:08:46 +05:00
Haris Muneer ⚡️
ea3117e087
Update README.md 2020-03-07 17:56:27 +05:00
Haris Muneer ⚡️
be79adbe90
Update README.md 2020-03-07 17:52:40 +05:00
Haris Muneer ⚡️
56b89b6ebc
Update README.md 2020-03-07 17:49:32 +05:00