mirror of https://github.com/harismuneer/Ultimate-Facebook-Scraper synced 2024-11-10 06:04:17 +00:00

No description

Find a file

Haris Muneer ⚡️ 98b3f23bb3 Update README.md		2020-03-08 19:16:15 +05:00
.github	Delete FUNDING.yml	2020-03-07 18:20:32 +05:00
bin	Move binaries to 'bin' directory	2019-11-30 01:50:54 +01:00
images	[ImgBot] Optimize images	2019-10-09 09:31:26 +00:00
scraper	Convert to a proper Python module	2019-11-30 01:53:02 +01:00
.gitignore	Convert to a proper Python module	2019-11-30 01:53:02 +01:00
credentials.yaml	Move config files to root	2019-11-30 01:53:02 +01:00
input.txt	Move config files to root	2019-11-30 01:53:02 +01:00
LICENSE	Upgrade LICENSE	2019-11-30 01:50:54 +01:00
README.md	Update README.md	2020-03-08 19:16:15 +05:00
requirements.txt	Use yaml for credentials. Lint with black	2019-11-28 23:35:06 +01:00
setup.py	Add UTF-8 encoding to open of README.md	2019-12-04 01:10:25 -06:00

README.md

Ultimate Facebook Scraper (UFS)

Tooling that automates your social media interactions to collect posts, photos, videos, friends, followers and much more on Facebook.

Featured by Top Security Blogs and OSINT Researchers

2nd Spot in Top Trending Python Repositories on GitHub

UFS trended among top Python repositories on GitHub for 3 consecutive weeks 🌟

News Updates 🏆

UFS got included as an official tool in the BlackArch Linux distribution!
UFS got listed among the top 20 hacking tools in 2019!

Features 🚀

A bot which scrapes almost everything about a user's Facebook profile including:

uploaded photos
tagged photos
videos
friends list and their profile photos (including Followers, Following, Work Friends, College Friends etc)
and all public posts/statuses available on the user's timeline.

Data is scraped in an organized format to be used for educational/research purposes by researchers. This scraper does not use Facebook's Graph API meaning there are no rate limiting issues.

This tool is being used by thousands of developers weekly and we are pretty amazed at this response! Thank you!🎉

For citing/referencing this tool for your research, check the 'Citation' section below.

Note 🤝

This tool uses xpaths of 'divs' to extract data. Since Facebook updates its site frequently, the 'divs' get changed. Consequently, we have to update the divs accordingly to correctly scrape data.

The developers of this tool have devoted time and effort in developing, and maintaining this tool for a long time. In order to keep this amazing tool alive, we need support from you geeks.

The code is intuitive and easy to understand, so you can update the relevant xpaths in the code if you find data is not being scraped from profiles. Facebook has most likely updated their site, so please generate a pull request. Much appreciated!

Sample

Screenshot

Usage 🔧

Installation 💻

You will need to:

Install latest version of Google Chrome.
Install Python 3
Have a Facebook account without 2FA enabled

$ git clone https://github.com/harismuneer/Ultimate-Facebook-Scraper.git
$ cd Ultimate-Facebook-Scraper

# Set up a virtual env
$ python3 -m venv venv
$ source venv/bin/activate

# Install Python requirements
$ pip install -e .

The code is multi-platform and is tested on both Windows and Linux. The tool uses latest version of Chrome Web Driver. I have placed the webdriver along with the code but if that version doesn't work then replace the chrome web driver with the latest one according to your platform and your Google Chrome version.

How to Run

Fill your Facebook credentials into credentials.yaml
Edit the input.txt file and add many profiles links as you want in the following format with each link on a new line:

Make sure the link only contains the username or id number at the end and not any other stuff. Make sure its in the format mentioned above.

Note: There are two modes to download Friends Profile Pics and the user's Photos: Large Size and Small Size. You can change the following variables in scraper/scraper.py. By default they are set to Small Sized Pics because its really quick while Large Size Mode takes time depending on the number of pictures to download

# whether to download the full image or its thumbnail (small size)
# if small size is True then it will be very quick else if its False then it will open each photo to download it
# and it will take much more time
friends_small_size = True
photos_small_size = True

Run the ultimate-facebook-scraper command ! 🚀

Citation 📚

If you use this tool for your research, then kindly cite it. Click the above badge for more information regarding the complete citation for this tool and diffferent citation formats like IEEE, APA etc.

Important Message ⚠️

This tool is for research purposes only. Hence, the developers of this tool won't be responsible for any misuse of data collected using this tool. Used by many researchers and open source intelligence (OSINT) analysts.

This tool will not works if your account was set up with 2FA. You must disable it before using.