mirror of https://github.com/harismuneer/Ultimate-Facebook-Scraper synced 2024-11-12 23:17:16 +00:00

No description

Find a file

Haris Muneer 9e597fc414 📦 initialized facebook_url as a constant which can be modified easily later on		2019-10-08 22:39:23 +05:00
images	📦 added ufs logo	2019-10-07 21:52:42 +05:00
src	📦 initialized facebook_url as a constant which can be modified easily later on	2019-10-08 22:39:23 +05:00
.gitignore	Increased scroll count and set download friends photos to true	2019-06-30 13:34:38 +05:00
LICENSE	Update LICENSE	2018-08-23 02:14:33 +05:00
README.md	Update README.md	2019-10-08 00:49:15 +05:00
requirements.txt	added requirements.txt and did some refactoring	2019-06-29 17:48:26 +05:00

README.md

Ultimate Facebook Scraper (UFS)

Tooling that automates your social media interactions to collect posts, photos, videos, friends, followers and much more on Facebook.

Contributors

Developers from following organizations have so far joined the quest and contributed to UFS.

Features

A bot which scrapes almost everything about a facebook user's profile including

uploaded photos
tagged photos
videos
friends list and their profile photos (including Followers, Following, Work Friends, College Friends etc)
and all public posts/statuses available on the user's timeline.

The best thing about this scraper is that the data is scraped in an organized format so that it can be used for educational/research purpose by researchers. Moreover, this scraper does not use Facebook's Graph API so there are no rate limiting issues as such.

This tool is being used by thousands of developers weekly and we are pretty amazed at this response! Thankyou guys!🎉

For details regarding citing/referencing this tool for your research, check the 'Citation' section below.

Note

At its core, this tool uses xpaths of 'divs' to extract data from them. Since Facebook keeps on updating its site frequently and the 'divs' get changed. Consequently, we have to update the divs accordingly to correctly scrape the data.

The developers of this tool have devoted a lot of time and effort in developing and most importantly maintaining this tool for quite a lot time now. In order to keep this amazing tool alive, we need support from you geeks.

The code is pretty intuitive and easy to understand, so you can update the relevant xpaths in the code when you feel that you have tried many profiles and the data isn't being scraped for any of them (that's a hint that Facebook has updated their site) and generate a pull request. That's quite an easy thing to do. Thanks!

Sample

Screenshot

Usage

Installation

You will need to install latest version of Google Chrome. Moreover, you need to install selenium module as well using

pip install selenium

Run the code using Python 3. Also, the code is multi-platform and is tested on both Windows and Linux. The tool uses latest version of Chrome Web Driver. I have placed the webdriver along with the code but if that version doesn't work then replace the chrome web driver with the latest one.

How to Run

There's a file named "input.txt". You can add as many profiles as you want in the following format with each link on a new line:

https://www.facebook.com/andrew.ng.96
https://www.facebook.com/zuck

Make sure the link only contains the username or id number at the end and not any other stuff. Make sure its in the format mentioned above.

Note: There are two modes to download Friends Profile Pics and the user's Photos: Large Size and Small Size. You can change the following variables. By default they are set to Small Sized Pics because its really quick while Large Size Mode takes time depending on the number of pictures to download

# whether to download the full image or its thumbnail (small size)
# if small size is True then it will be very quick else if its False then it will open each photo to download it
# and it will take much more time
friends_small_size = True
photos_small_size = True

Citation

If you use this tool for your research, then kindly cite it. Click the above badge for more information regarding the complete citation for this tool and diffferent citation formats like IEEE, APA etc.

Important Message

This tool is for research purposes only. Hence, the developers of this tool won't be responsible for any misuse of data collected using this tool. Used by many researchers and open source intelligence (OSINT) analysts.