Skip to content

About

Datascraper that is currently adult focused - Updated regularly

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

4.3k stars

Watchers

176 watching

Forks

Latest commit

 

History

1,220 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

UltimaScraper

Buy Me a Coffee Proxies by Webshare

Your creator archive, on autopilot. UltimaScraper saves the posts, messages, stories and media from the creators you follow on OnlyFans, Fansly and LoyalFans, and gives you a beautiful dashboard to run it all from your browser.

The UltimaScraper dashboard

Jobs
⚡ Jobs: the queue and its history
Statistics
📊 Statistics: how your archive grows
Users
👥 Users: creators and their archives
Setup wizard
🧙 Setup wizard: up and running in a few clicks

Screenshots use made-up demo data.

✨ Features

  • 🖥️ Everything in your browser. Queue jobs, browse your library and manage accounts from one dashboard. No command line needed.
  • 📥 Grab it all. Timeline and archived posts, stories and highlights, messages with their attachments, and recorded streams.
  • ⚡ Fast and parallel. Workers download many creators at once, and new work slots in the moment a download finishes.
  • 🔁 Pick up where you left off. Failed items retry with one click, and a crashed worker's tasks go straight back in the queue.
  • 🖼️ A library you'll actually use. Search captions and messages, filter by creator, type or date, and preview photos, videos and audio right in the page.
  • 📊 See your archive grow. Charts of new accounts, posting activity and busiest hours, days and months, per site.
  • 📡 Live dashboard. Watch jobs, workers, throughput and disk space update in real time.
  • 🧙 Guided setup. A wizard installs everything on this machine, or on another one over SSH, and checks it as it goes.
  • 🌐 Grow to many machines. Add more servers and workers whenever you like, run them as one cluster, and invite other dashboards to share it.
  • 💾 Storage aware. Spread your archive over several drives, with warnings before one fills up.
  • 🔔 Webhooks and plugins. Get notified when things happen, and extend UltimaScraper with plugins.
  • 🔐 Private by design. It runs on your own hardware, protects the dashboard with a password, and keeps saved logins encrypted.

🚀 Quick start

You need Docker with Compose.

git clone https://github.com/UltimaHoarder/UltimaScraper.git
cd UltimaScraper
cp .env.example .env

Open .env and set POSTGRES_PASSWORD and REDIS_PASSWORD to long random values (openssl rand -hex 24 makes a good one). Then start it:

docker compose up -d

🎉 Open http://localhost:21120, choose a password, and the setup wizard takes it from there. If you open it from another device, enter the setup code that docker compose logs webui prints.

Important

UltimaScraper creates an encryption key on first start. Back it up: your saved logins can't be read without it. The Docker guide shows where it lives.

📚 Learn more

The full documentation is at ultimahoarder.github.io/UltimaScraper.

⚖️ Use responsibly

Only archive content you have legitimate access to, and respect creators and each site's terms. You are responsible for how you use UltimaScraper.

☕ Support

If you find UltimaScraper helpful, consider supporting the project:

Buy Me A Coffee

🌐 Need proxies? UltimaScraper can spread its work over proxies from the Network page. Sign up for Webshare through our affiliate link and you'll get 10 free proxies to see how much they help. It supports the project at no extra cost to you.

What I use: I've personally scraped 500 million public OnlyFans profiles in two to three months with UltimaScraper's Mass Profile Scraper (Tools → Mass Profile Scraper) and this Webshare setup, for around $30:

  • Proxy server: Shared
  • 250 proxies
  • 5,000 GB bandwidth
  • High concurrency

Proxies by Webshare

📄 License

UltimaScraper is free software, released under the GNU Affero General Public License v3.0 or later. If you run a modified version as a service for others, you must offer them its source code. Found a security issue? See SECURITY.md.

About

Datascraper that is currently adult focused - Updated regularly

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

4.3k stars

Watchers

176 watching

Forks

Releases

Packages

Used by

Contributors

Languages