Scrape Reddit and extract every posts out of one or many subreddits with this Reddit scraper
How to scrape Reddit is a pretty common question on the web since Reddit is a huge - to say the least - source of content. Reddit is kind enough to provide API points for extracting the latest 1000 posts of a subreddit. But most people don't know how to build their own scraper or connect to API endpoints.
For that reason we built this Reddit Posts Extractor tool that will allow anyone to scrape every posts from one or many sub-Reddits.
This data can be extremely useful for monitoring trending topics or curating content for your Twitter feed or your Newsletter.
Use-cases are endless but one thing is for sure: This is the easiest way to scrape a list of posts from many Reddit subreddits. Enjoy!
Fill it with Subreddits URLs. One URL per row, all in column A.
Make this spreadsheet public so Phantombuster can access it.
Paste the spreadsheet's URL to Phantombuster.
Start your automation!
You're all set. Just click "launch" to get your automation started!
Set this automation on repeat
Once your automation's configuration is ready, you can schedule repetitive launches. This will allow you to avoid rate limits, scrape more data and get your automated workflows to spread over days, weeks, even months.
To do so, go to your dashboard and look for your automation's “Settings” button.
Then, select a frequency:
And Save those new settings at the bottom of the page.
This API will output CSV and/or JSON containing the following fields:
permalink (Reddit post URL)
title (Post title)
author (Post author)
score (Post score)
commentCount (Number of comments)
silverCount (Number of Silver gildings)
goldCount (Number of Gold gildings)
platinumCount (Number of Platinum gildings)
postId (ID of the post)
createdDate (Post date)
Share this API
Your friends & colleagues need to know about this!