Reddit Posts Extractor

How to get every posts out of one or many subreddits

Share:  
Table of Contents

Scrape Reddit and extract every posts out of one or many subreddits with this Reddit scraper

How to scrape Reddit is a pretty common question on the web since Reddit is a huge - to say the least - source of content. Reddit is kind enough to provide API points for extracting the latest 1000 posts of a subreddit. But most people don't know how to build their own scraper or connect to API endpoints.

For that reason we built this Reddit Posts Extractor tool that will allow anyone to scrape every posts from one or many sub-Reddits.

This data can be extremely useful for monitoring trending topics or curating content for your Twitter feed or your Newsletter.

Use-cases are endless but one thing is for sure: This is the easiest way to scrape a list of posts from many Reddit subreddits. Enjoy!


1. Create your account.

Free trial for 14 days. Then switch to a Free plan or become a customer.

SIGN UP

* no credit card required

2. Add this automation to your account.

3. Click on Configure me!

You'll now see the 3 configuration dots blinking. Click on them.

4. Specify the subreddits you want to scrape.

Create a spreadsheet on Google Spreadsheet.

Fill it with Subreddits URLs. One URL per row, all in column A.

Make this spreadsheet public so Phantombuster can access it.

Paste the spreadsheet's URL to Phantombuster.

Start your automation!

You're all set. Just click "launch" to get your automation started!

Set this automation on repeat

Once your automation's configuration is ready, you can schedule repetitive launches. This will allow you to avoid rate limits, scrape more data and get your automated workflows to spread over days, weeks, even months.

To do so, go to your dashboard and look for your automation's “Settings” button.

Then, select a frequency:

And Save those new settings at the bottom of the page.

Output

This API will output CSV and/or JSON containing the following fields:

  • permalink (Reddit post URL)
  • title (Post title)
  • author (Post author)
  • score (Post score)
  • commentCount (Number of comments)
  • silverCount (Number of Silver gildings)
  • goldCount (Number of Gold gildings)
  • platinumCount (Number of Platinum gildings)
  • postId (ID of the post)
  • createdDate (Post date)

Share this API

Your friends & colleagues need to know about this!