Twitter Profile Scraper

Collect every Public Infos out of a Twitter Profile

Share:  
Table of Contents

Extract every public info off a list of Twitter Profiles 🐦

Basically, this tool will extract every piece of public info out of a list of Twitter Profiles:
That means the name, description, handle, URL, accounts' age and numbers of Tweets, Followers, Followee & Likes.

Great if you're looking specific keywords or do stats based on those numbers.

What will you need? ⚙️

  • "Twitter account or Spreadsheet URL": Choose a sepcific twitter account like @phbuster or choose an open spreadsheet url
  • "Session Cookie auth_token": Your Twitter auth_token session cookie.

Which steps to follow?

1. Create an account on Phantombuster.com 💻

If you haven't already, create a FREE account on Phantombuster. Our service will browse the web for you. It’s a website automator which runs in the cloud. Once done we'll follow up.

2. Use this API on your account.👌

Now that you're connected to Phantombuster, Click on the following button (it will open a new tab).

3. Click on Configure me!

You'll now see the 3 configuration dots blinking. Click on them.

4. Aim a specific Twitter account or several at a time

In the 1st argument field "Twitter account or Spreadsheet URL" you have the choice to use this API for 1 twitter account at a time or several in one go.

  • One at a time: Just fill the form with a Twitter username, example: @phbuster

  • Several at a time: Paste the URL of a spreadsheet filled with Twitter username and/or Twitter accounts URLs on column A

5. Get your Twitter Session cookie

The Session Cookie you'll need to make this API work is called "auth_token",
Here's how you can get yours:

  • Using Chrome, go to your Twitter homepage and open the inspector
    → Right click anywhere on the page and select “Inspect”
    CMD+OPT+i on macOS
    or
    F12 or CTRL+MAJ+i on Windows

  • Locate the “Application” tab

  • Select “Cookies” > “https://www.twitter.com” on the left menu.

  • Locate the “auth_token” cookie.

  • Copy what’s under “Value” (Double click on it then Ctrl+C) and paste it into your script Argument)

// How to access your cookies with Edge, Firefox and Safari//

⚙️️Repetition setup ⚙️

Now that your API is ready, you should set up repetitive launches. That way, your scraping will be spread over days, weeks or even months. You can also specify the number of profiles to process per launch, or leave that field blank to process every profile from your list.

To do so, simply hit the “Settings” button to define when your API is launched:

Then, select a frequency:

Don't forget to click 💾 Save at the bottom of the page!

Click on Launch & Enjoy!

It’s done! All that is left to do is to click on "launch" to try your script!

More bots like this one will be added to Phantombuster,

stay tuned & check our API store!💗

#Output

This API will output CSV and/or JSON containing the following fields:

name
twitterProfile
handle
bio
location
website
joinDate
profilePicture
twitterId
alternativeProfileUrl
tweetsCount
followers
following
likes
birthday
query

Output

This API will output CSV and/or JSON containing the following fields:

  • twitterId
  • twitterProfile
  • alternativeProfileUrl (Twitter URL with the Twitter ID)
  • tweetsCount
  • followers (Followers count)
  • following (Following count)
  • likes
  • lists
  • name
  • handle
  • bio (Profile description)
  • location
  • website
  • joindDate (Twitter join date (if available))
  • birthday
  • followback

Share this API

Your friends & colleagues need to know about this!