Twitter Media Extractor

Collect all metadata from any Twitter medias

Share:  
Table of Contents

Extract every single piece of media content off a list of Twitter Profiles 🐦

Let's say you follow a few people whose Twitter are a goldmine of cool videos & images..
Or you might be interested in what your competitors are publishing.

Give us a list of these people and we will extract the URLs where each piece of content is hosted for you.
And everything about it at the precise moment: viewcounts, durations, description, etc.

What you do with this content is up to you.

What will you need? ⚙️

  • "Twitter account or Spreadsheet URL": Choose a sepcific twitter account like @phbuster or choose an open spreadsheet url
  • "Session Cookie auth_token": Your Twitter auth_token session cookie.

Which steps to follow?

1. Create an account on Phantombuster.com 💻

If you haven't already, create a FREE account on Phantombuster. Our service will browse the web for you. It’s a website automator which runs in the cloud. Once done we'll follow up.

2. Use this API on your account.👌

Now that you're connected to Phantombuster, Click on the following button (it will open a new tab).

3. Click on Configure me!

You'll now see the 3 configuration dots blinking. Click on them.

4. Aim a specific Twitter account or several at a time

In the 1st argument field "Twitter account or Spreadsheet URL" you have the choice to use this API for 1 twitter account at a time or several in one go.

  • One at a time: Just fill the form with a Twitter username, example: @phbuster

  • Several at a time: Paste the URL of a spreadsheet filled with Twitter username and/or Twitter accounts URLs on column A

5. Get your Twitter Session cookie

The Session Cookie you'll need to make this API work is called "auth_token",
Here's how you can get yours:

  • Using Chrome, go to your Twitter homepage and open the inspector
    → Right click anywhere on the page and select “Inspect”
    CMD+OPT+i on macOS
    or
    F12 or CTRL+MAJ+i on Windows

  • Locate the “Application” tab

  • Select “Cookies” > “https://www.twitter.com” on the left menu.

  • Locate the “auth_token” cookie.

  • Copy what’s under “Value” (Double click on it then Ctrl+C) and paste it into your script Argument)

// How to access your cookies with Edge, Firefox and Safari//

⚙️️Repetition setup ⚙️

Now that your API is ready, you should set up repetitive launches. That way, your scraping will be spread over days, weeks or even months. You can also specify the number of profiles to process per launch, or leave that field blank to process every profile from your list.

To do so, simply hit the “Settings” button to define when your API is launched:

Then, select a frequency:

Don't forget to click 💾 Save at the bottom of the page!

For example, 10 profiles processed per launch, 8 launches per day: you'll process a total of 80 profiles per day.

Click on Launch & Enjoy!

It’s done! All that is left to do is to click on "launch" to try your script!

More bots like this one will be added to Phantombuster,

stay tuned & check our API store!💗

#Output

This API will output CSV and/or JSON containing the following fields:

twitterPostUrl (Tweet URL)
tweetContent
query (Original query (most of the time the Twitter profile / Twitter handle))
pubImage (Tweet images URLs (if available))
mediaUrl (External media URL)
mediaDescription (Description of the external media)
duration (Video duration (if available in ms))
views (Video views (if available))
videoUrl (URL to download the video (if available))

Output

This API will output CSV and/or JSON containing the following fields:

  • twitterPostUrl (Tweet URL)
  • tweetContent
  • query (Original query (most of the time the Twitter profile / Twitter handle))
  • pubImage (Tweet images URLs (if available))
  • mediaUrl (External media URL)
  • mediaDescription (Description of the external media)
  • duration (Video duration (if available in ms))
  • views (Video views (if available))
  • videoUrl (URL to download the video (if available))

Share this API

Your friends & colleagues need to know about this!