twint

Twint is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles without using Twitter’s API.

Twint utilizes Twitter’s search operators to let you scrape Tweets from specific users, scrape Tweets relating to certain topics, hashtags & trends, or sort out sensitive information from Tweets like e-mail and phone numbers. I find this very useful, and you can get really creative with it too.

Twint also makes special queries to Twitter allowing you to also scrape a Twitter user’s followers, Tweets a user has liked, and who they follow without any authentication, API, Selenium, or browser emulation.

Benefits

Some of the benefits of using Tweep vs Twitter API:

• Can fetch almost all Tweets (Twitter API limits to last 3200 Tweets only)
• Fast initial setup
• Can be used anonymously and without Twitter sign up
• No rate limitations

Install

git clone https://github.com/haccer/twint.git
pip install -r requirements.txt

Basic Examples and Combos.

• python3 twint.py -u username – Scrape all the Tweets from user‘s timeline.
• python3 twint.py -u username -s pineapple – Scrape all Tweets from the user‘s timeline containing pineapple.
• python3 twint.py -s pineapple – Collect every Tweet containing pineapple from everyone’s Tweets.
• python3 twint.py -u username --year 2014 – Collect Tweets that were tweeted before 2014.
• python3 twint.py -u username --since 2015-12-20 – Collect Tweets that were tweeted since 2015-12-20.
• python3 twint.py -u username -o file.txt – Scrape Tweets and save to file.txt.
• python3 twint.py -u username -o file.csv --csv – Scrape Tweets and save as a csv file.
• python3 twint.py -u username --fruit – Show Tweets with low-hanging fruit.
• python3 twint.py -s "Donald Trump" --verified --users – List verified users that Tweet about Donald Trump.
• python3 twint.py -g="48.880048,2.385939,1km" -o file.csv --csv – Scrape Tweets from a radius of 1km around a place in Paris and export them to a csv file.
• python3 twint.py -u username -es localhost:9200 – Output Tweets to Elasticsearch
• python3 twint.py -u username -o file.json --json – Scrape Tweets and save as a json file.
• python3 twint.py -u username --database tweets.db – Save Tweets to an SQLite database.
• python3 twint.py -u username --followers – Scrape a Twitter user’s followers.
• python3 twint.py -u username --following – Scrape who a Twitter user follows.
• python3 twint.py -u username --favorites – Collect all the Tweets a user has favorited.

Graph Visualization

Graph details are also located on the wiki.

Copyright (c) 2018 Cody Zacharias

Source: https://github.com/twintproject/