lingxue

lingxue

向着遥不可及的梦想,进发!
steam
youtube
keybase
twitter

(失效)如何在Twitter停用免费API后爬取Twitter内容

2023/09/16 The plugin has been taken down

2023/08/27 The old version API seems to be completely invalid and will not return any content

On July 9, 2023, the daily limit was lifted and the old version API was restored, but I don't know how long it will be available

Due to Twitter's update on restrictions, the API in the plugin has become invalid and the plugin cannot be used

I don't know when Twitter stopped using the free API. Previously, it was possible to apply for it to crawl content. There are many open-source crawlers on GitHub, but they require an API key. However, the new version API is expensive. Here is a browser crawler plugin that I have been using.

Disclaimer#

The content of this article is time-sensitive, and it is not guaranteed that this tutorial will still be available in the future.

This article only provides links to crawler plugins found online and their usage methods. It is strongly discouraged to use them for excessive crawling that consumes server resources.


Using crawlers without the official API violates Twitter's terms of use. We are not responsible for any consequences of using crawlers that result in account suspension or restrictions.


They will really suspend your account, and they won't unban you even if you appeal.


Screenshot 2023-06-24 204602

Chrome version

Firefox version

Usage#

After downloading, the default configuration does not need to be modified.

Screenshot 2023-06-24 210511

The above options save data by default. Select "disabled" to download the original image.

The option below is to specify the size at which to package and save as a zip file.

Open any page on Twitter that contains tweets.

Take a personal homepage as an example.

Screenshot 2023-06-24 210740
"media" downloads the author's Twitter content.
"like" downloads liked content.
The default interface looks like this.

Screenshot 2023-06-24 210905

Select "no media" to download only the text content. The content in parentheses below is for downloading retweeted content.

You don't need to worry about "dry run".

Conclusion#

The tutorial is over, let me remind you again

This article only provides links to crawler plugins found online and their usage methods. It is strongly discouraged to use them for excessive crawling that consumes server resources.


Using crawlers without the official API violates Twitter's terms of use. We are not responsible for any consequences of using crawlers that result in account suspension or restrictions.


They will really suspend your account, and they won't unban you even if you appeal.

載入中......
此文章數據所有權由區塊鏈加密技術和智能合約保障僅歸創作者所有。