Back to News
NewsRegulation

Developer Releases Metadata for 5.6 Billion TikTok Videos on Hugging Face

A developer has released metadata for 5.6 billion TikTok videos on Hugging Face, raising legal concerns over data scraping practices.

Mercation Admin
October 6, 2026 1 min read
Developer Releases Metadata for 5.6 Billion TikTok Videos on Hugging Face

A Developer Shares Extensive TikTok Video Metadata

A developer known as hashfunction has released metadata for approximately 5.6 billion public TikTok videos on Hugging Face, covering content from July 2014 to October 2026. This dataset is available for free under a non-commercial license.

The metadata does not include video content but provides detailed insights such as captions, hashtags, sound IDs, and various engagement metrics like views and likes. The dataset, comprising 460 GB of data, is organized into monthly files, allowing users to analyze trends in TikTok video performance.

Despite its accessibility, the scraping of this data raises significant legal concerns. TikTok's terms of service explicitly prohibit automated data collection without permission. Hashfunction reportedly accessed TikTok's private mobile API using various techniques to bypass restrictions, compiling billions of data points without needing an account.

For commercial purposes, users are directed to datasocial.ai, where they can also purchase the source code of the data scraper for $1,699. The release of this dataset is significant for AI developers, who are increasingly interested in analyzing viral trends and sales potential within TikTok's ecosystem.

As of now, Hugging Face has recorded 1,181 downloads of the dataset. The ongoing legal landscape surrounding data scraping continues to evolve, with other platforms, like Reddit, also facing challenges regarding similar practices. While TikTok provides limited access to its data through approved research channels, this extensive dataset offers a more comprehensive resource for research and development in AI and social media analysis.