The social media platform X (formerly Twitter) currently provides a creator revenue-sharing program for eligible users, an initiative that has inadvertently incentivized a multitude of engagement-farming accounts to leverage artificial intelligence to forge various videos, thereby captivating attention and amassing views. The rampant proliferation of such fabricated information has consequently inflicted myriad tribulations upon the platform.
Hence, X had previously mandated that any dissemination of AI-generated content must be explicitly labeled as such. Violations culminating in user reports could precipitate the mandated deletion of the offending posts, while recurrent transgressions might invite permanent account suspension.
Presently, the ongoing military operations initiated by the United States and Israel against Iran dominate public discourse. Consequently, an abundance of engagement-farming accounts has resorted to disseminating AI-forged videos depicting wartime hostilities. In direct response, X has revised its creator monetization program to aggressively curtail the spread of these counterfeit war chronicles.
Specifically, should an account broadcast AI-fabricated videos concerning warfare—not exclusively confined to the current Middle Eastern theater—and subsequently be detected by the platform or reported by users, the offending account shall endure a 90-day suspension from the creator revenue-sharing program.
Upon this suspension, the capability to accrue financial dividends through posting is entirely severed. Through this punitive measure, X endeavors to mercilessly strike down the deceptive practices of these accounts. Naturally, unrelenting violations may result in permanent excommunication from the monetization program.
As for the methodology of detecting such content, it scarcely presents a formidable challenge, courtesy of the Community Notes feature. Whenever a video achieves substantial viral velocity, vigilant users inevitably scrutinize its authenticity. Once flagged and reported by the community, the platform’s investigative protocols are instantaneously triggered.
Furthermore, videos inherently bearing AI watermarks may also face detection. The Head of Product at X noted that a predominant fraction of these newly circulated, forged videos are synthesized via OpenAI’s Sora 2. While Sora 2 naturally embeds an AI watermark, this relies entirely on the premise that the publisher has not maliciously scrubbed it prior to upload—thus rendering watermark-based detection inherently fallible, given the profound ease of its erasure.
Support Our Threat Intelligence
If you find our CVE report and cybersecurity news helpful, consider supporting our work.