Meta paper shows watermarks can expose distilled AI models

2 weeks ago 32

A new detection method called WM-Basin flags student models trained on watermarked outputs far more often than token counting does

Meta Platforms Inc. (META) price

Full chart and stats

Loading chart…

Market cap $1.6T (all share classes as of 2026-10-16) cover page

P/E (trailing) 21.3 (EPS to 2026-09-30)

Annual revenue $201.0B USD (FY ended 2025-12-31) 10-K
Annual revenue growth +22.2% (FY ended 2025-12-31 vs FY ended 2024-12-31) 10-K
Annual net income 60,458,000,000 USD (FY ended 2025-12-31, attributable to the company) 10-K

Annual operating margin 41.4% (FY ended 2025-12-31)

Forward P/E Unavailable: no dated forecast source

Gloria daily close for session Oct 29, 2026. Market cap and trailing P/E use this close with the SEC share total and trailing diluted earnings, each dated next to its figure. Annual revenue, revenue growth, net income and margin show their own fiscal period and link the 10-K. Current context may postdate this article.

Meta Platforms Inc. and its peers

Token vs underlying stock

Current comparison for META. Historical observations may postdate this article.

METAx token unit vs META share · USD

$626.37Oct 29 UTC

+6.2% over displayed period

● METAx token┄ META stock: $624.52

Aug 6, 2026: token $589.91 at 20:00 UTC; stock close $589.90 Aug 7, 2026: token $592.96 at 20:00 UTC; stock close $592.10 Aug 10, 2026: token $595.64 at 20:00 UTC; stock close $594.92 Aug 11, 2026: token $600.42 at 20:00 UTC; stock close $599.12 Aug 12, 2026: token $580.52 at 20:00 UTC; stock close $578.85 Aug 13, 2026: token $595.84 at 20:00 UTC; stock close $594.97 Aug 14, 2026: token $590.73 at 20:00 UTC; stock close $589.85 Aug 17, 2026: token $569.77 at 20:00 UTC; stock close $568.97 Aug 18, 2026: token $544.97 at 20:00 UTC; stock close $543.67 Aug 19, 2026: token $547.78 at 20:00 UTC; stock close $546.03 Aug 20, 2026: token $547.56 at 20:00 UTC; stock close $545.83 Aug 21, 2026: token $551.35 at 20:00 UTC; stock close $549.90 Aug 24, 2026: token $560.74 at 20:00 UTC; stock close $559.02 Aug 25, 2026: token $571.26 at 20:00 UTC; stock close $570.05 Aug 26, 2026: token $577.62 at 20:00 UTC; stock close $576.14 Aug 27, 2026: token $572.41 at 20:00 UTC; stock close $571.10 Aug 28, 2026: token $579.18 at 20:00 UTC; stock close $578.02 Aug 31, 2026: token $573.08 at 20:00 UTC; stock close $572.34 Sep 1, 2026: token $579.55 at 20:00 UTC; stock close $578.54 Sep 2, 2026: token $593.44 at 20:00 UTC; stock close $592.85 Sep 3, 2026: token $612.22 at 20:00 UTC; stock close $610.68 Sep 4, 2026: token $617.78 at 20:00 UTC; stock close $616.77 Sep 8, 2026: token $614.55 at 20:00 UTC; stock close $613.48 Sep 9, 2026: token $653.99 at 20:00 UTC; stock close $653.69 Sep 10, 2026: token $645.68 at 20:00 UTC; stock close $644.38 Sep 11, 2026: token $648.82 at 20:00 UTC; stock close $648.03 Sep 14, 2026: token $667.33 at 20:00 UTC; stock close $665.60 Sep 15, 2026: token $671.72 at 20:00 UTC; stock close $670.24 Sep 16, 2026: token $674.78 at 20:00 UTC; stock close $673.31 Sep 17, 2026: token $683.69 at 20:00 UTC; stock close $682.31 Sep 18, 2026: token $667.45 at 20:00 UTC; stock close $665.75 Sep 21, 2026: token $743.56 at 20:00 UTC; stock close $741.25 Sep 22, 2026: token $740.44 at 20:00 UTC; stock close $736.60 Sep 23, 2026: token $746.35 at 20:00 UTC; stock close $744.10 Sep 24, 2026: token $778.30 at 20:00 UTC; stock close $777.59 Sep 25, 2026: token $752.94 at 20:00 UTC; stock close $751.66 Sep 28, 2026: token $716.77 at 20:00 UTC; stock close $715.62 Sep 29, 2026: token $741.08 at 20:00 UTC; stock close $738.79 Sep 30, 2026: token $728.60 at 20:00 UTC; stock close $725.18 Oct 1, 2026: token $727.20 at 20:00 UTC; stock close $725.93 Oct 2, 2026: token $729.17 at 20:00 UTC; stock close $728.08 Oct 5, 2026: token $743.97 at 20:00 UTC; stock close $741.90 Oct 6, 2026: token $741.44 at 20:00 UTC; stock close $738.88 Oct 7, 2026: token $722.75 at 20:00 UTC; stock close $721.31 Oct 8, 2026: token $722.91 at 20:00 UTC; stock close $720.89 Oct 9, 2026: token $720.22 at 20:00 UTC; stock close $718.67 Oct 12, 2026: token $744.29 at 20:00 UTC; stock close $742.96 Oct 13, 2026: token $764.47 at 20:00 UTC; stock close $762.50 Oct 14, 2026: token $737.37 at 20:00 UTC; stock close $737.54 Oct 15, 2026: token $738.03 at 20:00 UTC; stock close $736.72 Oct 16, 2026: token $711.14 at 20:00 UTC; stock close $709.33 Oct 19, 2026: token $707.00 at 20:00 UTC; stock close $705.44 Oct 20, 2026: token $695.35 at 20:00 UTC; stock close $694.25 Oct 21, 2026: token $700.90 at 20:00 UTC; stock close $697.52 Oct 22, 2026: token $650.24 at 20:00 UTC; stock close $648.85 Oct 23, 2026: token $643.78 at 20:00 UTC; stock close $642.62 Oct 26, 2026: token $631.24 at 20:00 UTC; stock close $630.56 Oct 27, 2026: token $621.46 at 20:00 UTC; stock close $620.19 Oct 28, 2026: token $612.89 at 20:00 UTC; stock close $612.49 Oct 29, 2026: token $626.37 at 20:00 UTC; stock close $624.52 Aug 6$543.67 to $778.30Oct 29

Copying a large language model used to require stealing its weights. Now you can arguably do it by asking it a lot of questions and training a smaller model on the answers.

Researchers at Meta think they have a better way to catch that. A paper from Meta’s FAIR and Superintelligence Labs introduces WM-Basin, a black-box technique that identifies models distilled from a watermarked teacher. In testing, it beat the prior state-of-the-art token-level detector by a wide margin.

What the paper actually found

The study, titled “Watermark Basins: Black-Box Detection of Distilled LLMs,” was published on October 27, 2026 under arXiv:2610.37266. Its focus is a specific scenario: someone queries a watermarked model through an API, collects the outputs, and trains a “student” model on them.

The headline result is a 79% true-positive rate at a false-positive rate of just 0.1%, using n-gram=1. The previous best black-box token-level detector managed a true-positive rate of only 29% under the same conditions.

According to the authors, the gap between the two methods widens further at stricter detection thresholds and with larger n-gram windows.

The evaluation was not small. The team tested 1,200 student models ranging from 135 million to 8.2 billion parameters. These students were trained on mathematical reasoning traces from OpenR1-Math, across six student architecture families, multiple teachers, and several watermarking schemes.

How WM-Basin works

WM-Basin feeds the suspect model’s generated text into a fixed, clean probe model and converts that text into gradient representations. Put simply, it asks how the text would push the probe model’s parameters if the probe were trained on it.

From there, the method separates ordinary fine-tuning directions from alignment with what the authors call a key-specific “watermark basin” in parameter space. The watermark leaves a directional signature, and WM-Basin looks for that direction rather than for individual telltale words.

A crucial practical detail: the tool only needs text outputs from the suspect model via API. It does not require access to weights or logits.

Where the signal holds, and where it breaks

The researchers report that the detection signal survives several common post-distillation modifications. These include quantization, which compresses a model to run cheaper; pruning, which strips out parameters; and reinforcement learning.

WM-Basin also proves more reliable when token-level signals fade, such as during low-temperature sampling.

The paper is candid about its limits, though. Extensive fine-tuning on clean data can degrade the signal. The authors flag continued supervised fine-tuning on unwatermarked data and paraphrasing the teacher’s traces as potential evasion vectors.

What this means for AI developers

The 0.1% false-positive rate is arguably the more important number for that use case. Any legal or contractual claim built on watermark evidence will be scrutinized for wrongful accusations. A method that holds a low false-alarm rate while catching 79% of copies is far more defensible than one catching 29%.

The evaluation centered on mathematical reasoning traces, so performance on other kinds of content is an open question from the data presented. Real-world copiers may also combine several evasion tactics at once, including the paraphrasing and clean-data fine-tuning the authors themselves identified.

Disclosure: This article was edited by Diego Almada Lopez. For more information on how we create and review content, see our Editorial Policy.

Read Entire Article