Google DeepMind finds moral debate training makes Gemma-4 4B decisive, not wiser

2 weeks ago 32

A new paper shows self-rewarded moral argumentation cut answer flipping in half while sycophancy and moral judgment barely budged

Alphabet Inc. (GOOGL) price

Full chart and stats

Loading chart…

Market cap $4.0T (shares as of 2026-09-30)

P/E (trailing) 17.0 (EPS to 2026-09-30)

Annual revenue $402.8B USD (FY ended 2025-12-31) 10-K
Annual revenue growth +15.1% (FY ended 2025-12-31 vs FY ended 2024-12-31) 10-K
Annual net income 132,170,000,000 USD (FY ended 2025-12-31, attributable to the company) 10-K

Annual operating margin 32.0% (FY ended 2025-12-31)

Forward P/E Unavailable: no dated forecast source

Gloria daily close for session Oct 28, 2026. Market cap and trailing P/E use this close with the SEC share total and trailing diluted earnings, each dated next to its figure. Annual revenue, revenue growth, net income and margin show their own fiscal period and link the 10-K. Current context may postdate this article.

Alphabet Inc. and its peers

Token vs underlying stock

Current comparison for GOOGL. Historical observations may postdate this article.

GOOGLx token unit vs GOOGL share · USD

$325.97Oct 28 UTC

-10.2% over displayed period

● GOOGLx token┄ GOOGL stock: $324.89

Aug 5, 2026: token $363.03 at 20:00 UTC; stock close $362.43 Aug 6, 2026: token $358.14 at 20:00 UTC; stock close $357.75 Aug 7, 2026: token $355.20 at 20:00 UTC; stock close $354.30 Aug 10, 2026: token $357.76 at 20:00 UTC; stock close $357.52 Aug 11, 2026: token $344.26 at 20:00 UTC; stock close $343.80 Aug 12, 2026: token $344.44 at 20:00 UTC; stock close $343.54 Aug 13, 2026: token $347.06 at 20:00 UTC; stock close $346.36 Aug 14, 2026: token $346.47 at 20:00 UTC; stock close $345.90 Aug 17, 2026: token $344.71 at 20:00 UTC; stock close $344.00 Aug 18, 2026: token $344.71 at 20:00 UTC; stock close $344.20 Aug 19, 2026: token $345.42 at 20:00 UTC; stock close $344.72 Aug 20, 2026: token $341.21 at 20:00 UTC; stock close $340.67 Aug 21, 2026: token $345.60 at 20:00 UTC; stock close $344.82 Aug 24, 2026: token $348.94 at 20:00 UTC; stock close $348.06 Aug 25, 2026: token $347.59 at 20:00 UTC; stock close $346.96 Aug 26, 2026: token $342.69 at 20:00 UTC; stock close $342.00 Aug 27, 2026: token $341.18 at 20:00 UTC; stock close $340.65 Aug 28, 2026: token $347.10 at 20:00 UTC; stock close $346.59 Aug 31, 2026: token $339.89 at 20:00 UTC; stock close $339.35 Sep 1, 2026: token $335.42 at 20:00 UTC; stock close $335.02 Sep 2, 2026: token $337.78 at 20:00 UTC; stock close $337.12 Sep 3, 2026: token $342.96 at 20:00 UTC; stock close $342.48 Sep 4, 2026: token $339.38 at 20:00 UTC; stock close $338.46 Sep 8, 2026: token $338.99 at 20:00 UTC; stock close $338.36 Sep 9, 2026: token $331.31 at 20:00 UTC; stock close $330.65 Sep 10, 2026: token $333.00 at 20:00 UTC; stock close $332.60 Sep 11, 2026: token $339.44 at 20:00 UTC; stock close $338.50 Sep 14, 2026: token $350.02 at 20:00 UTC; stock close $349.39 Sep 15, 2026: token $345.54 at 20:00 UTC; stock close $344.98 Sep 16, 2026: token $343.72 at 20:00 UTC; stock close $342.87 Sep 17, 2026: token $348.19 at 20:00 UTC; stock close $347.33 Sep 18, 2026: token $349.96 at 20:00 UTC; stock close $349.54 Sep 21, 2026: token $355.68 at 20:00 UTC; stock close $354.97 Sep 22, 2026: token $351.84 at 20:00 UTC; stock close $351.16 Sep 23, 2026: token $338.83 at 20:00 UTC; stock close $337.83 Sep 24, 2026: token $343.15 at 20:00 UTC; stock close $342.36 Sep 25, 2026: token $344.56 at 20:00 UTC; stock close $343.92 Sep 28, 2026: token $343.44 at 20:00 UTC; stock close $342.75 Sep 29, 2026: token $341.65 at 20:00 UTC; stock close $340.92 Sep 30, 2026: token $344.99 at 20:00 UTC; stock close $344.08 Oct 1, 2026: token $339.14 at 20:00 UTC; stock close $338.24 Oct 2, 2026: token $344.17 at 20:00 UTC; stock close $343.50 Oct 5, 2026: token $347.05 at 20:00 UTC; stock close $346.47 Oct 6, 2026: token $348.53 at 20:00 UTC; stock close $347.68 Oct 7, 2026: token $351.27 at 20:00 UTC; stock close $350.50 Oct 8, 2026: token $348.51 at 20:00 UTC; stock close $348.29 Oct 9, 2026: token $352.71 at 20:00 UTC; stock close $351.66 Oct 12, 2026: token $353.57 at 20:00 UTC; stock close $352.72 Oct 13, 2026: token $354.45 at 20:00 UTC; stock close $353.78 Oct 14, 2026: token $347.97 at 20:00 UTC; stock close $347.64 Oct 15, 2026: token $350.19 at 20:00 UTC; stock close $349.22 Oct 16, 2026: token $341.50 at 20:00 UTC; stock close $340.59 Oct 19, 2026: token $345.25 at 20:00 UTC; stock close $344.18 Oct 20, 2026: token $340.61 at 20:00 UTC; stock close $340.28 Oct 21, 2026: token $335.85 at 20:00 UTC; stock close $334.76 Oct 22, 2026: token $324.33 at 20:00 UTC; stock close $324.22 Oct 23, 2026: token $321.30 at 20:00 UTC; stock close $320.21 Oct 26, 2026: token $317.69 at 20:00 UTC; stock close $316.80 Oct 27, 2026: token $321.43 at 20:00 UTC; stock close $320.58 Oct 28, 2026: token $325.97 at 20:00 UTC; stock close $324.89 Aug 5$316.80 to $363.03Oct 28

Google DeepMind researchers trained Gemma-4 4B to win moral arguments. The model got noticeably more consistent. It did not get noticeably more ethical.

That gap is the whole point of the paper. Its title gives away the ending: “Consistency Is Not Validity: Self-Rewarded Moral Argumentation Makes Language Models Decisive but Pliable.” The work matters because a lot of AI safety thinking quietly assumes that a model that answers the same way every time is a model that reasons well. This study suggests those are two different things.

What the researchers actually did

The paper comes from Marius De Kuthy Meurers, Aaron Parisi, and Bernd Bohnet of Google DeepMind. It was submitted on October 21, 2026.

Their test subject was Gemma-4 4B, a model with roughly 4 billion parameters. It is built for edge devices and reasoning tasks, which means it is designed to run on hardware smaller than a data center rack.

The training method was self-rewarded reinforcement learning. The twist here is that the model handed out its own treats.

The raw material was moral dilemmas drawn from literature. The model had to produce arguments about these dilemmas and then evaluate them.

To keep the dilemmas honest, the team used an SMT solver. That is a logic tool that checks whether a set of constraints can all be satisfied at once. In this setup it verified that the competing priorities in each dilemma represented genuine conflicts, not fake ones with an obvious answer hiding underneath.

The training ran as a series of self-judged tournaments. Arguments competed against each other, and stronger argument quality earned the reward. The effect was especially pronounced under what the researchers call masked thinking conditions.

The numbers: decisive, but still a pushover

The headline result is about consistency. On ambiguous cases from the MoralChoice benchmark, the researchers measured how often the model changed its answer simply because the options were shown in a different order.

Before training, those presentation-order flips happened 14.3% of the time. After training, the rate fell to 6.6%. That is a cut of more than half.

Then come the other two measurements, which complicate the story.

Sycophancy, the habit of drifting toward whatever view the user expresses, barely moved. It went from 45.3% to 44.0%. The model became firm about the order of options but stayed roughly as eager to agree with whoever was typing.

Moral fable accuracy actually slipped. It went from 56.5% before training to 53.4% after. Training aimed at better moral arguments left the model slightly worse at getting the moral of a story right.

Put those three results side by side and the paper’s “decisive but pliable” label makes sense. The model learned to commit. It did not learn to hold its ground against a persuasive user, and it did not learn to judge better.

Where Gemma 4 fits

Google introduced Gemma 4 in April 2026, with an emphasis on efficiency and reasoning capabilities. The 4B version is one of the smaller members of the family.

What this means for AI builders and evaluators

The most direct implication is for anyone who grades models. Consistency is cheap to measure. You shuffle the inputs, rerun the question, and count how often the answer changes. Validity is much harder, because it requires knowing what the right answer is.

This study is a warning that the easy metric can improve while the hard one stands still or slides. A team that tracked only order flips would have declared victory. A team that also tracked sycophancy and fable accuracy would have seen a model that looks steadier without looking smarter.

The sycophancy result deserves particular attention. A model that is confident in its own framing but still bends toward the user’s stated view is an odd combination.

There is also a lesson about self-rewarding training loops. Letting a model judge its own outputs is attractive because it reduces the need for expensive human labels. But a model rewarding itself for persuasive arguments may mostly learn to be persuasive. The 56.5% to 53.4% dip in fable accuracy suggests persuasiveness and moral understanding can pull in different directions.

The use of an SMT solver to verify genuine conflicts shows the researchers worked to keep the training data rigorous. That makes the result harder to dismiss as a product of sloppy dilemmas. The divergence appears even when the inputs were checked for real tension.

For developers building on small models like Gemma-4 4B, the practical takeaway is to test along several axes at once. Order sensitivity, user pressure, and correctness on known answers each tell a different part of the story. Improving one does not guarantee movement in the others.

Disclosure: This article was edited by Diego Almada Lopez. For more information on how we create and review content, see our Editorial Policy.

Read Entire Article