One gigabyte of Wikipedia losslessly compressed to 105.39MB with self-learning AI transformer model

3 hours ago 3
Nvidia Blackwell GPU package on a black background (Image credit: Nvidia)

Follow us

Add us as a preferred source on Google

Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.

We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models.November 19, 2026

Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.

Shane Downing is a Contributing Writer for Tom’s Hardware, covering consumer storage, PC hardware, and AI.

Read Entire Article