The Art Project

Art is Life


What makes something interesting?

Driven by Compression Progress: Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

Imagine you are trying to remember a long list of numbers, like this: 1, 2, 3, 1, 2, 3, 1, 2, 3…

You could try to remember every single number on its own, which is hard. OR, you could just remember a simple rule: “It’s just 1, 2, 3 over and over again.”

That rule is a shortcut. In this paper, the author calls this “compression” . It means taking something big and complicated and squishing it down into a simple rule.

The paper says that your brain loves finding these shortcuts. But here is the secret:

  • Totally Random stuff is boring: If you stare at a TV screen with just static (snow), you can’t find any rules. Your brain gets bored because it can’t learn anything .
  • Totally Known stuff is boring: If you stare at a wall that is all one color, you know the rule instantly (“it’s all white”). Your brain gets bored because there is nothing new to learn .

The most fun thing in the world is the moment you figure out the trick. It’s that split second when you go from “I don’t understand” to “Aha! I see the pattern!” .

The paper calls this “Compression Progress” . It measures how fast you are learning a new rule.

Because your brain loves that “Aha!” feeling, you are naturally curious.

Being curious means you are constantly looking for things that are a little bit mysterious—not too easy, but not impossible. You want to find new data that you can turn into a new rule . This is why babies play with toys and why scientists do experiments. They are just trying to find new rules to make the world make sense .

The author says that almost everything cool humans do comes from this desire to find shortcuts:

  • Science: Scientists look at the confusing world (like apples falling) and try to find a short, simple rule to explain it (Gravity) .
  • Art: Artists create paintings or songs that have hidden patterns. When you look at them or listen, your brain enjoys the work of finding the pattern .
  • Jokes: A joke sets up a pattern and then breaks it in a funny way. You laugh because your brain quickly figures out the new connection .

The author wants to use this idea to make robots smarter.

Instead of programming a robot to do exactly one job (like “pick up the box”), he wants to program the robot to want to learn. He suggests giving the robot a “reward” (like a digital cookie) every time it figures out a new rule or pattern .

If the robot gets rewarded for learning, it will naturally explore the world, play with things, and get smarter all on its own, just like a child does .

Summary

  • Beauty is when something has a simple pattern .
  • Fun (Interestingness) is the process of finding that pattern .
  • We should build robots that chase that “fun” feeling so they learn by themselves .
Driven by Compression Progress