If we're going to have AIs that fully automate math, they not only need to solve existing problems. We also need to teach them how to recognize what problem to solve next. Human mathematicians have heuristic models that they use to decide what to work on, like, “There’s something important going on with the randomness of primes - let’s codify some patterns we see into specific conjectures.” But these aren’t currently precise enough for RL.