On numbers and meaning

How do you know when AI is powerful enough to be dangerous? Regulators try to do the math | AP News

https://apnews.com/article/measuring-ai-safety-risk-flops-california-1047-6d556799683b02aa192b821462422aa2

“Ten to the 26th flops,” said venture capitalist Ben Horowitz on a podcast this summer. “Well, what if that’s the size of the model you need to, like, cure cancer?”

“This is all happening very fast,” Aguirre said. “I think there’s a legitimate criticism that these thresholds are not capturing exactly what we want them to capture. But I think it’s a poor argument to go from that to, ‘Well, we just shouldn’t do anything and just cross our fingers and hope for the best.’”

it’s so crazy. If you imagine the mind of a MAIS , modern AI System to be made up of a cloud of floating point numbers. Does it matter if they truncate? The mirror has no face. It cannot affirm itself. Yet it affirms as premise. It’s kind of like running after cows for food. It’s a necessity, yet it’s meaningless, like cancer: