Sea urchin holes

The rocks were covered with hundreds if perfectly round holes, that
were previously homes to sea urchins. I wonder what made them leave?