Cities like
Merv or
Mohenjo-daro have declined 100% percent from their peaks, when they were among the largest cities in the world. This is not rare.
As far as I know, no city in history has seen a bigger decline faster than Detroit, which in about six decades lost more than half of its population.