Schmidtt's examine(pdf) seems to present a relatively regular decline from some time of European Call till around the beginning with the twentieth century (at which stage their population started increasing all over again). The sole bit in there that actually sticks out like a sore thumb was in 1804, when it seems nearly half the remaining populace