We had a severe decline in the population during the Black Death - as much as 50% in some places.
It was great for the survivors. It ended the feudal system, wages rose dramatically. People inherited a lot of property from distant relatives. Others were able to buy a lot of land cheaply as estate owners and their heirs passed away.
RE: Can Capitalism Survive Declining Birth Rates?