Mr Nakatani is worried because Japanese are living longer, yet having fewer children. The result is a shrinking workforce which threatens economic growth.
In recognition, the government is thinking of loosening its restrictive immigration policy.
But any changes may come as a shock to a nation where registered foreigners make up just over 1% of its population.