TOKYO - Deputy Prime Minister Taro Aso on Monday retracted his remark the previous day that could be taken as blaming swelling social security costs and other issues associated with Japan's aging population and declining birthrates on those who do not have children.