Canada’s federal housing agency is worried affordability will deteriorate unless the country acts on supply challenges and other housing measures soon.