America's housing crisis has changed the tune of how people perceive affordable housing, according to a new survey.