An Immigration and Customs Enforcement (ICE) officer who pushed a woman to the ground in New York City on Thursday has been relieved of his duties while the Department of Homeland Security (DHS) conducts an investigation into the altercation, the agency announced Friday.