I don't have any problem with Afghans and Iraq refugees. As long as they aren't Sunni, sh*tte, Wahhabi (the Saudi kind) branches of Islam. Ahmadiyya sect Muslims would be on a case by case basis, since they aren't holy enough for the rest of Muslims. They generally reject forced conversion and war against the west. They aren't considered Muslim by most Muslims and get persecuted for their more peaceful ways. The Saudi's don't allow them to go to Mecca for hajj, as they consider them non-Muslim.
The real refugees are simply the non-Muslims for the most part. These are the people getting killed, and we should let them flee. However we do have to make sure the violent Muslims don't slip in the process.