Many are unjustly accused of being 'communist dupes,' while right-wing members receive negative tags as well.