When Visual Style Gets In The Way