That seem to be FIFA's stance. FIFA president Sepp Blatter ripped the officiating in recent matches, especially Russian referee Valentin Ivanov. Ivanov gave out a World Cup tying record of 16 yellow cards and then a record-setting 4 red cards.
"I think there could have been a yellow card for the referee," Blatter said.
English official Graham Poll is in hot water for handing out three yellow cards to one Croatian player as he apparently was unclear on how to count that high.