From massaging Baseball-Reference's Play Index, I found 16 other visiting pitchers who made their big league debut as a starting pitcher since 1956. The Yankees are 8-8 in those games.
There are some great names on the list. Literally great names. Such as Beiker Graterol. Beiker never pitched again in the majors.
And there was Robinson Checo. At one point, the Boston Red Sox and Hiroshima Carp were involved in an international struggle to for the rights to sign Robinson Checo. And by the time his career was over, teams were trying to tell him the wrong address for their spring training camps so he wouldn't show up. (There's a possibility that this last part may not be entirely true.)
In 1996, the Angels had TWO pitchers debut at Yankee Stadium. And one was the famous Shad Williams. The other was Jason Dickson. He was an All-Star in 1997. Really, he was.