The girls staying away thing is just a reference to the fact that Japanese seem to find people over 6ft or so terribly scary in general.
The fight story was part of the best man’s speech at the wedding but none of the details are really exciting enough to be worth going over here.