Remember that the game is only one part of A Day. Captains are enshrined at Denny Chimes. Other athletic teams have games. Football alumni have a flag game. Sure, you could do these things on another day, but having the crowd there ensures good attendance.
BTW, has A Day ever been at Legion Field or anyplace other than BDS?