Seamless Travel creates Pawns for controllers that it shouldn't

Seamless Travel creates Pawns for controllers that shouldn't have a pawn created for them. This only happens is Seamless Travel is enabled.

Regression?: No
This occurs in 4.20

1. Download the attached project
2. Open the project
3. Play in Standalone
4. Run the console command ToggleDebugCamera
5. Run the console command ServerTravel MapTwo
   Result: There is an additional DefaultPawn spawned for the DebugCamera's controller. You can see it if you move.
   Expected: The only pawn in the level is the one you're controlling.