The problem was reported via UE Bug Submission. I was able to repro with their provided test project.
Result: BP_Actor cube has collision
Expected: BP_Actor cube does not have collision
There's no existing public thread on this issue, so head over to AnswerHub just mention UE-103064 in the post.