This is by design as hot-reload only effects classes derived from UCLASS types.
After making a change to an automation test function and triggering a hot reload, the changes are not reflected the next time the text is ran.
The text printed out after the hot reload has not been updated.
Hot reload updates minor code changes without having to restart the editor.
Head over to the existing Questions & Answers thread and let us know what's up.