I had to disconnect the controller to report the bug and exit the sandbox to be able to write.
I launched the game normally, went to settings to configure the controller and everything went fine. Once I tried to fly anything the game went to about 0.2 fps (sometimes lower) making it impossible to do anything
@AndrewGarrison I haven't played with the controller since the bug report, I'll test it more this weekend