Do I need to connect a conversion event to a test for it to be tracked?

No. Conversions are always tracked if the script is active, but only connected conversions to a test will appear in the results tab of a test and give conversion count for that specific test.