Move exit handlers setting at the beginning of main (#3498)

Move exit handlers setting at the beginning of main (#3498) #2040