To toggle the Quick Reply box that appears in each thread, open the admin panel and select Settings, then select Forum Settings on the following menu.
Scroll down to the Boards & Threads section. Change the setting for Quick Reply to your desired preference.