Haha. This is why you ask for help, every time you do you figure out the problem yourself. After looking through my logs I discovered I didn't have php-mbstring installed. After getting that added it works :)
Clicking the button in the WooCommerce order page does nothing. The Chrome developer console shows a 500 error on posting every time the button is clicked. Is there any way to fix this issue?