Running systemctl status apache2.service gave me this:
● apache2.service - LSB: Apache2 web server
Loaded: loaded (/etc/init.d/apache2; bad; vendor preset: enabled)
Drop-In: /lib/systemd/system/apache2.service.d
└─apache2-systemd.conf
Active: inactive (dead) since Thu 2016-07-14 20:49:36 NZST; 2min 1s ago
Docs: man:systemd-sysv-generator(8)
Process: 9942 ExecStop=/etc/init.d/apache2 stop (code=exited, status=0/SUCCESS)
Process: 9212 ExecStart=/etc/init.d/apache2 start (code=exited, status=0/SUCCESS)
Jul 14 20:09:20 ubuntu-server systemd[1]: Starting LSB: Apache2 web server...
Jul 14 20:09:20 ubuntu-server apache2[9212]: * Starting Apache httpd web server apache2
Jul 14 20:09:20 ubuntu-server apache2[9212]: AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 127.0.1.1.
Jul 14 20:09:21 ubuntu-server apache2[9212]: *
Jul 14 20:09:21 ubuntu-server systemd[1]: Started LSB: Apache2 web server.
Jul 14 20:49:36 ubuntu-server apache2[9942]: * Stopping Apache httpd web server apache2
Jul 14 20:49:36 ubuntu-server apache2[9942
I moved SSLengine on up to the second line in the virtual host conf file and tried to restart apache. This time I got an error
AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 127.0.1.1. Set the 'ServerName' directive globally to suppress this message
[Thu Jul 14 20:49:36.783996 2016] [ssl:emerg] [pid 9230] AH02572: Failed to configure at least one certificate and key for *my domain.net.nz:443
[Thu Jul 14 20:49:36.784024 2016] [ssl:emerg] [pid 9230] SSL Library Error: error:140A80B1:SSL routines:SSL_CTX_check_private_key:no certificate assigned
[Thu Jul 14 20:49:36.784028 2016] [ssl:emerg] [pid 9230] AH02312: Fatal error initialising mod_ssl, exiting.
[Thu Jul 14 20:49:36.784030 2016] [:emerg] [pid 9230] AH00020: Configuration Failed, exiting
Not sure what to do now, looks like there no certificate or keys? or mod_ssl is broken? Not sure which?