Turns out I don't have IPv6 setup properly in my network so when apt attempts to connect to the Internet it tries IPv6 and fails.
To disable IPv6 on the ubuntu guest, add this to end of /etc/sysctl.conf and restart the guest:
sudo vim /etc/sysctl.conf:
net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.lo.disable_ipv6 = 1
This was a hacky work around mostly because although I desire to have IPv6 working, I desire to get this VM running more...
Thanks for reading, leave comments please.