This repository contains a thesis (and its latex source) describing two electrical load forecasting systems, utilizing the transformer attention-based neural network model (Attention is All You Need) and a more standard sequence to sequence neural network. This thesis was submitted as part of a Bachelor of Engineering with Honours at the University of Tasmania, 2018.