NeuralCompression: A machine learning approach to compress high frequency measurements in smart grid

Abstract The smart grid features frequent communication of measurements collected at consuming and distributing nodes to other agents in the grid. While this increases grid visibility and improves situation awareness, the sheer volume of such data generated from the geographically vast grid will result in overloading of the communication infrastructure. In this regard, compressing data at the source and communicating compressed measurements has been explored in the literature. However, such techniques rely on the presence of a structure in data that is exploited for compression. In this article we propose the use of Autoencoder for data compression that extracts an appropriate structure from data that then allows for compression. The proposed approach also incorporates nonlinear transformations in the compression mechanism which is likely to improve the compression ratio for the same reconstruction accuracy. The proposed method is applied on four publicly available datasets and results show that the Autoencoder has merit over state-of-the-art Compressive Sensing for high compression ratios. Generalization of Autoencoder models to datasets from different geographical locations is also studied as a distinct feature of the proposed method. The generalizability of models is also improved with transfer learning by adapting pre-trained models to the idiosyncrasies of target dataset.