Secure and Privacy Driven Energy Data Analytics



renewable resources, machine learning, blockchain, data hubs, TOTEM, token for controlled computation, big data


Renewable resources are the main energy sources in a smart grid project. In order to ensure the smooth functioning of the smart grid, Information and Communication Technologies (ICT) need to be utilised efficiently. The objective of the SmartNEM project is to effectively utilise the technologies such as Machine Learning, Blockchain and Data Hubs for the aforementioned purpose and at the same time ensure a secured and privacy preserved solution. The data involved in smart grids require high security and it can be sensitive due to the household data which contains personal information. The individuals can be reluctant to share these data due to mistrust and to avoid unnecessary manipulation of the data they provide.

In order to overcome this it is necessary to build a trust based framework in which one could ensure data security and data privacy for the data owners to open up their data for data analysis. To achieves this we have proposed an architecture called TOTEM, Token for Controlled Computation, which integrates Blockchain and Big Data technologies. The conventional method of data analysis demands data be moved across the network to the location where the execution happens, however in the TOTEM architecture computational code will be moved to the data owner’s environment where the data is located. The TOTEM is a three layer architecture (Blockchain consortium layer, Storage layer and Computational layer) with two main actors, data provider and data consumer. Data provider provides metadata of the data they own and provide resources for the execution of data. Data consumers will get an opportunity to execute their own code on the data provider´s data. For a controlled computation and to avoid malicious functions an entity called totem is introduced in the architecture. The authorised users should meet the requirements of Totem value for executing their code on the requested data. For live monitoring of the totem value throughout the run time is achieved with the components such as totem manager and updaters in the computational layer. The code must follow a specific format and will undergo preliminary checks with the TOTEM defined SDK and smart contracts deployed by the data providers in the blockchain network. The Extended TOTEM architecture is also proposed to address the additional features when it is needed to combine the results from multiple data providers without sharing the data. This research work focused on the design of the TOTEM architecture and implementation as a proof of concept for the newly introduced components in the architecture. We have also introduced artificial intelligence in the framework to improve core features’ functionality.

In the present research, the TOTEM architecture is proposed for the SmartNEM project to utilize the energy data for decision making and figure out the trends or patterns, while maintaining data privacy, data ownership, accountability and traceability. Moreover, the architecture can be extended to other domains such as health, education, etc, where data security and privacy is the key concern in sharing the data.

Author Biography

Dhanya Therese Jose

PhD fellow
Faculty of Science and Technology
Department of Electrical Engineering and Computer Science
University of Stavanger


Damir Novosel Michael I. Henderson and Mariesa L. Crow. "Electric Power Grid Modernization Trends,Challenges, and Opportunities." In: (November 2017).

"Cyber-attack against Ukrainian critical infrastructure, Alert (IR-ALERT-H-16-056-01)" The Industrial Control Systems Cyber Emergency Response Team (ICS-CERT), Department of Homeland Security, Washington, DC In: (2016).

", "Natural gas and the environment," available at: In: (2010).

Jing Liu, Yang Xiao, Shuhui Li, Wei Liang, and CL Philip Chen. "Cyber security and privacy issues in smart grids." In: IEEE Communications surveys & tutorials 14.4 (2012), pp. 981-997.

"U.S. NETL, "A systems view of the modern grid," White Paper, available at: In: (2007).

"U.S. DOE, "Smart grid system report,"White Paper, available at: 090707 lowres.pdf." In: (2009).

Dhanya Therese Jose, Jørgen Holme, Antorweep Chakravorty, and Chunming Rong. "Integrating big data and blockchain to manage energy smart grids-TOTEM framework."In: Blockchain: Research and Applications 3.3 (2022), p. 100081. issn: 20967209. url: In: (2017).

Mingli Wu, Kun Wang, Xiaoqin Cai, Song Guo, Minyi Guo, and Chunming Rong."A Comprehensive Survey of Blockchain: From Theory to IoT Applications and Beyond." In: IEEE Internet of Things Journal 6.5 (2019), pp. 8114-8154.

GDPR In: (2020).

Deepa S Kumar and M Abdul Rahman. "Simplifed HDFS architecture with blockchain distribution of metadata." In: International Journal of Applied Engineering Research 12.21 (2017), pp. 11374-11382.

A Outchakoucht Jp Leroy H Es-Samaali, Nn Van, and R Nakagawa T Tanouchi S Kodama. "A Blockchain-based Access Control for Big Data." In: Journal of Computer Networks and Communications 5 (2017), pp. 137-147.

Uchi Ugobame Uchibeke, Kevin A Schneider, Sara Hosseinzadeh Kassani, and Ralph Deters. "Blockchain access control ecosystem for big data security." In: (2018), pp. 1373-1378.

Manuj Subhankar Sahoo and Pallav Kumar Baruah."HBasechain DB-a scalable blockchain framework on hadoop ecosystem." In: (2018), pp. 18-29.

Elena Karafloski and Anastas Mishev. "Blockchain solutions for big data challenges: A literature review." In: (2017), pp. 763- 768.

Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "TOTEM : Token for controlled computation: Integrating Blockchain with Big Data." In: (2019), pp. 1-7. doi: 10.1109/ ICCCNT45670.2019.8944855.

Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "Distributed computational framework in TOTEM architecture enabled by blockchain." In: (2020), pp. 83-88.

Behfar Behzad, Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "TOTEM SDK: an open toolset for token controlled computation managed by blockchain." In: (2021), pp. 1-8.

Dhanya Therese Jose, Chunming Rong, and Antorweep Chakravorty. "Application of Artifcial intelligence in secure decentralised computation enabled by TOTEM." In: IEEE Asia-Pacifc Conference on Computer Science and Data Engineering (CSDE).IEEE (2022).

Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. Method for analyzing data using a blockchain, a data provider and a data customer therefor. US Patent 11,121,874. Sept. 2021.

Karim R Lakhani and M Iansiti. "The truth about blockchain." In: Harvard Business Review 95.1 (2017), pp. 119-127.

S Haber and WS Stornetta. "How to Time-Stamp a Digital Document, Menezes AJ, Vanstone SA (eds) Advances in CryptologyCRYPTO'90. CRYPTO 1990." In: Lecture Notes in Computer Science 537 (1991).

Satoshi Nakamoto. "Bitcoin: A peer-to-peer electronic cash system Bitcoin: A Peer-to-Peer Electronic Cash System." In: Bitcoin. org. Disponible en (2009).

Giang-Truong Nguyen and Kyungbaek Kim. "A survey about consensus algorithms used in blockchain." In: Journal of Information processing systems 14.1 (2018), pp. 101-128.

Gareth W Peters and Efstathios Panayi. "Understanding modern banking ledgers through blockchain technologies: Future of transaction processing and smart contracts on the internet of money." In: (2016), pp. 239-278.

Nick Szabo et al. "Smart contracts." In: (1994).

Vitalik Buterin et al. "A next-generation smart contract and decentralized application platform." In: white paper 3.37 (2014), pp. 2-1.

Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, Konstantinos Christidis, Angelo De Caro, David Enyeart, Christopher Ferris, Gennady Laventman, Yacov Manevich, Srinivasan Muralidharan, Chet Murthy, Binh Nguyen, Manish Sethi, Gari Singh, Keith Smith, Alessandro Sorniotti, Chrysoula Stathakopo ulou, Marko Vukoli'c, Sharon Weed Cocco, and Jason Yellick. "Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains." In: EuroSys '18 (2018).

Min Chen, Shiwen Mao, and Yunhao Liu. "Big data: A survey." In: Mobile networks and applications 19.2 (2014), pp. 171-209.

Judith Hurwitz, Alan Nugent, Fern Halper, Marcia Kaufman, et al. "Big data for dummies." In: 336 (2013).

Parth Chandarana and M Vijayalakshmi. "Big data analytics frameworks." In: (2014), pp. 430-434.

Jefrey Dean and Sanjay Ghemawat. "MapReduce: a fexible data processing tool." In: Communications of the ACM 53.1 (2010), pp. 72-77.

Salman Salloum, Ruslan Dautov, Xiaojun Chen, Patrick Xiaogang Peng, and Joshua Zhexue Huang. "Big data analytics on Apache Spark." In: International Journal of Data Science and Analytics 1.3 (2016), pp. 145-164.

Muhammad Hussain Iqbal, Tariq Rahim Soomro, et al. "Big data analysis: Apache storm perspective." In: International journal of computer trends and technology 19.1 (2015), pp. 9- 14.

Shakuntala Gupta Edward and Navin Sabharwal. "Mongodb architecture." In: (2015), pp. 95-157.

Richa Vasuja, Ayesha Bhandralia, and Kanika Chuchra. "Daemons of Hadoop: An Overview." In: International Journal of Engineering Research and Technology (2018), pp. 2278-0181.

Dhruba Borthakur. "The hadoop distributed fle system: Architecture and design." In: Hadoop Project Website 11.2007 (2007), p. 21.

Vinod Kumar Vavilapalli, Arun C Murthy, Chris Douglas, Sharad Agarwal, Mahadev Konar, Robert Evans, Thomas Graves, Jason Lowe, Hitesh Shah, Siddharth Seth, et al."Apache hadoop yarn: Yet another resource negotiator."In: (2013), pp. 1- 16.

Issam El Naqa and Martin J Murphy. "What is machine learning?" In: (2015), pp. 3-11.

Rich Caruana and Alexandru Niculescu-Mizil. "An empiri-cal comparison of supervised learning algorithms." In: (2006), pp. 161-168.

Yann LeCun, Yoshua Bengio, and Geofrey Hinton. "Deep learning." In: nature 521.7553 (2015), pp. 436-444.

Jakub Koneˇcn, H Brendan McMahan, Daniel Ramage, and Peter Richt'arik. "Federated optimization: Distributed machine learning for on-device intelligence."In: arXiv:1610.02527 (2016).

Qiang Yang, Yang Liu, Yong Cheng, Yan Kang, Tianjian Chen, and Han Yu. "Federated learning." In: Synthesis Lectures on Artifcial Intelligence and Machine Learning 13.3 (2019), pp. 1- 207.

"Ansible" In: Ansible (2022).

"Azure" In: Azure (2022).

Cover image



November 10, 2022


Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.