Secure and Privacy Driven Energy Data Analytics
Keywords:
renewable resources, machine learning, blockchain, data hubs, TOTEM, token for controlled computation, big dataSynopsis
Renewable resources are the main energy sources in a smart grid project. In order to ensure the smooth functioning of the smart grid, Information and Communication Technologies (ICT) need to be utilised efficiently. The objective of the SmartNEM project is to effectively utilise the technologies such as Machine Learning, Blockchain and Data Hubs for the aforementioned purpose and at the same time ensure a secured and privacy preserved solution. The data involved in smart grids require high security and it can be sensitive due to the household data which contains personal information. The individuals can be reluctant to share these data due to mistrust and to avoid unnecessary manipulation of the data they provide.
In order to overcome this it is necessary to build a trust based framework in which one could ensure data security and data privacy for the data owners to open up their data for data analysis. To achieves this we have proposed an architecture called TOTEM, Token for Controlled Computation, which integrates Blockchain and Big Data technologies. The conventional method of data analysis demands data be moved across the network to the location where the execution happens, however in the TOTEM architecture computational code will be moved to the data owner’s environment where the data is located. The TOTEM is a three layer architecture (Blockchain consortium layer, Storage layer and Computational layer) with two main actors, data provider and data consumer. Data provider provides metadata of the data they own and provide resources for the execution of data. Data consumers will get an opportunity to execute their own code on the data provider´s data. For a controlled computation and to avoid malicious functions an entity called totem is introduced in the architecture. The authorised users should meet the requirements of Totem value for executing their code on the requested data. For live monitoring of the totem value throughout the run time is achieved with the components such as totem manager and updaters in the computational layer. The code must follow a specific format and will undergo preliminary checks with the TOTEM defined SDK and smart contracts deployed by the data providers in the blockchain network. The Extended TOTEM architecture is also proposed to address the additional features when it is needed to combine the results from multiple data providers without sharing the data. This research work focused on the design of the TOTEM architecture and implementation as a proof of concept for the newly introduced components in the architecture. We have also introduced artificial intelligence in the framework to improve core features’ functionality.
In the present research, the TOTEM architecture is proposed for the SmartNEM project to utilize the energy data for decision making and figure out the trends or patterns, while maintaining data privacy, data ownership, accountability and traceability. Moreover, the architecture can be extended to other domains such as health, education, etc, where data security and privacy is the key concern in sharing the data.
References
Damir Novosel Michael I. Henderson and Mariesa L. Crow. "Electric Power Grid Modernization Trends,Challenges, and Opportunities." In: (November 2017).
"Cyber-attack against Ukrainian critical infrastructure, Alert (IR-ALERT-H-16-056-01)" The Industrial Control Systems Cyber Emergency Response Team (ICS-CERT), Department of Homeland Security, Washington, DC https://www.cisa.gov/uscert/ics/alerts/IR-ALERT-H-16-056-01 In: (2016).
"NaturalGas.org, "Natural gas and the environment," available at: http://www.naturalgas.org/environment/naturalgas.asp In: (2010).
Jing Liu, Yang Xiao, Shuhui Li, Wei Liang, and CL Philip Chen. "Cyber security and privacy issues in smart grids." In: IEEE Communications surveys & tutorials 14.4 (2012), pp. 981-997.
https://doi.org/10.1109/SURV.2011.122111.00145
"U.S. NETL, "A systems view of the modern grid," White Paper, available at: https://www.smartgrid.gov/document/systems_view_modern_grid In: (2007).
"U.S. DOE, "Smart grid system report,"White Paper, available at: http://www.oe.energy.gov/SGSRMain 090707 lowres.pdf." In: (2009).
Dhanya Therese Jose, Jørgen Holme, Antorweep Chakravorty, and Chunming Rong. "Integrating big data and blockchain to manage energy smart grids-TOTEM framework."In: Blockchain: Research and Applications 3.3 (2022), p. 100081. issn: 20967209. url: https://www.sciencedirect.com/science/article/pii/S2096720922000227
https://doi.org/10.1016/j.bcra.2022.100081
https://www.uis.no/en/research/data-centered-and-securecomputing-dscomputing In: (2017).
Mingli Wu, Kun Wang, Xiaoqin Cai, Song Guo, Minyi Guo, and Chunming Rong."A Comprehensive Survey of Blockchain: From Theory to IoT Applications and Beyond." In: IEEE Internet of Things Journal 6.5 (2019), pp. 8114-8154.
https://doi.org/10.1109/JIOT.2019.2922538
GDPR https://gdpr-info.eu/ In: (2020).
Deepa S Kumar and M Abdul Rahman. "Simplifed HDFS architecture with blockchain distribution of metadata." In: International Journal of Applied Engineering Research 12.21 (2017), pp. 11374-11382.
A Outchakoucht Jp Leroy H Es-Samaali, Nn Van, and R Nakagawa T Tanouchi S Kodama. "A Blockchain-based Access Control for Big Data." In: Journal of Computer Networks and Communications 5 (2017), pp. 137-147.
Uchi Ugobame Uchibeke, Kevin A Schneider, Sara Hosseinzadeh Kassani, and Ralph Deters. "Blockchain access control ecosystem for big data security." In: (2018), pp. 1373-1378.
https://doi.org/10.1109/Cybermatics_2018.2018.00236
Manuj Subhankar Sahoo and Pallav Kumar Baruah."HBasechain DB-a scalable blockchain framework on hadoop ecosystem." In: (2018), pp. 18-29.
https://doi.org/10.1007/978-3-319-69953-0_2
Elena Karafloski and Anastas Mishev. "Blockchain solutions for big data challenges: A literature review." In: (2017), pp. 763- 768.
https://doi.org/10.1109/EUROCON.2017.8011213
Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "TOTEM : Token for controlled computation: Integrating Blockchain with Big Data." In: (2019), pp. 1-7. doi: 10.1109/ ICCCNT45670.2019.8944855.
Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "Distributed computational framework in TOTEM architecture enabled by blockchain." In: (2020), pp. 83-88.
https://doi.org/10.1109/ICCSE49874.2020.9201683
Behfar Behzad, Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. "TOTEM SDK: an open toolset for token controlled computation managed by blockchain." In: (2021), pp. 1-8.
https://doi.org/10.1109/CSDE53843.2021.9718489
Dhanya Therese Jose, Chunming Rong, and Antorweep Chakravorty. "Application of Artifcial intelligence in secure decentralised computation enabled by TOTEM." In: IEEE Asia-Pacifc Conference on Computer Science and Data Engineering (CSDE).IEEE (2022).
Dhanya Therese Jose, Antorweep Chakravorty, and Chunming Rong. Method for analyzing data using a blockchain, a data provider and a data customer therefor. US Patent 11,121,874. Sept. 2021.
Karim R Lakhani and M Iansiti. "The truth about blockchain." In: Harvard Business Review 95.1 (2017), pp. 119-127.
S Haber and WS Stornetta. "How to Time-Stamp a Digital Document, Menezes AJ, Vanstone SA (eds) Advances in CryptologyCRYPTO'90. CRYPTO 1990." In: Lecture Notes in Computer Science 537 (1991).
Satoshi Nakamoto. "Bitcoin: A peer-to-peer electronic cash system Bitcoin: A Peer-to-Peer Electronic Cash System." In: Bitcoin. org. Disponible en https://bitcoin.org/en/bitcoin-paper (2009).
Giang-Truong Nguyen and Kyungbaek Kim. "A survey about consensus algorithms used in blockchain." In: Journal of Information processing systems 14.1 (2018), pp. 101-128.
Gareth W Peters and Efstathios Panayi. "Understanding modern banking ledgers through blockchain technologies: Future of transaction processing and smart contracts on the internet of money." In: (2016), pp. 239-278.
https://doi.org/10.1007/978-3-319-42448-4_13
Nick Szabo et al. "Smart contracts." In: (1994).
Vitalik Buterin et al. "A next-generation smart contract and decentralized application platform." In: white paper 3.37 (2014), pp. 2-1.
Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, Konstantinos Christidis, Angelo De Caro, David Enyeart, Christopher Ferris, Gennady Laventman, Yacov Manevich, Srinivasan Muralidharan, Chet Murthy, Binh Nguyen, Manish Sethi, Gari Singh, Keith Smith, Alessandro Sorniotti, Chrysoula Stathakopo ulou, Marko Vukoli'c, Sharon Weed Cocco, and Jason Yellick. "Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains." In: EuroSys '18 (2018). https://doi.org/10.1145/3190508.3190538.
Min Chen, Shiwen Mao, and Yunhao Liu. "Big data: A survey." In: Mobile networks and applications 19.2 (2014), pp. 171-209.
https://doi.org/10.1007/s11036-013-0489-0
Judith Hurwitz, Alan Nugent, Fern Halper, Marcia Kaufman, et al. "Big data for dummies." In: 336 (2013).
Parth Chandarana and M Vijayalakshmi. "Big data analytics frameworks." In: (2014), pp. 430-434.
https://doi.org/10.1109/CSCITA.2014.6839299
Jefrey Dean and Sanjay Ghemawat. "MapReduce: a fexible data processing tool." In: Communications of the ACM 53.1 (2010), pp. 72-77.
https://doi.org/10.1145/1629175.1629198
Salman Salloum, Ruslan Dautov, Xiaojun Chen, Patrick Xiaogang Peng, and Joshua Zhexue Huang. "Big data analytics on Apache Spark." In: International Journal of Data Science and Analytics 1.3 (2016), pp. 145-164.
https://doi.org/10.1007/s41060-016-0027-9
Muhammad Hussain Iqbal, Tariq Rahim Soomro, et al. "Big data analysis: Apache storm perspective." In: International journal of computer trends and technology 19.1 (2015), pp. 9- 14.
https://doi.org/10.14445/22312803/IJCTT-V19P103
Shakuntala Gupta Edward and Navin Sabharwal. "Mongodb architecture." In: (2015), pp. 95-157.
https://doi.org/10.1007/978-1-4842-0647-8_7
Richa Vasuja, Ayesha Bhandralia, and Kanika Chuchra. "Daemons of Hadoop: An Overview." In: International Journal of Engineering Research and Technology (2018), pp. 2278-0181.
Dhruba Borthakur. "The hadoop distributed fle system: Architecture and design." In: Hadoop Project Website 11.2007 (2007), p. 21.
Vinod Kumar Vavilapalli, Arun C Murthy, Chris Douglas, Sharad Agarwal, Mahadev Konar, Robert Evans, Thomas Graves, Jason Lowe, Hitesh Shah, Siddharth Seth, et al."Apache hadoop yarn: Yet another resource negotiator."In: (2013), pp. 1- 16.
https://doi.org/10.1145/2523616.2523633
Issam El Naqa and Martin J Murphy. "What is machine learning?" In: (2015), pp. 3-11.
https://doi.org/10.1007/978-3-319-18305-3_1
Rich Caruana and Alexandru Niculescu-Mizil. "An empiri-cal comparison of supervised learning algorithms." In: (2006), pp. 161-168.
https://doi.org/10.1145/1143844.1143865
Yann LeCun, Yoshua Bengio, and Geofrey Hinton. "Deep learning." In: nature 521.7553 (2015), pp. 436-444.
https://doi.org/10.1038/nature14539
Jakub Koneˇcn, H Brendan McMahan, Daniel Ramage, and Peter Richt'arik. "Federated optimization: Distributed machine learning for on-device intelligence."In: arXiv:1610.02527 (2016).
Qiang Yang, Yang Liu, Yong Cheng, Yan Kang, Tianjian Chen, and Han Yu. "Federated learning." In: Synthesis Lectures on Artifcial Intelligence and Machine Learning 13.3 (2019), pp. 1- 207.
https://doi.org/10.2200/S00960ED2V01Y201910AIM043
"Ansible" https://www.ansible.com/overview/it-automation In: Ansible (2022).
"Azure" https://azure.microsoft.com/en-us/ In: Azure (2022).
