Design and Implementation of Data Management Scheme to Enable Efficient Analysis of Sensing Data

Yuichi Hashi
Kazuyoshi Matsumoto
Yoshinori Seki
Masahiro Hiji
Toru Abe
Takuo Suganuma
Hitachi Solutions East Japan, Ltd; Tohoku University
Published in: 
Proceedings of 2015 IEEE 12th International Conference on Autonomic Computing

ICT supports smart communities in their aim to build efficient and sustainable social infrastructure. To realize a smart community, it is necessary to manage and analyze data about the community including large volumes of sensing data, meta-data, as well as information on data sources and consent for use, all of which are interrelated. We propose a data management scheme capable of both high-speed search of large volumes of data for analysis, and flexible search of data which changes depending on the collection environment. A major characteristic of our scheme is that it combines a schema-free, document-oriented database and an graph database suited for flexible search. We implement proposed data management scheme, and evaluate a performance of the search for sensing data. As the result, searching time of large volumes of sensing data is very high-speed. We believe that proposed data management scheme is able to minimize the the time required for analysis.