Towards a Dataflow Platform in a Hierarchical Network: A Proposal for a Dataflow Component Management Method
-
- Ishihara Shintaro
- Graduate School of Frontier Informatics, Kyoto Sangyo University
-
- Akiyama Toyokazu
- Graduate School of Frontier Informatics, Kyoto Sangyo University
Abstract
<p>Massive dataflows are generated from IoT applications for controlling real-world environments. For maintaining the long-running IoT application costs, it becomes important to reduce network traffic and delay considering hierarchical network characteristics, e.g., leveraging edge resources. Research and development of such a dataflow platform are ongoing, and the platform enables application developers to build a new dataflow application by just combining reusable software components. However, the existing dataflow platform does not support component management, which includes application deployment and placement selection, assuming the hierarchical network environments. In this paper, to realize the dataflow platform in a hierarchical network, we proposed an approach to deploy components into heterogeneous environments using a major open-source product and to enable the large-scale deployment by considering the structure of network clusters. Then, a component deployment layer selection method is also proposed considering network and resource conditions in the proposed platform. During the definition of the component placement problem, we also extracted parameters, which are dataflow platform parameters, dataflow application parameters and dataflow application component parameters, required to estimate component deployment budgets. Furthermore, we implemented a simple dataflow application based on two use cases and confirmed the validity of the proposed method.</p>
Journal
-
- Journal of Information Processing
-
Journal of Information Processing 28 (0), 599-610, 2020
Information Processing Society of Japan
- Tweet
Details 詳細情報について
-
- CRID
- 1390004222619775104
-
- NII Article ID
- 130007904836
-
- ISSN
- 18826652
-
- Text Lang
- en
-
- Data Source
-
- JaLC
- Crossref
- CiNii Articles
- KAKEN
-
- Abstract License Flag
- Disallowed