IDEA: Integrating Divisive and Ensemble-Agglomerate hierarchical clustering framework for arbitrary shape data
- Authors
- Ahn, Hongryul; Jung, Inuk; Chae, Heejoon; Oh, Minsik; Kim, Inyoung; Kim, Sun
- Issue Date
- Dec-2021
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Divisive-agglomerate hybrid clustering; Ensemble clustering; Hierarchical clustering; Tree cost minimization
- Citation
- Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021, pp 2791 - 2800
- Pages
- 10
- Journal Title
- Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021
- Start Page
- 2791
- End Page
- 2800
- URI
- https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/151273
- DOI
- 10.1109/BigData52589.2021.9671953
- ISSN
- 0000-0000
- Abstract
- Hierarchical clustering, a traditional clustering method, has been getting attention again. Among several reasons, a credit goes to a recent paper by Dasgupta in 2016 that proposed a cost function that quantitatively evaluates hierarchical clustering trees. An important question is how to combine this recent advance with existing successful clustering methods. In this paper, we propose a hierarchical clustering method to minimize the cost function of clustering tree by incorporating existing clustering techniques. First, we developed an ensemble tree-search method that finds an integrated tree with reduced cost by integrating multiple existing hierarchical clustering methods. Second, to operate on large and arbitrary shape data, we designed an efficient hierarchical clustering framework, called integrating divisive and ensemble-agglomerate (IDEA) by combining it with advanced clustering techniques such as nearest neighbor graph construction, divisive-agglomerate hybridization, and dynamic cut tree. The IDEA clustering method showed better performance in minimizing Dasgupta's cost and improving accuracy (adjusted rand index) over existing cost-minimization-based, and density-based hierarchical clustering methods in experiments using arbitrary shape datasets and complex biology-domain datasets. © 2021 IEEE.
- Files in This Item
-
Go to Link
- Appears in
Collections - 공과대학 > 소프트웨어학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.