Can unbounded distance measures mitigate the curse of dimensionality?

Jayaram, Balasubramaniam and Klawonn, F (2012) Can unbounded distance measures mitigate the curse of dimensionality? International Journal of Data Mining, Modelling and Management, 4 (4). ISSN 1759-1163

[img]
Preview
Text
BJ_FK_IJDMMM_CoD.pdf - Accepted Version

Download (1MB) | Preview

Abstract

In this work, we revisit the curse of dimensionality, especially the concentration of the norm phenomenon which is the inability of distance functions to separate points well in high dimensions. We study the influence of the different properties of a distance measure, viz., triangle inequality, boundedness and translation invariance and on this phenomenon. Our studies indicate that unbounded distance measures whose expectations do not exist are to be preferred. We propose some new distance measures based on our studies and present many experimental results which seem to confirm our analysis. In particular, we study these distance measures w.r.t. indices like relative variance and relative contrast and further compare and contrast these measures in the setting of nearest neighbour/proximity searches and hierarchical clustering.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Jayaram, Balasubramaniamhttp://orcid.org/0000-0001-7370-3821
Item Type: Article
Uncontrolled Keywords: Cluster analysis; CoD; Curse of dimensionality; Nearest neighbour classifier
Subjects: Mathematics
Divisions: Department of Mathematics
Depositing User: Team Library
Date Deposited: 28 Oct 2014 10:20
Last Modified: 20 Sep 2017 07:28
URI: http://raiith.iith.ac.in/id/eprint/479
Publisher URL: https://doi.org/10.1504/IJDMMM.2012.049883
OA policy: http://www.sherpa.ac.uk/romeo/issn/1759-1163/
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 479 Statistics for this ePrint Item