Model Selection Using Efficiency of Conformal Predictors

Jaiswal, R and Balasubramanian, V N (2015) Model Selection Using Efficiency of Conformal Predictors. In: Statistical Learning and Data Sciences: Third International Symposium, SLDS 2015, Egham, UK, April 20-23, 2015, Proceedings. Lecture Notes in Computer Science (3). Springer International Publishing, Switzerland, pp. 291-300. ISBN 978-3-319-17090-9

Full text not available from this repository. (Request a copy)

Abstract

The Conformal Prediction framework guarantees error calibration in the online setting, but its practical usefulness in real-world problems is affected by its efficiency, i.e. the size of the prediction region. Narrow prediction regions that maintain validity would be the most useful conformal predictors. In this work, we use the efficiency of conformal predictors as a measure to perform model selection in classifiers. We pose this objective as an optimization problem on the model parameters, and test this approach with the k-Nearest Neighbour classifier. Our results on the USPS and other standard datasets show promise in this approach.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Balasubramanian, V NUNSPECIFIED
Item Type: Book Section
Uncontrolled Keywords: Conformal prediction, Efficiency, Model selection, Optimisation
Subjects: Computer science > Big Data Analytics
Divisions: Department of Computer Science & Engineering
Depositing User: Team Library
Date Deposited: 05 Jan 2016 06:56
Last Modified: 05 Jan 2016 06:56
URI: http://raiith.iith.ac.in/id/eprint/2095
Publisher URL: http://dx.doi.org/10.1007/978-3-319-17091-6_24
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 2095 Statistics for this ePrint Item