\documentclass[11pt]{article} \setlength{\oddsidemargin}{0.0truein} \setlength{\evensidemargin}{0.0truein} \setlength{\textwidth}{6.5truein} \setlength{\topmargin}{0.0truein} \setlength{\textheight}{9.0truein} \setlength{\headsep}{0.0truein} \setlength{\headheight}{0.0truein} \setlength{\topskip}{10.0pt} \setlength{\parskip}{5mm} \usepackage{url} \usepackage{amsmath} \usepackage{amssymb} \pagestyle{empty} \begin{document} \begin{center} \textbf{\Large{\textsc{STANFORD UNIVERSITY}}}\\[5pt] \textbf{\Large{\textsc{DEPARTMENT OF STATISTICS}}}\\[5pt] \Large{\textsc{DEPARTMENTAL SEMINAR}} \end{center} % In the following statements, replace "Time of talk", % "Weekday", and "Date of talk". An example is provided. % If you are not sure about this, just skip this part. \begin{center} %Time of talk, Weekday, Date of talk\\ 4:15 p.m., Tuesday, April 1, 2008\\ Sequoia Hall Room 200\\ (Cookies at 3:45 in 1st Floor Lounge) \end{center} % In the following statements, replace "Name of the speaker" with your % name, "Department Affiliation" with your department affiliation, and %"University Affiliation" with your university affiliation. \begin{center} \textsl{Susan A. Murphy} \\ Department of Statistics\\ University of Michigan \end{center} % In the following statements, replace "Title of the talk" % with your title of the talk. \begin{center} \subsection*{A Prediction Interval for the Misclassification Rate and Value} \end{center} The misclassification rate of a classifier and the value of a policy are non-smooth functions of the classifier and policy respectively. Both suffer from bias due to over-fitting and while the misclassification rate is a "minimized" quantity the value of a policy is a "maximized" quantity. For all of these reasons the construction of measures of confidence such as estimates of variance and confidence/prediction intervals are challenging. We discuss how these problems are similar and propose a method based on the use of a smooth upper bound combined with the bootstrap. This upper bound utilizes the surrogate loss that is used in the construction of the classifier (or policy). \noindent \end{document}