A Course in Large-Sample and High-Dimensional Theory

This book provides a systematic treatment of two central regimes in statistical theory: classical large-sample theory for M- and Z-estimation with a fixed number of parameters, and high-dimensional theory where the number of parameters can be comparable to or larger than the sample size. While the former was developed earlier and remains fundamental, high-dimensional statistical theory has become an indispensable part of modern statistics. Classical large-sample theory and high-dimensional theory are typically compartmentalized into separate books and courses, which can make it difficult for readers to see how they relate. To foster learning, this book brings them together in a compact and integrated manner, highlighting both their differences and their shared underlying structures. Assuming basic knowledge of mathematics and statistics, the book is intended primarily as a graduate textbook for students and researchers in Statistics, Data Science, and related fields. It serves as a useful resource for those wishing to study classical asymptotics and modern high-dimensional theory as cohesive parts of a broader statistical framework. Key Features: Focuses on core, representative topics in classical and modern statistical theory, emphasizing essential ideas that help readers extend their understanding to related areas. Treats important results that are otherwise scattered across research papers and monographs in a coherent and carefully organized manner. Provides direct, self-contained proofs of main results while assuming only basic concepts and results from probability and real analysis. Reinforces learning with end-of-chapter exercises as well as questions and exercises integrated into the main text.