CS7840 (Foundations and Applications of Information Theory) course reviews and ratings at Northeastern (NEU). Compare professors with RateMyProfessor reviews.
Studies information theory and selected applications for data management, machine learning, and information retrieval. Information theory examines the transmission, processing, extraction, and utilization of information. Topics include entropy; mutual information; cross-entropy; data processing theorem; information inequalities; Cox's theorem; maximum entropy solutions; and applications such as data normalization, decision trees, maximum likelihood, logistic regression, and VC dimensions. Requires prior study of standard computer science algorithms. Offers hands-on experience through a flexible project, allowing students to explore information theory in aspects related to their PhD research.
Data updated October 2026.