Papers
Topics
Authors
Recent
2000 character limit reached

Lecture Notes on Algorithmic Information Theory

Published 22 Apr 2025 in cs.IT, cs.LO, and math.IT | (2504.18568v1)

Abstract: Algorithmic information theory roots the concept of information in computation rather than probability. These lecture notes were constructed in conjunction with the graduate course I taught at Universit`a della Svizzera italiana in the spring of 2023. The course is intended for graduate students and researchers seeking a self-contained journey from the foundations of computability theory to prefix complexity and the information-theoretic limits of formal systems. My exposition ignores boundaries between computer science, mathematics, physics, and philosophy -- an approach I consider essential when explaining inherently multidisciplinary fields. Lecture recordings are available online. Among other topics, the notes cover bit strings, codes, Shannon information theory, computability theory, the universal Turing machine, the Halting Problem, Rice's Theorem, plain algorithmic complexity, the Invariance Theorem, incompressibility, Solomonoff's induction, self-delimiting Turing machines, prefix algorithmic complexity, the halting probability Omega, Chaitin's Incompleteness Theorem, The Coding Theorem, lower semi-computable semi-measures, and the chain rule for algorithmic complexity.

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We found no open problems mentioned in this paper.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 3 tweets with 369 likes about this paper.