This book is a philosophical study of mathematics, pursued by considering and relating two aspects of mathematical thinking and practice, especially in modern mathematics, which, having emerged around 1800, consolidated around 1900 and extends to our own time, while also tracing both aspects to earlier periods, beginning with the ancient Greek mathematics. The first aspect is conceptual, which characterizes mathematics as the invention of and working with concepts, rather than only by its logical nature. The second, Pythagorean, aspect is grounded, first, in the interplay of geometry and algebra in modern mathematics, and secondly, in the epistemologically most radical form of modern mathematics, designated in this study as radical Pythagorean mathematics. This form of mathematics is defined by the role of that which beyond the limits of thought in mathematical thinking, or in ancient Greek terms, used in the book's title, an alogon in the logos of mathematics. The outcome of this investigation is a new philosophical and historical understanding of the nature of modern mathematics and mathematics in general. The book is addressed to mathematicians, mathematical physicists, and philosophers and historians of mathematics, and graduate students in these fields.