Data Science Decoded
Episodes
Data Science #34 - The deep learning original paper review, Hinton, Rumelhard & Williams (1985)
23 Nov 2025
Contributed by Lukas
On the 34th episode, we review the 1986 paper, "Learning representations by back-propagating errors" , which was pivotal because it provided a clear, ...
Data Science #33 - The Backpropagation method, Paul Werbos (1980)
03 Nov 2025
Contributed by Lukas
On the 33rd episdoe we review Paul Werbos’s “Applications of Advances in Nonlinear Sensitivity Analysis” which presents efficient methods for co...
Data Science #32 - A Markovian Decision Process, Richard Bellman (1957)
19 Sep 2025
Contributed by Lukas
We reviewed Richard Bellman’s “A Markovian Decision Process” (1957), which introduced a mathematical framework for sequential decision-making un...
Data Science #31 - Correlation and causation (1921), Wright Sewall
26 Jul 2025
Contributed by Lukas
On the 31st episode of the podcast, we add Liron to the team, we review a gem from 1921, where Sewall Wright introduced path analysis, mapping hypot...
Data Science #30 - The Bootstrap Method (1977)
30 May 2025
Contributed by Lukas
In the 30th episode we review the the bootstrap, method which was introduced by Bradley Efron in 1979, is a non-parametric resampling technique that a...
Data Science #29 - The Chi-square automatic interaction detection(CHAID) algorithm (1979)
23 May 2025
Contributed by Lukas
In the 29th episode, we go over the 1979 paper by Gordon Vivian Kass that introduced the CHAID algorithm.CHAID (Chi-squared Automatic Interaction Dete...
Data Science #28 - The Bloom filter algorithm
23 May 2025
Contributed by Lukas
In the 28th episode, we go over Burton Bloom's Bloom filter from 1970, a groundbreaking data structure that enables fast, space-efficient set membersh...
Data Science #27 - The History of Least Squares (1877)
02 Apr 2025
Contributed by Lukas
Mansfield Merriman's 1877 paper traces the historical development of the Method of Least Squares, crediting Legendre (1805) for introducing the method...
Data Science #26 - The First Gradient decent algorithm by Cauchy (1847)
23 Mar 2025
Contributed by Lukas
In this episode, we review Cauchy’s 1847 paper, which introduced an iterative method for solving simultaneous equations by minimizing a function usi...
Data Science #24 - The Expectation Maximization (EM) algorithm Paper review (1977)
04 Feb 2025
Contributed by Lukas
At the 24th episode we go over the paper titled:Dempster, Arthur P., Nan M. Laird, and Donald B. Rubin. "Maximum likelihood from incomplete data via t...
Data Science #23- The Markov Chain Monte Carl MCMC Paper review (1953)
14 Jan 2025
Contributed by Lukas
In the 23rd episode we review the The 1953 paper Metropolis, Nicholas, et al. "Equation of state calculations by fast computing machines." The journa...
Data Science #22 - The theory of dynamic programming, Paper review 1954
07 Jan 2025
Contributed by Lukas
We review Richard Bellman's "The Theory of Dynamic Programming" paper from 1954 which revolutionized how we approach complex decision-making problems ...
Data Science #21 - Steps Toward Artificial Intelligence
25 Dec 2024
Contributed by Lukas
In the 1st episode of the second season we review the legendary Marvin Minsky's "Steps Toward Artificial Intelligence" from 1961. Itis a foundational...
Data Science #20 - the Rao-Cramer bound (1945)
09 Dec 2024
Contributed by Lukas
In the 20th episode, we review the seminal paper by Rao which introduced the Cramer Rao bound: Rao, Calyampudi Radakrishna (1945). "Information and t...
Data Science #19 - The Kullback–Leibler divergence paper (1951)
02 Dec 2024
Contributed by Lukas
In this episode with go over the Kullback-Leibler (KL) divergence paper, "On Information and Sufficiency" (1951). It introduced a measure of the diff...
Data Science #18 - The k-nearest neighbors algorithm (1951)
25 Nov 2024
Contributed by Lukas
In the 18th episode we go over the original k-nearest neighbors algorithm; Fix, Evelyn; Hodges, Joseph L. (1951). Discriminatory Analysis. Nonparame...
Data Science #17 - The Monte Carlo Algorithm (1949)
18 Nov 2024
Contributed by Lukas
We review the original Monte Carlo paper from 1949 by Metropolis, Nicholas, and Stanislaw Ulam. "The monte carlo method." Journal of the American stat...
Data Science #16 - The First Stochastic Descent Algorithm (1952)
07 Nov 2024
Contributed by Lukas
In the 16th episode we go over the seminal the 1952 paper titled: "A stochastic approximation method." The annals of mathematical statistics (1951): ...
Data Science #15 - The First Decision Tree Algorithm (1963)
28 Oct 2024
Contributed by Lukas
the 15th episode we went over the paper "Problems in the Analysis of Survey Data, and a Proposal" by James N. Morgan and John A. Sonquist from 1963. ...
Data Science #14 - The original k-means algorithm paper review (1957)
10 Oct 2024
Contributed by Lukas
At the 14th episode we go over the Stuart Lloyd's 1957 paper, "Least Squares Quantization in PCM," (which was published only at 1982) The k-means alg...
Data Science #13 - Kolmogorov complexity paper review (1965) - Part 2
01 Oct 2024
Contributed by Lukas
In the 14th episode we review the second part of Kolmogorov's seminal paper: Three approaches to the quantitative definition of information’." Probl...
Data Science #12 - Kolmogorov complexity paper review (1965) - Part 1
28 Sep 2024
Contributed by Lukas
In the 12th episode we review the first part of Kolmogorov's seminal paper: "3 approaches to the quantitative definition of information’." Problems...
Data Science #11 - The original Perceptron paper by Frank Rosenblatt (1958)
20 Sep 2024
Contributed by Lukas
Frank Rosenblatt's 1958 paper, "The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain," introduces the perceptro...
Data Science #10 - The original principal component analysis (PCA) paper by Harold Hotelling (1935)
12 Sep 2024
Contributed by Lukas
Hotelling, Harold. "Analysis of a complex of statistical variables into principal components." Journal of educational psychology 24.6 (1933): 417. Th...
Data Science #9 - The Unreasonable Effectiveness of Mathematics in Natural Sciences, Eugene Wigner
10 Sep 2024
Contributed by Lukas
In this special episode, Daniel Aronovich joins forces with the 632 nm podcast. In this timeless paper Wigner reflects on how mathematical concepts, ...
Data Science #8 - The Turing test by Turing Alan "Computing machinery and intelligence" Mind (1950)
04 Sep 2024
Contributed by Lukas
This paper is a foundational text in the field of artificial intelligence (AI) and explores the question: "Can machines think?" Turing introduces wh...
Data Science #7 - "The use of multiple measurements in taxonomic problems." (1936), Fisher RA
12 Aug 2024
Contributed by Lukas
This paper introduced linear discriminant analysis(LDA), a statistical technique that revolutionized classification in biology and beyond. Fisher de...
Data Science #6 -"On the problem of the most efficient tests of statistical hypotheses." (1933) N&P
07 Aug 2024
Contributed by Lukas
This paper is considered one of the foundational works in modern statistical hypothesis testing. Key insights and influences: Neyman-Pearson Lemma: ...
Data Science #5 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 3
30 Jul 2024
Contributed by Lukas
Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423. Part 3/3. The paper fundam...
Data Science #4 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 2
21 Jul 2024
Contributed by Lukas
Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423. Part 2/3. The paper fundam...
Data Science #3 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 1
16 Jul 2024
Contributed by Lukas
Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423. Part 1/3. The paper fundam...
Data Science #2 - "Application of the Logistic Function to Bio-Assays" (1944), Berkson Joseph
07 Jul 2024
Contributed by Lukas
"Application of the Logistic Function to Bio-Assays" (1944), Berkson Joseph It gained further prominence in the 20th century through applications ...
Data Science #1 - Fisher RA. "On the mathematical foundations of theoretical statistics"(1922)
07 Jul 2024
Contributed by Lukas
We discuss Ronald A. Fisher's paper "On the Mathematical Foundations of Theoretical Statistics"(1922), which profoundly shaped the field of statistics...