Thoughts on data science, statistics and machine learning.
Book Review: The View from the Cheap Seats - Neil Gaiman
I can’t think of a single fantasy character that would be Neil Gaiman. I’m tempted to think that he’s like Santa Claus, but he’s not the sort who’d care if someone was being naughty. He’s not Dumbledore or Gandalf either - he’d rather be your friend than your mentor. He’s not even the Dream of the Endless, since he’s not aware of how powerful he is. Reading Gaiman’s nonfiction is like meditation that clears and even expands your mind.
Playing With the Konmari Method
I heard about the bestseller The Life-Changing Magic of Tidying Up at a SciPy talk about deculttering your data science project. The speakers admitted they hadn’t read it - they were simply trying to point out that tidying up your space and tidying up your software project are both similar. I’ve been married and living with my wife for about a year now. After we moved into “our own home” last year, we have both undergone major role reversals when it comes to tidying up.
On the Linearity of Bayesian Classifiers
In his book, Neural Networks - A Comprehensive Foundation, Simon Haykin has an entire section (3.10) dedicated to how perceptrons and Bayesian classifiers are closely related when operating in a Gaussian environment. However, it is not until the end of the section that Haykin mentions that the relation is only limited to linearity. What is interesting about this is that a Perceptron can produce the same classification “model” as a Bayesian classifier, provided that the underlying data is drawn from a Gaussian distribution.
A Geometric Proof of the Perceptron Convergence Theorem
The last time I studied neural networks in detail was five years ago in college. I did touch upon backpropagation when Andrew Ng’s machine learning MOOC was offered on Coursera for the first time, but beyond that I’ve only dabbled with them through keras. Then recently, when I read about Coursera’s imminent decision to pull down much of their freely available material (you can read a rant about it here), I went on a downloading spree (many thanks to the wonderful coursera-dl).