I think I’ve discovered something amazing: Hebbian learning naturally takes place during the backpropagation of SNNs. Backpropagation in Spiking Neural Networks (SNNs) engenders Spike-Timing-Dependent Plasticity (STDP)-like Hebbian learning behavior. So: – At first I simply thought “hey, what about coding a Spiking Neural Network using an automatic differentiation framework?” Here it is. – Then I […]
Random Thoughts on Brain-Computer Interfaces, Productivity, and Privacy.
I think that in the future, Brain-Computer Interfaces (BCI) will be absolutely awesome. As much as the thought of using them are attractive, I think they also might be dangerous for ourselves if misused. We can expect to see the emergence of awesome speeds of communication, new apps and tools, shareable mental models and knowledge […]
LSTMs for Human Activity Recognition
See the GitHub project here. Human Activity Recognition (HAR) using smartphones dataset and an LSTM RNN. Classifying the type of movement amongst six categories: – WALKING, – WALKING_UPSTAIRS, – WALKING_DOWNSTAIRS, – SITTING, – STANDING, – LAYING. Compared to a classical approach, using a Recurrent Neural Networks (RNN) with Long Short-Term Memory cells (LSTMs) require no […]