An Empirical Exploration of Recurrent Network Architectures: Paper Notes

This post contains my notes about the paper titled "An Empirical Exploration of Recurrent Network Architectures". You can read the paper here - http://proceedings.mlr.press/v37/jozefowicz15.pdf Abstract of the paper -  The Recurrent Neural Network (RNN) is an extremely powerful sequence model that is often difficult to train. The Long Short-Term Memory (LSTM) is a specific RNN … Continue reading An Empirical Exploration of Recurrent Network Architectures: Paper Notes

Template Specialization in C++

This is one of the new things which I learnt this week. In this blog post we will talk about Template Specialization in C++. So I am really enjoying coding in Cpp and playing with the core internals. The power which comes which system level languages are amazing. You can actually go and see closely … Continue reading Template Specialization in C++

CRDTs: Introduction

Hey guys, I am writing this blog post for beginners like me who want to understand CRDTs or distributed systems much. Quoting Wikipedia - "In distributed computing, a conflict-free replicated data type (CRDT) is a data structure which can be replicated across multiple computers in a network, where the replicas can be updated independently and concurrently without coordination between the replicas, and where it is always mathematically … Continue reading CRDTs: Introduction

“Exploration vs Exploitation” Dilemma of autodidacts

In Reinforcement Learning, there is something known as Exploration vs Exploitation tradeoff. In this post I would be talking about the tradeoff and some personal dilemma as well. Follow this thread once - https://twitter.com/alienelf/status/1082949406977114112 I think if you are in self learning mode then you must have gone through this. So Let me explain a … Continue reading “Exploration vs Exploitation” Dilemma of autodidacts

Which one should I choose as a beginner in Deep Learning pytorch or tensorflow?

I know I know. It is really daunting to start learning deep learning today. I remember August-September of 2017 when I was starting to tiptoe in the waters of deep learning. I still remember reading my first paper and how formidable experience it was, specially for an autodidact programmer like me. I was so confused … Continue reading Which one should I choose as a beginner in Deep Learning pytorch or tensorflow?

Airflow, Hadoop, Hue, Python and Twitter Sentiment Analysis

So this week at my work place I took baby steps to being a Data Scientist! I just peaked into distributed computing, data warehousing and data crunching(add more terms like these, to sound cool). Airflow and Hadoop ecosystem made me go "oh wow!". I built a very simple Twitter sentiment analysis big data solution using … Continue reading Airflow, Hadoop, Hue, Python and Twitter Sentiment Analysis