Hello! 👋 I'm a final year Mathematics & Computing undergrad at IIT Kharagpur

My interests include Computer Vision, Deep Learning, Software and Web developement in Python and JS, Asynchronous Programming, etc.

Feel free to reach out to me @ dibyadas998 at gmail dot com

Résumé


Blog ↓

Implicit Rank Minimization in Gradient Descent

October 14, 2020

I came across this paper “Implicit Rank-Minimizing Autoencoder” [1] by FAIR which was shared by Yann LeCun on his facebook timeline. In this paper, the authors show that inserting a few linear layers between the encoder and the decoder decreases the dimensionality of the latent space. The authors build on the results of [2] which showed how overparameterization of linear neural networks results in implicit regularization of the rank when trained via gradient descent(GD). ... Read more

Sherman-Morrison-Woodbury | Effect of low rank changes to matrix inverse

October 1, 2020

I recently came across this tweet about the Sherman-Morrison-Woodbury formula (henceforth referred to as SMW in this post). I was reading linear regression and I realized that this formula has a very practical application there. I will highlight the formula and briefly explain one of its applications. The Sherman-Morrison-Woodbury formula is : $$(A + uv^T)^{-1} = A^{-1} - \frac{A^{-1}uv^TA^{-1}}{1+v^TA^{-1}u}$$ where $A$ is n $\times$ n matrix and $u$ and $v$ are both n $\times$ 1 matrix. ... Read more

Waiting to Sync

July 2, 2020

The month of May, when I experienced the lowest of my productivity, I was trying out different ways to make myself do something worthwhile. But everything went in vain and I just gave up. I planned to ride out this wave of unproductivity. Among the things I tried to do, one of them was trying to learn async/await in Python which I have never been able to fully follow through in the past. ... Read more

Éireann

August 17, 2019

I spent this summers of 2019 interning at the Insight Centre for Data Analytics, NUI Galway and I would like to write my experience so that I can come back later and smile in reminiscence :). I was elated to get my VISA just in time after my exams ended so that I could make my travel plans to Ireland. Unfortunately during that time there was a severe cyclone originating in the east coast of India affecting my city and my state and this delayed my plans to spend time at home. ... Read more

intel_idle.max_cstate=1

July 4, 2018

This post is looooong overdue. I was supposed to write this post like 2 years back and it should have been my first post. I’ve finally taken out the time and I’m determined to finish & publish this. First, a little background on this. I finished my higher secondary education ( also referred to as +2 in India) under CHSE Board, Odisha. A youth empowerment initiative launched by our state government offers laptops to the top 15,000 students of the 12th board exams for free. ... Read more

Visualizing Different Normalization Techniques

May 29, 2018

While implementing Semantic Segmentation using Adversarial Networks, I came across a normalization technique called Local Contrast Normalization. Before feeding the image into the segmentor network, the image undergoes this normalization. Then I came across other ways to normalize image data. Like Simplified Whitening, Local Response Normalization. Here is a great article on the same where I drew my inspiration from. But I wanted to see for myself, how the image turns out after being normalized. ... Read more

Machine Learning, Its Implementation in Specialized hardware

December 6, 2017

Yet another post on ML 😛 Recently, I was working on an assignment with my group, about the needs and uses of specialized hardware for ML. I browsed through a few articles on the internet about this and decided to compile them here. Why specialized hardware is important for Machine Learning?Cores of a CPU are far more versatile than a GPU coreOne may ask, why a GPU is needed? There are broadly 2 stages to ML. ... Read more

2 weeks into my Summers!

May 15, 2017

Few months ago, when I opened my account on Medium, it was only for reading blogs concerning my interests. Little did I know, that I would end up writing one. And now, I am writing my first ever blogpost! It was the end of our first year in KGP. I had not been to my home during the semester. So I was missing my home a lot! To my wish, I was allotted the same hall(LBS) I was in. ... Read more

Hucore theme & Hugo