Saptarshi Dey

Implementing Decision Tree Regression from scratch without using Scikit-learn Decision Trees are one of the most popular and intuitive machine learning algorithms. They can be used for both classification and regression tasks. In regression problems, a Decision Tree tries to split the dataset into regions such that the variance (or mean squared error) within each region is minimized. It produces a binary tree where each split is based on the best threshold of a feature. Unlike black-box models, decision ...

Implementing multivariate linear regression from scratch without using Scikit-learn Have you ever wondered how the Scikit-learn regression models work under the hood? In this blog, we will try to mimic the Scikit-learn regression models using basic differential calculus and matrix algebra. In other words, we are going to implement Multiple Linear Regression from scratch. First things first. This blog dives deep into pure mathematics concepts. So I assume that you know the basics of engineering mathematic...