What are regression trees?

Regression Trees are decision trees that have a continuous target variable.

For example, imagine there is a newly launched product in the market whose price will depend on many constraints. This is the kind of example of where Regression Trees can be used. A regression tree is created through a process called binary recursive partitioningAn iterative process that splits the data into partitions or branches, and then continues splitting each partition into smaller groups as the method moves up each branch..

%0 node_1 condition node_2 condition node_1->node_2 node_3 condition node_1->node_3 node_1594189477374 Value node_2->node_1594189477374 node_1594189508340 Value node_2->node_1594189508340 node_1594189603481 Value node_3->node_1594189603481 node_1594189587392 Value node_3->node_1594189587392
How a Regression Tree looks like.

Features of regression trees

Root: This is the beginning of the decision tree. The first node represents the first condition based on the criteria of the data provided.

Leaf: The last node in the tree is represented by the value in the decision tree above. This is the terminal node that does not point to any condition or value.

Decision Node: Nodes after the root where any decision or condition is further divided into different categories.

Child Node: The node that is further divided into different categories is called a parent node. The nodes that result from this division are called child nodes.

Features of Regression Trees
Features of Regression Trees

Advantages of regression trees

  1. Visualization of data becomes easier as users can identify and process each and every step.

  2. A specific decision node could be set to have a priority against other decision nodes.

  3. As the regression tree progresses, undesired data will be filtered at each step. As a result, only important data is left to process, which increases the efficiency and accuracy of our design.

  4. It is easy to prepare regression trees – they can be used to present data during meetings, presentations, etc.

Let’s look at one basic example of a regression tree that plots data on the salary of a company’s employees based on their position.

Basic example of Regression Tree
Basic example of Regression Tree

Free Resources

Copyright ©2025 Educative, Inc. All rights reserved