What is "Decision Tree" and how to realize it?

What is 'Decision Tree'?

In operations research, specifically in decision analysis, a decision tree (or tree diagram) is a decision support tool that uses a graph or model of decisions and their possible consequences, including chance event outcomes, resource costs, and utility. A decision tree is used to identify the strategy most likely to reach a goal Another use of trees is as a descriptive means for calculating conditional probabilities. In date ming and machine learning, a decision tree is a predictive model; that is, a mapping from observations about an item to conclusions about its target value. More descriptive names for such tree models are classification tree (discrete outcome) or regression tree (continuous outcome). In these tree structures, leaves represent classifications and branches represent conjunctions of features that lead to those classifications. The machine learning technique for inducing a decision tree from data is called decision tree learning, or (colloquially) decision trees.

In General

In decision analysis a "decision tree" — and a closely related model form, an influence diagram— is used as a visual and analytical decision support tool, where the expected value(or expected utility) of competing alternatives are calculated. For example a factory makes product B. The manager has to decide to invest in development for a new product - product A or product C. (She cannot do both due to budget constraints.) Product A is estimated to require two million dollars of R&D investment, but only has a 50% chance of the research being successful and a product being obtained. It will have a 30% chance of selling $5M profit, a 40% chance of selling $10M profit, and a 30% chance of no sales. Product C, on the other hand, will also cost $2M in R&D but has an 80% chance of selling $5M profit and a 20% chance of no sales. $1M is the manufacturing cost for either product. If the company has a policy of maximising expected values, which is the preferred strategy? The alternatives, probabilities, payoffs, and resulting expected value calculations are shown in the example tree below. In this case either Product A or Product C are expected to turn a profit but product C has the higher expected value of $1 million:

The same example again, this time taking account of the time value of money by discounting to Net Present Value, for this scenario it can be seen that Product C is clearly the winning choice with a payout of $0.36 million. Product A is not expected to turn a profit.

Analysis can take into account the decision maker's (e.g., the company's) preference or utility function, for example:

The basic interpretation in this situation is that the company prefers B's risk and payoffs under realistic risk preference coefficients (greater than $400K -- in that range of risk aversion, the company would need to model a third strategy, "Neither A nor B").

Influence diagram

A decision tree can be represented more compactly as an influence diagram, focusing attention on the issues and relationships between events.

Uses in teaching
Decision trees, influence diagram, utility function, and other decision analysis tools and methods are taught to undergraduate students in schools of business, health economics, and public health, and are examples of operations research or management science methods.

Creation of decision nodes
Three popular rules are applied in the automatic creation of classification trees. The Gini rule splits off a single group of as large a size as possible, whereas the entropy and twoing rules find multiple groups comprising as close to half the samples as possible. Both algorithms proceed recursively down the tree until stopping criteria are met.

Futher study?look into here:http://en.wikipedia.org/wiki/Category:Trees_(structure)