Skip to main content

Bayesian decision theory

Bayesian decision theory refers to a decision theory which is informed by Bayesian probability. It is a statistical system that tries to quantify the tradeoff between various decisions, making use of probabilities and costs. An agent operating under such a decision theory uses the concepts of Bayesian statistics to estimate the expected value of its actions, and update its expectations based on new information. These agents can and are usually referred to as estimators.

From the perspective of Bayesian decision theory, any kind of probability distribution - such as the distribution for tomorrow's weather - represents a prior distribution. That is, it represents how we expect today the weather is going to be tomorrow. This contrasts with frequentist inference, the classical probability interpretation, where conclusions about an experiment are drawn from a set of repetitions of such experience, each producing statistically independent results. For a frequentist, a probability function would be a simple distribution function with no special meaning.

Suppose we intend to meet a friend tomorrow, and expect an 0.5 chance of raining. If we are choosing between various options for the meeting, with the pleasantness of some of the options (such as going to the park) being affected by the possibility of rain, we can assign values to the different options with or with rain. We can then pick the option whose expected value is the highest, given the probability of rain.

One definition of rationality, used both on Less Wrong and in economics and psychology, is behavior which obeys the rules of Bayesian decision theory. Due to computational constraints, this is impossible to do perfectly, but naturally evolved brains do seem to mirror these probabilistic methods when they adapt to an uncertain environment. Such models and distributions may be reconfigured according to feedback from the environment.


Bayesian decision theory - Lesswrongwiki


Comments

Popular posts from this blog

Baconian method

The Baconian method is the investigative method developed by Sir Francis Bacon . The method was put forward in Bacon's book Novum Organum (1620), or 'New Method', and was supposed to replace the methods put forward in Aristotle 's Organon . This method was influential upon the development of scientific method in modern science ; but also more generally in the early modern rejection of medieval Aristotelianism . Bacon's method is an example of the application of inductive reasoning . By reasoning using "induction", Bacon meant the ability to generalize a finding stepwise, based on accumulating data. He advised proceeding by this method, or in other words, by building a case from the ground up. He wrote in the Novum Organum that: "Our only hope, then is in genuine Induction... There is the same degree of licentiousness and error in forming Axioms, as in abstracting Notions: and that in the first principles, which depend in common induction. Stil...

To PC or NPC: That is the question

When it's time to gear up and get LARPing (live action role playing), you have a decision to make. Do you want to play as a PC (player character) or NPC (non-player character)? For most LARPers, there are several factors involved in making this decision. A PC generally gets to make his or her own choices and become a hero (or villain) on an adventure. An NPC is usually tied to plot and limited in such choices, although there are sometimes phenomenal combat and role play opportunities available to NPCs as well. To PC or NPC: That is the question - National LARP | Examiner.com

Fundamental attribution error

In social psychology, the fundamental attribution error (also known as correspondence bias or attribution effect) is people's tendency to place an undue emphasis on internal characteristics to explain someone else's behavior in a given situation, rather than thinking about external situational. It does not explain interpretations of one's own behavior—where situational factors are more easily recognized and can thus be taken into consideration. The flip side of this error is the actor–observer bias, in which people tend to overemphasize the role of a situation in their behaviors and underemphasize the role of their own personalities. As a simple example, consider a situation where Alice, a driver, is about to pass through an intersection. Her light turns green, and she begins to accelerate when another car drives through the red light and crosses in front of her. The fundamental attribution error may lead her to think that the driver of the other car was an unskilled or rec...