Ilya: 1 revision imported

2018-07-04T16:28:45Z

1 revision imported

nemenman>Ilya: Created page with "{{PHYS212-2018}} ===General notes=== A good introduction to probability theory, one of my favorites, but more on the mathematical side, can be found at [http://www.dartmouth..."

2018-03-28T13:53:18Z

Created page with "{{PHYS212-2018}} ===General notes=== A good introduction to probability theory, one of my favorites, but more on the mathematical side, can be found at [http://www.dartmouth..."

New page

{{PHYS212-2018}}

===General notes===
A good introduction to probability theory, one of my favorites, but more on the mathematical side, can be found at
[http://www.dartmouth.edu/~chance/teaching_aids/books_articles/probability_book/pdf.html Introduction to Probability] by CM Grinstead and JL Snell.

===Why do we need random numbers?===
*Some processes are fundamentally random (quantum mechanics, statistical mechanics, mutations, chemical reactions).
*Some calculations are easier done using random numbers than using deterministic approaches (e.g., calculating area of a complex object).
*Avatars for randomness: a coin toss, a dice, a number of molecules in a certain volume of air, time to a click of a Geiger counter.

===Introducing concepts of randomness===
To define the necessary probabilistic concepts, we need
*To define a set of outcomes that a random variable can take (e.g., head or tails, six sides of a die, etc.).
*Then we define a probability of a certain outcome <math>x</math> as a limit of frequencies after many random draws, or events. That is, if after <math>N</math> draws, the outcome happened <math>n_x</math> times, then it's frequency is <math>f_x=n_x/N</math>, and the probability is <math>P(x)=\lim_{N\to\infty}f_x=\lim_{N\to\infty}\frac{n_x}{N}</math>.
Probabilities satisfy the following properties, which follow from their definition of limits of frequencies:
*nonnegativity: <math>P_i\ge0</math>
*unit normalization: <math>\sum_{i=1}^N P_i=1</math>
*nesting: if <math>A\subset B</math> then <math>P(A)\le P(B)</math>
*additivity (for non-disjoint events): <math> P(A\cup B)=P(A)+P(B)-P(A\cap B)</math>
*complementarity <math>P(not\, A)=1-P(A)</math>

====What if we are studying more than one random variable?====
Multivariate distributions <math>P(x,y)</math> is the probability of both events happening. It contains all of the information about the variables, including
*Marginal distribution: <math>P(x)=\sum_{y\in Y} P(x,y)</math>
*The conditional distribution, which can then be defined as <math>P(y|x)=P(x,y)/P(x)</math>, so that the probability of both events is the probability of the first happening, and then the probability of the second happening given that the first one has happened.

The conditional distributions are related using the Bayes theorem, which says: <math>P(x,y)=P(x|y)P(y)=P(y|x)P(x)</math>, so that <math>P(x|y)=\frac{P(y|x)P(x)}{P(y)}</math>.

We can also now formalize the intuitive concept of dependence among variables. Two random variables are considered to be statistically independent if and only if <math>P(x,y)=P(x)P(y)</math>, or, equivalently, <math>P(x|y)=P(x)</math> or <math>P(y|x)=P(y)</math>.

===How easy is it to generate random numbers?===
*Do exercises on [http://faculty.rhodes.edu/wetzel/random/mainbody.html this web page] to get a better feel for random numbers. Were you successful in generating random numbers without the help of a coin?
*Linear congruential method for generating random numbers. See http://apps.nrbook.com/c/index.html, Chapter 7.1 for details.
*Many standard systems use: multiplier = 7**5, modulus = 2**31-1, increment = 0

===Your turn===
*Download the [[media:rnd_generation.txt | rnd_generation]] script and play with different multiples and moduli for the linear congruential method.
*Histogram your results. Do all values of the parameters produce good random numbers?
*[https://docs.google.com/forms/d/e/1FAIpQLSeNvrPddCgvMfHdlSA8uYDddBFqLK81Rrr4l7jfozud6J7iww/viewform Submit your work].

← Older revision	Revision as of 16:28, 4 July 2018
(No difference)

Physics 212, 2018: Lecture 18 - Revision history

Ilya: 1 revision imported

nemenman>Ilya: Created page with "{{PHYS212-2018}} ===General notes=== A good introduction to probability theory, one of my favorites, but more on the mathematical side, can be found at [http://www.dartmouth..."