Ilya: /* Your work */

2019-02-17T18:36:11Z

‎Your work

Ilya at 18:34, 17 February 2019

2019-02-17T18:34:34Z

Ilya: Created page with "{{PHYS212-2019}} ==Errors in the modeling process== Errors plague modeling process. We have mentioned earlier the Mars Climate Orbiter that crashed due to an error in the uni..."

2019-02-17T18:31:24Z

Created page with "{{PHYS212-2019}} ==Errors in the modeling process== Errors plague modeling process. We have mentioned earlier the Mars Climate Orbiter that crashed due to an error in the uni..."

New page

{{PHYS212-2019}}

==Errors in the modeling process==
Errors plague modeling process. We have mentioned earlier the Mars Climate Orbiter that crashed due to an error in the unit conversion. However, such errors are maybe not the most common (and definitely avoidable). However, the computational modeling process involves also other types of errors, some of them simply unavoidable.

===Modeling errors===
Incorrectly constructed model. This can include rather sophisticated errors, such as making wrong assumptions about importance of various effects. Or the errors can be trivial, like simply writing down a wrong form of a interaction law. To find these errors, one must verify the program -- line by line, but also, more crucially, using special simple cases, at least one per independent parameter.

===Implementation (coding) errors===
Some of these may be notices simply -- like syntactic errors that the interpreter will pick for you. Some may be more complicated and involve incorrect logic (e.g., not initializing variables), and such mistakes are very hard to detect. As above, the only way of doing this is by verifying your program again and again with different parameter values.

===Data errors===
These are often outside of your control: instruments can have errors, parameter values you read in the literature can have errors, data may be copied with errors, etc. While outside of our control, detecting such errors is also important. Check -- does the data make sense? Is it of correct sign? Of correct magnitude? Does it change in the right fashion? etc.

===Computational errors===
To understand how these emerge, we need first to understand how real numbers are stored in computer memory. In Python, you can find the functions needed to check how numbers are represented in the module sys.
*Real number is represented by a mantissa and by exponent. In general, '''precision''' of a floating point number is the number of significant digits in its mantissa.
*The little endian vs. the big endian representation of a number. See more here [https://en.wikipedia.org/wiki/Endianness]. Related, for those who haven't read it, I highly recommend [https://en.wikipedia.org/wiki/Gulliver%27s_Travels Gulliver's Travels] book. See sys.byteorder.
*Single precision floating point number occupies 32 bits (4 bytes), and double precision 64 bits (8 bytes).
*Double precision number properties can can be found in sys.foat_info (check also sys.long_info).
**What is the largest and the smallest number available on your computers? (be ready to submit this at the end of the class).
*Relative error vs absolute error.
*When numerical operations are done with floating point numbers, '''arithmetic''' errors generally occur. Let's consider examples:
**Adding two numbers with 3 digit precision. Numbers have to have the same exponents first to be added. Whatever doesn't fit into the new mantissa is '''rounded off''' or '''truncated'''. '''Epsilon''' is the smallest number you can add to 1 and still have a result different from 1. What is epsilon on your computer?
**Multiplying numbers with 3 digit precision. Again, rounding or truncation errors will happen. Importantly, another common error is possible: overflow or underflow (also possible for addition, but less likely). '''Overflow''' error -- the resulting number too large (in absolute value) to be represented. '''Underflow''' error -- the resulting number is too small (in absolute value) to be represented. ESA Ariane 5 rocket crushed due to an overflow error.
*Good practice for avoiding arithmetic errors:
** Don't add small numbers to large numbers. Test this by creating an array of 1e6 in length of numbers 1e-20. Replace the 1000'th entry in the array by 1. Sum the array. You will get 1.0. Now instead sort the array and sum it. What do you get? Why?
**How should divisions and multiplications be done? There's no one specific sequence, but there is one rule: avoid underflow or overflow. If you need to multiply and divide many numbers, make sure that your divisions and multiplications are ordered in such a way, that you don't get too large or too small numbers in the middle of the process.
**Don't do many additions when you can do just one multiplication.
**In general, don't assume that distributive or associative properties are satisfied on a computer.
**Don't compare floating point numbers exactly. Compare them to a certain precision. Your work: write a function that compares if two floating point numbers are equal to a given relative precision (determined by the number with the smallest absolute value).

Please [https://docs.google.com/forms/d/e/1FAIpQLSeNvrPddCgvMfHdlSA8uYDddBFqLK81Rrr4l7jfozud6J7iww/viewform submit your work].

← Older revision		Revision as of 18:36, 17 February 2019
Line 34:		Line 34:
	;Problem 1: Find examples (which will involve very large, very small, or relatively small numbers) the violate the distributive property of addition/multiplication.		;Problem 1: Find examples (which will involve very large, very small, or relatively small numbers) the violate the distributive property of addition/multiplication.
	;Problem 2: Write a function that will compare if two floating point numbers are equal to some relative or absolute precision.		;Problem 2: Write a function that will compare if two floating point numbers are equal to some relative or absolute precision.
		+
		+	==Scripts used==
		+	:[[media:ComputationalErrors.txt\|Computational errors]] Jupyter notebook, which shows how to get the details of implementation of floating point algebra in your system, and illustrates a few common errors.

← Older revision		Revision as of 18:34, 17 February 2019
Line 31:		Line 31:
	**Don't compare floating point numbers exactly. Compare them to a certain precision. Your work: write a function that compares if two floating point numbers are equal to a given relative precision (determined by the number with the smallest absolute value).		**Don't compare floating point numbers exactly. Compare them to a certain precision. Your work: write a function that compares if two floating point numbers are equal to a given relative precision (determined by the number with the smallest absolute value).

−	~~Please [https~~:/~~/docs~~.~~google.com/forms/d/e/1FAIpQLSeNvrPddCgvMfHdlSA8uYDddBFqLK81Rrr4l7jfozud6J7iww/viewform submit your work]~~.	+	==Your work==
		+	;Problem 1: Find examples (which will involve very large, very small, or relatively small numbers) the violate the distributive property of addition/multiplication.
		+	;Problem 2: Write a function that will compare if two floating point numbers are equal to some relative or absolute precision.

Physics 212, 2019: Lecture 11 - Revision history

Ilya: /* Your work */

Ilya at 18:34, 17 February 2019

Ilya: Created page with "{{PHYS212-2019}} ==Errors in the modeling process== Errors plague modeling process. We have mentioned earlier the Mars Climate Orbiter that crashed due to an error in the uni..."