<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://nemenmanlab.org/~ilya/index.php?action=history&amp;feed=atom&amp;title=Physics_380%2C_2011%3A_Lecture_18</id>
	<title>Physics 380, 2011: Lecture 18 - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://nemenmanlab.org/~ilya/index.php?action=history&amp;feed=atom&amp;title=Physics_380%2C_2011%3A_Lecture_18"/>
	<link rel="alternate" type="text/html" href="https://nemenmanlab.org/~ilya/index.php?title=Physics_380,_2011:_Lecture_18&amp;action=history"/>
	<updated>2026-05-17T09:40:36Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.31.0</generator>
	<entry>
		<id>https://nemenmanlab.org/~ilya/index.php?title=Physics_380,_2011:_Lecture_18&amp;diff=341&amp;oldid=prev</id>
		<title>Ilya: 1 revision imported</title>
		<link rel="alternate" type="text/html" href="https://nemenmanlab.org/~ilya/index.php?title=Physics_380,_2011:_Lecture_18&amp;diff=341&amp;oldid=prev"/>
		<updated>2018-07-04T16:28:41Z</updated>

		<summary type="html">&lt;p&gt;1 revision imported&lt;/p&gt;
&lt;table class=&quot;diff diff-contentalign-left&quot; data-mw=&quot;interface&quot;&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;1&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;1&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;Revision as of 16:28, 4 July 2018&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-notice&quot; lang=&quot;en&quot;&gt;&lt;div class=&quot;mw-diff-empty&quot;&gt;(No difference)&lt;/div&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;/table&gt;</summary>
		<author><name>Ilya</name></author>
		
	</entry>
	<entry>
		<id>https://nemenmanlab.org/~ilya/index.php?title=Physics_380,_2011:_Lecture_18&amp;diff=340&amp;oldid=prev</id>
		<title>nemenman&gt;Ilya at 13:43, 3 November 2011</title>
		<link rel="alternate" type="text/html" href="https://nemenmanlab.org/~ilya/index.php?title=Physics_380,_2011:_Lecture_18&amp;diff=340&amp;oldid=prev"/>
		<updated>2011-11-03T13:43:13Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;{{PHYS380-2011}}&lt;br /&gt;
We are proceeding with the dynamical information processing block. In the next couple of lectures, we will follow the article by Detwiler et al., 2000. &lt;br /&gt;
&lt;br /&gt;
==Warm up question==&lt;br /&gt;
How do we calculate the amount of information processed in the vertebrate photoreceptor?&lt;br /&gt;
&lt;br /&gt;
==Main lecture==&lt;br /&gt;
#We follow Detwiler et al., 2000, article in this lecture as well.&lt;br /&gt;
#Let &amp;lt;math&amp;gt;\delta,\Delta&amp;lt;/math&amp;gt; denote the noise and the signal in a quantity, respectively. Then &amp;lt;math&amp;gt;\frac{d\Delta X^*}{dt}=-k_{XX}\Delta x^*+k_{XE}\Delta E_a&amp;lt;/math&amp;gt;. This can be rewritten as &amp;lt;math&amp;gt;\frac{d\Delta X^*}{dt}=-\frac{1}{\tau}(\Delta x^*-g_0\Delta E_a)&amp;lt;/math&amp;gt;.&lt;br /&gt;
#With noise, this gives: &amp;lt;math&amp;gt;\frac{d\delta X^*}{dt}=-k_{XX}\delta x^*+k_{XE}\delta E_a+\eta(t)&amp;lt;/math&amp;gt;. Here we use &amp;lt;math&amp;gt;&amp;lt;\eta(t)\eta(t')&amp;gt;=(\Gamma_a+\Gamma_d)\delta(t-t')&amp;lt;/math&amp;gt;. In reality, noises in complex reactions are not as simple. See Sinitsyn and Nemenman, 2007.&lt;br /&gt;
#The noise clearly contributes to the variance of &amp;lt;math&amp;gt;\delta X*&amp;lt;/math&amp;gt;, but so does the noise in the enzyme. Overall: &amp;lt;math&amp;gt;\delta X_\omega=\frac{k_{XE}\delta E_{a\omega}+\eta_\omega}{k_{XX}+i\omega}&amp;lt;/math&amp;gt;.&lt;br /&gt;
#What is &amp;lt;math&amp;gt;\eta_\omega&amp;lt;/math&amp;gt;? It's a random variable. Hence &amp;lt;math&amp;gt;\delta X_\omega&amp;lt;/math&amp;gt; is also a random variable. We need to calculate its mean and variance.&lt;br /&gt;
#Let's calculate the mean and the variance of each Fourier component. The mean is zero. &lt;br /&gt;
#To calculate variances, we will need the Fourier transforms of &amp;lt;math&amp;gt;\delta&amp;lt;/math&amp;gt; functions. &amp;lt;math&amp;gt;\delta_\omega=\int dt \delta(t) e^{-i\omega t}=1&amp;lt;/math&amp;gt;. And hence &amp;lt;math&amp;gt;\delta(t)=\int e^{i\omega t}\frac{d\omega}{2\pi}&amp;lt;/math&amp;gt;&lt;br /&gt;
#Variance is the mean square of the distance of the random variable from its mean (zero in this case). Recalling that components are now complex, we need for the variance &amp;lt;math&amp;gt;&amp;lt;\eta_\omega\eta_{-\omega}&amp;gt;&amp;lt;/math&amp;gt;. This is given by the Wiener-Khinchin theorem as &amp;lt;math&amp;gt;&amp;lt;\eta_\omega\eta_{-\omega}&amp;gt;=\int dt e^{-i\omega t} &amp;lt;\eta(t) \eta(t')&amp;gt;=\int dt e^{-i\omega t} (\Gamma_a+\Gamma_d)\delta(t-t')=\Gamma_a+\Gamma_d\equiv \Omega&amp;lt;/math&amp;gt;&lt;br /&gt;
#The expression &amp;lt;math&amp;gt;&amp;lt;X_\omega X_{-\omega}&amp;gt;=S_X(\omega)&amp;lt;/math&amp;gt; for any quantity X is called the spectrum.&lt;br /&gt;
#Thus: &amp;lt;math&amp;gt;&amp;lt;\delta X^*_\omega \delta X^*_{-\omega}&amp;gt;=S_{\delta X^*}(\omega)=\frac{k_{XE}S_{\delta E_a}(\omega)+\Omega}{k_{XX}^2+\omega^2}&amp;lt;/math&amp;gt;&lt;br /&gt;
#The signal and the noise get &amp;quot;filtered&amp;quot; by the system. But notice that all frequency components are independent from each other. So each component will have its own signal and noise.&lt;br /&gt;
#We have studied information transmission in such systems: each component independently contributes to information. We have &amp;lt;math&amp;gt;I[\Delta X^*;\Delta E_a]=\int \frac{d\omega}{2\pi}\frac{1/2} \log_2\left(1+SNR\right)=\int \frac{d\omega}{2\pi}\frac{1/2} \log_2\left(1+\frac{S_{\Delta X^*}(\omega)}{S_{\delta X^*(\omega)}}\right)&amp;lt;/math&amp;gt;, where the spectrum of the signal is given by &amp;lt;math&amp;gt;S_{\Delta X^*}(\omega)=\frac{k_{XE}S_{\Delta E_a}(\omega)}{k_{XX}^2+\omega^2}&amp;lt;/math&amp;gt;&lt;/div&gt;</summary>
		<author><name>nemenman&gt;Ilya</name></author>
		
	</entry>
</feed>