Team:Calgary/Project/OurSensor/Modelling/QuantitativeModelling

From 2013.igem.org

(Difference between revisions)
Line 28: Line 28:
</figure>
</figure>
-
<h2>Agent based model for DNA binding to TALEs
+
<h2>Agent Based Modelling</h2>
-
</h2>
+
-
<p>For any detection system, the sensitivity and specificity are of great importance. Ideally, one should determine those parameters from repeated experiments, but to shorten the development time and to provide some insight on directions of further improvements, we seek to develop a model describing the behaviour of the system, from which the sensitivity and specificity can be theoretically obtained.
+
<p>For any detection system, the sensitivity and specificity are of great importance. Ideally, one should determine these parameters from repeated experiments, but to shorten the development time and to provide some insight on directions of further improvements, we developed an agent based model to describe the behaviour of the system. We have been able to challenge this model with varying the amount of target DNA that the TALEs in our system would bind to, as well as the amount of TALEs that would be on our strip. Through this we have been able to predict the amount of protein that needs to be loaded onto our strips before we started our prototyping.</p>
-
</p>
+
-
<h3>How did we do this?
+
<h3>How was our model created?</h3>
-
</h3>
+
-
<p>A simple 2D Monte-Carlo method was used for the simulation of DNA moving along the strip and bind to TALE. At the end of the simulation the number of positive DNA binding to the TALE are tallied with the number of negative DNA that bind.
+
<p>A simple 2D Monte-Carlo method was used for the simulation of the DNA movement along the strip, as well as for the action of the TALEs binding the DNA. Once a TALE binds to the DNA it is rendered unable to bind to any further DNA, effectively simulating saturation. For the quantitative output generated by the simulation, the number of target DNA binding to the TALEs is tallied with the number of non-target DNA that binds to the TALEs. To determine the sensitivity of our system we set the probability of target DNA binding to TALEs equal to 1, with non-target DNA having a probability of binding equal to 0. In future iterations we plan on altering these parameters such that we can determine the trade-off between sensitivity and specificity in our system. These calculated parameters will also be tested in the lab, allowing us to feed our experimental data back into our model in an iterative fashion.</p>
-
</p>
+
-
<p>A 2D region of the test strip, viewed from the top, was partitioned into a grid of squares such that a single TALE (0.1 nm by 0.1 nm by 0.1 nm) will be occupying a single square. Initially, about 45% of the spaces counting from the left are designated the DNA loading zone, where only the DNA will be placed. The remaining spaces will be initially allocated for TALEs to be present. DNA then moves from its current square to its neighbouring squares, one square at a time, whose probabilities are set in such a way so that moving from left to right is favoured. When DNA enters a square occupied by a TALE, the probability of binding to that TALE is determined by whether the DNA is positive or negative. If binding occurs, the TALE becomes saturated and additional DNA cannot bind. After some time, the number of TALEs bound by a positive DNA are tallied against the number of TALEs bound by a negative DNA, from which sensitivity and specificity can be calculated.  
+
<p>A 2D region of the test strip, viewed from the top, was partitioned into a grid of squares such that a single TALE (0.1 nm by 0.1 nm, represented by the colour black) will be occupying a single square. The spaces on the left side of the grid are designated as the DNA loading zone, where the DNA species (red for target DNA, green for non-target DNA) will initially be located. The remaining spaces on the right will be initially allocated for the TALEs, representing the test line on our prototype. DNA then moves from its current square to its neighbouring squares, one square at a time, where the probability of the movement is set in such a way so that moving from left to right is favoured. This was designed to simulate the flow of fluid that will be used in our prototype and is currently used in home pregnancy tests. When DNA enters a square occupied by a TALE, the probability of binding to that TALE is determined by whether the DNA is target or non-target. If binding occurs, the TALE becomes saturated and additional DNA cannot bind, represented visually by the TALE changing from black to blue. After the simulation has run it's course, the number of TALEs bound by a positive DNA are tallied against the number of TALEs bound by a negative DNA, from which sensitivity and specificity can be calculated.</p>
-
</p>
+
-
<h3>What did it show?
+
<h3>What did our model show?</h3>
-
</h3>
+
-
<p>Currently, our model only supports probability of positive DNA binding equalling one and that of negative DNA equalling zero. In addition, a downscaled model is deployed enabling the user to interact with what the model has processed. Please note that this requires installation of third-party software: Mathematica Player provided by Wolfram Inc. free of charge.
+
<p>We initially tested our model by varying the number of target DNA sequences vs non-target DNA and the number of TALEs bound to our test strip. After performing 3 runs from each of our 25 conditions (5 for both the TALEs and the target DNA levels), for a total processing time of approximately 6 hours, we obtained the number of saturated TALEs in a 50 x 50 grid square representing our prototype for 75 runs. This data would have taken us approximately 4 weeks (based on the construction time of our recent prototypes) to do in the lab. The data from this was analyzed and is represented as a 3D surface below in Figure 3. Based on the graph, it seems that the main determinant in the sensitivity of our system will be the amount of TALEs on the test strip, which makes intuitive sense.</p>
-
</p>
+
-
<p>The positive DNA&#39;s are colored red, negative DNA is green, TALEs are black and after binding (i.e. saturation) they turn blue. The sliders under &quot;global settings&quot;€ are parameters needed before the simulation runs. Given that a simulation can take 30 seconds to complete, they should not be changed frequently as it will take longer to show the results. The sliders under &quot;€œdisplay settings&quot;€ are parameters needed after the simulation runs. Their responses are much faster and are best played by clicking on the plus sign to the right and hit &quot;€œPlay&quot;.
+
-
</p>
+
-
 
+
-
<p>
+
-
<a href="https://2013.igem.org/Team:Calgary/Project/OurSensor/Modeling/QuantitativeApp" target="_blank">Link to Quantitative Model</a>
+
-
</p>
+
-
 
+
-
<p>In addition to deploying the model on the webpage we had also investigated the effects of changing the ratios between positive and negative DNA, and the number of TALEs available. For 5 levels of each of those parameters, 3 runs were conducted since the method is stochastic, resulting a total of 125 experiments. They are summarized in the graph below.
+
-
</p>
+
<figure>
<figure>
<img src="https://static.igem.org/mediawiki/2013/c/c0/UCalgary2013SWSensitivityTuningResult.jpg" alt="Results" width="645" height="431">
<img src="https://static.igem.org/mediawiki/2013/c/c0/UCalgary2013SWSensitivityTuningResult.jpg" alt="Results" width="645" height="431">
<figcaption>
<figcaption>
-
<p><b>Figure 1.</b> Model results of sensitivity tuning for TALE test strip.</p>
+
<p><b>Figure 3.</b> Model results of sensitivity tuning for TALE test strip.</p>
</figcaption>
</figcaption>
</figure>
</figure>
 +
<br>
 +
<p><b>We have deployed our agent based model into an application playable by the <a href="http://www.wolfram.com/cdf-player/">Mathematica CDF Player</a>, and it can be found <a href="https://2013.igem.org/Team:Calgary/Project/OurSensor/Modeling/QuantitativeApp" target="_blank">here</a>, along with our enzyme kinetic models. The mathematica code for our model can also be found at this location.</b></p>
 +
<br>
 +
<h3>Future Directions</h3>
-
 
+
<p>The model that we have developed is very preliminary, currently unable to fully predict either the sensitivity or the specificity. It has given us a good starting point for determining the design of our prototype though, as it showed that the amount of TALEs present is extremely important to our system. In the future we aim to increase the scope of our model by adding more realistic probabilities for the binding reactions of our DNA sequences, as well as by including additional DNA sequences instead of an almost perfect two species system.</p>
-
<p>From the graph we clearly see that not much TALE or DNA is required to have enough DNA bind to TALE, such that the signal cascade starting from the TALE can be read on the strip. Thus we have some theoretical evidence that our constructs will work the way they are designed. Also note that this experiment is not designed for specificity and sensitivity because of the simplicity of the binding probabilities chosen. We do acknowledge that as percentage of positive DNA increases, the total binding number will also increase, so it is not a &quot;€œfair&quot; comparison of performance of various levels of percentage of positive DNA. But for the purpose of ensuring the signals will be large enough to be read, this suffices.
+
-
</p>
+
-
 
+
-
<h3>What to be done?
+
-
</h3>
+
-
 
+
-
<p>In the future the model will be expanded to include parameters changing the probability of binding to TALE for both the positive and negative DNA. After which more experiments will be run to investigate the effects of those probabilities upon the sensitivity and specificity of the strip. We wish to conclude from those experiments, what is the bare minimal amount of TALE required on the strip, such that it gives good enough sensitivity and specificity for all possible ranges of probability of binding. This will in turn translate to the concentration of TALE needed, an important design parameter concerning the strip.
+
-
</p>
+
-
 
+
</section>
</section>
</html>
</html>

Revision as of 03:37, 28 September 2013

Quantitative Modelling

Enzyme kinetics for potential reporter proteins

In the beginning of the project we were looking for a reporter system. The wet lab team has made a list of possible reporters that can be used in vitro. We wanted to ensure that the reporter system gave us a rapid output, was stable and did not require cellular machinery to work. We wanted to test this in silico before we tested it in the wetlab. We wanted to ensure there was concrete evidence to support our choice of one reporter enzyme over another. Given that it is much easier to do simulations using models than to do experiments in the lab, we simulated horseradish peroxidase (HRP) and beta-galactosidase which are one of the most rapid reporters known in the literature. We programmed differential equations modelling enzyme kinetics in Mathematica to produce a interactive plot of output over time, with parameters such as initial enzyme concentration and initial substrate concentration being the parameters that can be adjusted.

After careful examination of the models under various parameters, we decided to use HRP because it is fast and give accurate response, evident from the kinetic models. However it turns out that we couldn't produce HRP in E. coli. After some more literature search we found a substitue of horseradish peroxidase, ferritin, which is known to has fast kinetics and accurate response just like horseradish peroxidase.

Snap shot of interactive beta-galactosidase kinetics model
Snap shot of interactive horseradish peroxidase kinetics model

Agent Based Modelling

For any detection system, the sensitivity and specificity are of great importance. Ideally, one should determine these parameters from repeated experiments, but to shorten the development time and to provide some insight on directions of further improvements, we developed an agent based model to describe the behaviour of the system. We have been able to challenge this model with varying the amount of target DNA that the TALEs in our system would bind to, as well as the amount of TALEs that would be on our strip. Through this we have been able to predict the amount of protein that needs to be loaded onto our strips before we started our prototyping.

How was our model created?

A simple 2D Monte-Carlo method was used for the simulation of the DNA movement along the strip, as well as for the action of the TALEs binding the DNA. Once a TALE binds to the DNA it is rendered unable to bind to any further DNA, effectively simulating saturation. For the quantitative output generated by the simulation, the number of target DNA binding to the TALEs is tallied with the number of non-target DNA that binds to the TALEs. To determine the sensitivity of our system we set the probability of target DNA binding to TALEs equal to 1, with non-target DNA having a probability of binding equal to 0. In future iterations we plan on altering these parameters such that we can determine the trade-off between sensitivity and specificity in our system. These calculated parameters will also be tested in the lab, allowing us to feed our experimental data back into our model in an iterative fashion.

A 2D region of the test strip, viewed from the top, was partitioned into a grid of squares such that a single TALE (0.1 nm by 0.1 nm, represented by the colour black) will be occupying a single square. The spaces on the left side of the grid are designated as the DNA loading zone, where the DNA species (red for target DNA, green for non-target DNA) will initially be located. The remaining spaces on the right will be initially allocated for the TALEs, representing the test line on our prototype. DNA then moves from its current square to its neighbouring squares, one square at a time, where the probability of the movement is set in such a way so that moving from left to right is favoured. This was designed to simulate the flow of fluid that will be used in our prototype and is currently used in home pregnancy tests. When DNA enters a square occupied by a TALE, the probability of binding to that TALE is determined by whether the DNA is target or non-target. If binding occurs, the TALE becomes saturated and additional DNA cannot bind, represented visually by the TALE changing from black to blue. After the simulation has run it's course, the number of TALEs bound by a positive DNA are tallied against the number of TALEs bound by a negative DNA, from which sensitivity and specificity can be calculated.

What did our model show?

We initially tested our model by varying the number of target DNA sequences vs non-target DNA and the number of TALEs bound to our test strip. After performing 3 runs from each of our 25 conditions (5 for both the TALEs and the target DNA levels), for a total processing time of approximately 6 hours, we obtained the number of saturated TALEs in a 50 x 50 grid square representing our prototype for 75 runs. This data would have taken us approximately 4 weeks (based on the construction time of our recent prototypes) to do in the lab. The data from this was analyzed and is represented as a 3D surface below in Figure 3. Based on the graph, it seems that the main determinant in the sensitivity of our system will be the amount of TALEs on the test strip, which makes intuitive sense.

Results

Figure 3. Model results of sensitivity tuning for TALE test strip.


We have deployed our agent based model into an application playable by the Mathematica CDF Player, and it can be found here, along with our enzyme kinetic models. The mathematica code for our model can also be found at this location.


Future Directions

The model that we have developed is very preliminary, currently unable to fully predict either the sensitivity or the specificity. It has given us a good starting point for determining the design of our prototype though, as it showed that the amount of TALEs present is extremely important to our system. In the future we aim to increase the scope of our model by adding more realistic probabilities for the binding reactions of our DNA sequences, as well as by including additional DNA sequences instead of an almost perfect two species system.