Design Optimization

The required Python packages are Python, Numpy, Matplotlib, and Scipy. The MATLAB and Python plots produce trends that show the optimal solution with an l₁-norm objective function.

Dynamic estimation involves fitting parameters in a dynamic model. In many cases, a linear first order differential equation can approximate the dynamic evolution of many systems. The unknown parameters for this system include the time constant (tau), gain (K), and sometimes dead-time (theta).

For this exercise, you can assume that the dead-time (theta) is zero and estimate only the time constant (tau) and gain (K). The following data set was generated in class from a voltage input (u) that changed the temperature (x) of a thermister.

Fit the dynamic data to a first order linear system by estimating tau (time constant) and K (gain). Determine the 95% and 99% confidence intervals for the parameters (see F-test video tutorial).

The confidence interval is determined with an F-test that specifies an upper limit to the deviation from the optimal solution

with p=2 (number of parameters), n=851 (number of measurements), theta=[K,tau] (parameters), theta^* as the optimal parameters, SSE as the sum of squared errors, and the F statistic that has 3 arguments (alpha=confidence level, degrees of freedom 1, and degrees of freedom 2). For many problems, this creates a multi-dimensional nonlinear confidence region. In the case of 2 parameters, the nonlinear confidence region is a 2-dimensional space.

The confidence interval is determined with an F-test that specifies an upper limit to the deviation from the optimal solution.

For many problems, this creates a multi-dimensional nonlinear confidence region. In the case of 2 parameters, the nonlinear confidence region is a 2-dimensional space.

The required Python packages are Python 2.7 Δ, Numpy 1.6.2 Δ, Matplotlib 1.2.0 Δ, and Scipy 0.11.0 Δ. The MATLAB and Python plots produce trends that show the optimal solution with an L₁-norm objective function.

Excel Solution

MATLAB and Python Solutions

An alternative approach to the sum of squared errors is to minimize an L₁-norm error to find the optimal values of K (gain) and tau (time constant).

• Download MATLAB and Python Solutions for Dynamic Parameter Estimation

The MATLAB and Python plots produce trends that show the optimal solution with an L₁-norm objective function.

The nonlinear confidence interval is shown by producing a contour plot of the SSE objective function with variations in the two parameters. The optimal solution is shown at the center of the plot and the objective function becomes worse (higher) away from the optimal solution.

The confidence interval is determined with an F-test that specifies an upper limit to the deviation from the optimal solution. For many problems, this creates a multi-dimensional nonlinear confidence region. In the case of 2 parameters, the nonlinear confidence region is a 2-dimensional space.

The dynamic model can be written in discrete form by specifying that the voltage is constant between sampling intervals. The discrete form of the equation accounts for non-zero initial conditions in temperature (x₀) and voltage (u₀). In this case, the voltage does start at zero, but this is not required.

In this equation, the subscripts denote the sampling intervals that are collected at a time interval of delta time = t_k-t_k-1. The above equation and the data are put into an Excel worksheet. The difference between the measured and predicted values are minimized to obtain the optimal parameters K (gain) and tau (time constant).

The spreadsheet is currently showing non-optimal values. To obtain the optimal values, use Excel Solver available from the Data toolbar. If the solver option does not appear, it can be added with the Add-In manager.

Fit the dynamic data to a first order linear system by estimating tau (time constant) and K (gain). Determine the confidence intervals for the parameters (see F-test video tutorial).

Solution

The dynamic model can be written in discrete form by specifying that the voltage is constant between sampling intervals. The discrete form of the equation accounts for non-zero initial conditions in temperature (t[0]) and voltage (v[0]). In this case, the voltage does start at zero, but this is not required.

The above equation and the data are put into an Excel worksheet. The difference between the measured and predicted values are minimized to obtain the optimal parameters K (gain) and tau (time constant).

• Download Excel Worksheet for Dynamic Parameter Estimation

The spreadsheet is current showing non-optimal values. To obtain the optimal values, use Excel Solver available from the Data toolbar. If the solver option does not appear, it can be added with the Add-In manager.

Fit the dynamic data to a first order linear system by estimating tau (time constant) and K (gain). Determine the confidence intervals for the parameters (see F-test video tutorial).

Fit the dynamic data to a first order linear system by estimating tau (time constant) and K (gain). Determine the confidence intervals for the parameters.

• Download Dynamic Data

• Download Dynamic Data

(:title Dynamic Estimation:) (:keywords Dynamic Estimation, Lagrange Multiplier, Optimization, Constraint, Nonlinear Programming:) (:description Homework on Dynamic Estimation with by Minimizing a Sum of Squared Errors.:)

This homework assignment involves fitting parameters in a dynamic model. In many cases, a linear first order differential equation can approximate the dynamic evolution of many systems. The unknown parameters for this system include the time constant (tau), gain (K), and sometimes dead-time (theta).

For this assignment, you can assume that the dead-time (theta) is zero and estimate only the time constant (tau) and gain (K). The following data set was generated in class from a voltage input (u) that changed the temperature (x) of a thermister.

• Download Dynamic Data Δ

Fit the dynamic data to a first order linear system by estimating tau (time constant) and K (gain).

The difficulty of the last few assignments has been reduced to allow time for work on the Final Project. Please use the additional time this week to develop the project and start the write-up.

This assignment can be completed in groups of two. Additional guidelines on individual, collaborative, and group assignments are provided under the Expectations link.

(:html:)

 <div id="disqus_thread"></div>
    <script type="text/javascript">
        /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */
        var disqus_shortname = 'apmonitor'; // required: replace example with your forum shortname

        /* * * DON'T EDIT BELOW THIS LINE * * */
        (function() {
            var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true;
            dsq.src = 'https://' + disqus_shortname + '.disqus.com/embed.js';
            (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
        })();
    </script>
    <noscript>Please enable JavaScript to view the <a href="https://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript>
    <a href="https://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a>

(:htmlend:)