page archive

Reading and Course Material

Saturday, November 17th, 2007

Background Material

Lecture Notes

Introduction to Optimisation

Syllabus

Saturday, November 17th, 2007

Prerequisites: basic linear algebra, multi-variate calculus, probability

Introduction to Optimisation

  1. Fundamental Concepts in Convex Optimization
    1. Convex Sets and Functions
    2. Convex Optimization Problems:
      1. Existence of Solutions
      2. Optimality Conditions
    3. Projection Theorem and Separation Theorems
    4. Lagrangian Duality Theory
      1. Linear Programming Duality
      2. Slater Condition
      3. Karush-Khun-Tucker System
  2. Static Optimization (vector-space methods)
    1. Primal Algorithms

      1. Simplex Algorithm
      2. Gradient Projection Algorithm
    2. Dual Algorithms (differentiable case only)
  3. Motivating Examples (Network Applications)

    1. Classical Network Flow Problems

      • Shortest Path
      • Max-Flow Min-Cut
    2. Distributed Network Optimization
      • Kelly’s Utility Maximization Framework
      • Examples of routing, congestion control, rate allocation
  4. Dynamic Optimization (Dynamic Programming)

    1. Fundamental Concepts and Bellman’s Equation
    2. Stochastic Shortest Path
    3. Infinite Horizon Problems
      • Discounted Cost
      • Average Cost
    4. Applications to optimal routing

      • Dijkstra’s Shortest Path Algorithm
      • Max-Throughput (Tassiulas, Stolyar, and Neely)
      • Min-Delay Model (Gallagher’s data routing)

Introduction to Optimisation

Saturday, November 17th, 2007

Calendar

Saturday, November 17th, 2007

Monday
9am – 1pm: Fundamentals of Probability
Tuesday
9am – 1pm: Generating Functions and Inequalities
2.30pm-3.30pm: Applications Lecture – Dr. Wilhelm Huisinga, Hamilton Institute.

“Beyond Stabililty: The Mathematics of Molecular Flexibility in the Context of Virtual Screening”

Wednesday
9am – 1pm: Markov Chains
2.30pm-3.30pm: Applications Lecture – Dr. Ken Duffy, Hamilton Institute.

“Predicting the performance of IEEE 802.11 wireless networks with
Markov chains.”

Thursday
9am – 1pm: Limit Theorems
2.30pm-3.30pm: Applications Lecture – Prof. Rod Murray-Smith, Hamilton Institute.

“The role of probability in dynamics and interaction”

Friday

Reading and Course Material

Saturday, November 17th, 2007

Background Material

Lecture Notes

Fundamentals of Probability

Further Reading

P. Billingsley, Probability and Measure, Wiley Inter-Science.
Y. Suhov and M. Kelbert, Probability and statistics by example.
Vol. I., Cambridge University Press.

Syllabus

Saturday, November 17th, 2007

Fundamentals of Probability

  1. Fundamentals
    1. Review of elementary probability: conditional probability, independence, random variables, expectations, conditional expectation
    2. Probability triples: Lebesgue-Stieltjes measure and product measure
    3. Random variables: cdf and pdf, independence, expectation, calculational tools, stochastic processes
  2. Generating Functions and Inequalities
    1. Moments and moment generating function
    2. Inequalities: Markov, Chebyshev, Jensen, Holder
    3. Conditional probabilities and conditional expectation
  3. Markov Chains
    1. Discrete-time Markov chains, finite state space: absorbing chains, ergodic chains, stationary distributions, fundamental matrix
    2. Discrete-time Markov chains, countable state space: classification of states and chains, time reversible chains
    3. Stopping times
  4. Limit Theorems
    1. Modes of convergence for sequence of random variables
    2. Weak Law of Large Numbers
    3. Strong law of large numbers
    4. Characteristic functions
    5. Central limit theorem
    6. Cramer’s theorem

Fundamentals of Probability

Saturday, November 17th, 2007

Reading and Course Material

Saturday, November 17th, 2007

Background Material

Lecture Notes

Nonnegative Matrices and Positive Systems

Further Reading

A. Berman and R. Plemmons, Nonnegative matrices in the mathematical sciences, SIAM Classics in Applied Mathematics
L. Farina and S. Rinaldi, Positive Linear Systems, Wiley Interscience
A. Berman, M. Neumann, R. Stern, Nonnegative matrices in dynamic systems, Wiley Pure and App Mathematics

Calendar

Saturday, November 17th, 2007

Monday
Bank Holiday
Tuesday
9am – 12.30pm: Basics of Nonnegative Matrices
Wednesday
ALL DAY: Third Hamilton Institute Workshop on Nonnegative Matrices Thursday
9am – 11.45am: Third Hamilton Institute Workshop on Nonnegative Matrices
12.45 pm – 1.45 pm: Applications Lecture – Prof. Shmuel Friedland, University of Illinois, Chicago.

“Examples of Applications of Nonnegative Matrices”

2pm – 6pm: Graphs and Matrices
Friday
9am – 10 am: Applications Lecture – Prof. Amy Langville, College of Charleston

“Ranking and Clustering”

10am – 1pm: Stability and Convergence
2pm – 6pm: Applications and Extensions

Syllabus

Saturday, November 17th, 2007

Positive Systems and Nonnegative Matrices

  1. Basics of nonnegative matrices
    1. Perron theorem for positive matrices
    2. Frobenius theorem for nonnegative irreducible matrices
    3. Stochastic matrices and Markov chains
  2. Graphs and Matrices
    1. Incidence matrices
    2. Laplacians
    3. Colin de Verdiere parameters
  3. Stability and Convergence
    1. Z-matrices, M-matrices and P-matrices
    2. Stability, Diagonal stability and D-stability
    3. Paracontractivity and Projective metrices
  4. Applications and Extensions
    1. Nonnegative matrices and the internet – Google, congestion control
    2. Completely positive matrices
    3. Extensions of the Perron-Frobenius theory