The Azimuth Project
Blog - network theory (part 16)

This page is a blog article in progress, written by John Baez. To see discussions of it as it was being written, go the Azimuth Forum. For the final polished version, visit the Azimuth Blog.

We’ve been comparing two theories: stochastic mechanics and quantum mechanics. Last time we saw that any graph gives us an example of both theories! It’s a bit peculiar, but today we’ll explore the intersection of these theories a little further, and see that it has another interpretation. It’s also the theory of electrical circuits made of resistors!

That’s nice, because I’m supposed to be talking about ‘network theory’, and electrical circuits are perhaps the most practical networks of all:

I plan to talk a lot about electrical circuits. I’m not quite ready to dive in, but I can’t resist dipping my toe in the water today. Why don’t you join me? It’s not too cold!

Dirichlet operators

Last time we saw that any graph gives us an operator called the ‘graph Laplacian’ that’s both infinitesimal stochastic and self-adjoint. That means we get both:

  • a Markov process describing the random walk of a classical particle on the graph.

and

  • a 1-parameter unitary group describing the motion of a quantum particle on the graph.

That’s sort of neat, so it’s natural to wonder what are all the operators that are both infinitesimal stochastic and self-adjoint. They’re called ‘Dirichlet operators’, and at least in the finite-dimensional case we’re considering, they’re easy to completely understand. Even better, it turns out they describe electrical circuits made of resistors!

Today let’s take a lowbrow attitude and think of a linear operator H: n n as an n×n matrix with entries H ij. Then:

  • H is self-adjoint if it equals the conjugate of its transpose: H ij=H¯ ji

  • H is infinitesimal stochastic if its columns sum to zero and its off-diagonal entries are nonnegative:

iH ij=0\sum_i H_{i j} = 0
ijH ij0i \ne j \Rightarrow H_{i j} \ge 0

An operator that’s both self-adjoint and infinitesimal stochastic is called a Dirichlet operator.

What are Dirichlet operators like? Suppose H is a Dirichlet operator. Then its off-diagonal entries are 0, and since

iH ij=0\sum_i H_{i j} = 0

its diagonal entries obey

H ii= ijH ij0H_{i i} = - \sum_{ i \ne j} H_{i j} \le 0

So all the entries of the matrix H are real, which in turn implies it’s symmetric:

H ij=H¯ ji=H jiH_{i j} = \overline{H}_{j i} = H_{j i}

So, we can build any Dirichlet operator H as follows:

  • Choose the entries above the diagonal, H ij with i<j to be arbitrary nonnegative real numbers.

  • The entries below the diagonal, H ij with i>j, are then forced on us by the requirement that H be symmetric: H ij=H ji.

  • The diagonal entries are then forced on us by the requirement that the columns sum to zero: H ii= ijH ij.

Note that because the entries are real, we can think of a Dirichlet operator as a linear operator H: n n. We’ll do that for the rest of today.

Circuits made of resistors

Now for the fun part. We can easily draw any Dirichlet operator! To this we draw n dots, connect each pair of distinct dots with an edge, and label the edge connecting the ith dot to the jth with any number H ij0.

This contains all the information we need to build our Dirichlet operator. To make the picture prettier, we can leave out the edges labelled by 0:

Like last time, the graphs I’m talking about are simple: undirected, with no edges from a vertex to itself, and at most one edge from one vertex to another. So:

Theorem. Any finite simple graph with edges labelled by positive numbers gives a Dirichlet operator, and conversely.

We already talked about a special case last time: if we label all the edges by the number 1, our operator H is called the graph Laplacian. So, now we’re generalizing that idea by letting the edges have more interesting labels.

What’s the meaning of this trick? Well, we can think of our graph as an electrical circuit where the edges are wires. What do the numbers labelling these wires mean? One obvious possibility is to put a resistor on each wire, and let that number be its resistance. But that doesn’t make sense, since we’re leaving out wires labelled by 0. If we leave out a wire, that’s not like having a wire of zero resistance: it’s like having a wire of infinite resistance! No current can go through when there’s no wire. So the number labelling an edge should be the conductance of the resistor on that wire. Conductance is the reciprocal of resistance.

So, our Dirichlet operator above gives a circuit like this:

Here Ω is the symbol for an 'ohm', a unit of resistance… but the upside-down version, namely ℧, is the symbol for a 'mho', a unit of conductance that’s the reciprocal of an ohm.

Let’s see if this cute idea leads anywhere. Think of a Dirichlet operator H: n n as a circuit made of resistors. What could a vector ψ n mean? It assigns a real number to each vertex of our graph. The only sensible option is for this number to be the electric potential at that point in our circuit. So let’s try that.

Now, what’s

ψ,Hψ?\langle \psi, H \psi \rangle ?

In quantum mechanics this would be a very sensible thing to look at: it would be gives us the expected value of the Hamiltonian H in a state ψ. But what does it mean in the land of electrical circuits?

Up to a constant fudge factor, it turns out to be the power consumed by the electrical circuit!

Let’s see why. First, remember that when a current flows along a wire, power gets consumed. In other words, electrostatic potential energy gets turned into heat. The power consumed is

P=VIP = V I

where V is the voltage across the wire and I is the current flowing along the wire. If we assume our wire has resistance R we also have Ohm’s law:

I=V/RI = V / R

so

P=V 2R\displaystyle{ P = \frac{V^2}{R} }

If we write this using the conductance C=1/R instead of the resistance R, we get

P=CV 2P = C V^2

But our electrical circuit has lots of wires, so the power it consumes will be a sum of terms like this. We’re assuming H ij is the conductance of the wire from the ith vertex to the jth, or zero if there’s no wire connecting them. And by definition, the voltage across this wire is the difference in electrostatic potentials at the two ends: ψ iψ j. So, the total power consumed is

P= ijH ij(ψ iψ j) 2\displaystyle{ P = \sum_{i \ne j} H_{i j} (\psi_i - \psi_j)^2 }

This is nice, but what does it have to do with ψ,Hψ?

The answer is here:

Theorem. If H: n n is any Dirichlet operator, and ψ n is any vector, then

ψ,Hψ=12 ijH ij(ψ iψ j) 2\displaystyle{ \langle \psi , H \psi \rangle = -\frac{1}{2} \sum_{i \ne j} H_{i j} (\psi_i - \psi_j)^2 }

Proof. Let’s start with the formula for power:

P= ijH ij(ψ iψ j) 2\displaystyle{ P = \sum_{i \ne j} H_{i j} (\psi_i - \psi_j)^2 }

Note that the sum includes the condition ij, since we only have wires going between distinct vertices. But the summand is zero if i=j, so

P= i,jH ij(ψ iψ j) 2\displaystyle{ P = \sum_{i, j} H_{i j} (\psi_i - \psi_j)^2 }

Expanding the square, we get

P= i,jH ijψ i 22H ijψ iψ j+H ijψ j 2\displaystyle{ P = \sum_{i, j} H_{i j} \psi_i^2 - 2 H_{i j} \psi_i \psi_j + H_{i j} \psi_j^2 }

The middle term looks promisingly similar to ψ,Hψ, but what about the other two terms? Because H ij=H ji, they’re equal:

P= i,j2H ijψ iψ j+2H ijψ j 2\displaystyle{ P = \sum_{i, j} - 2 H_{i j} \psi_i \psi_j + 2 H_{i j} \psi_j^2 }

And in fact they’re zero! Since H is infinitesimal stochastic, we have

iH ij=0\displaystyle{ \sum_i H_{i j} = 0 }

so

iH ijψ j 2=0\displaystyle{ \sum_i H_{i j} \psi_j^2 = 0 }

and it’s still zero when we sum over j. We thus have

P=2 i,jH ijψ iψ j\displaystyle{ P = - 2 \sum_{i, j} H_{i j} \psi_i \psi_j }

But since ψ i is real, this is -2 times

ψ,Hψ= i,jH ijψ¯ iψ j\displaystyle{ \langle \psi, H \psi \rangle = \sum_{i, j} H_{i j} \overline{\psi}_i \psi_j }

So, we’re done.   █

An instant consequence of this theorem is that a Dirichlet operator has

ψ,Hψ0\langle \psi , H \psi \rangle \le 0

for all ψ. Actually most people use the opposite sign convention in defining infinitesimal stochastic operators. This makes H ij0, which is mildly annoying, but it gives

ψ,Hψ0\langle \psi , H \psi \rangle \ge 0

which is nice. When H is a Dirichlet operator, defined with this opposite sign convention, ψ,Hψ is called a Dirichlet form.

Overview

Maybe it’s a good time to step back and see where we are.

So far we’ve been exploring the analogy between stochastic mechanics and quantum mechanics. Where do networks come in? Well, they’ve actually come in twice so far:

1) First we saw that Petri nets can be used to describe stochastic or quantum processes where things of different kinds randomly react and turn into other things. A Petri net is a kind of network like this:

The different kinds of things are the yellow circles; we called them states, because sometimes we think of them as different states of a single kind of thing. The reactions where things turn into other things are the blue squares: we called them transitions. We label the transitions by numbers to say the rates at which they occur. In stochastic mechanics these are nonnegative real numbers; in quantum mechanics they’re complex.

2) Then we looked at stochastic or quantum processes where in each transition a single thing turns into a single thing. We can draw these as Petri nets where each transition has just one state as input and one state as output. But we can also draw them as directed graphs with edges labelled by numbers:

Now the dark blue boxes are states and the edges are transitions!

Today we looked at a special case of the second kind of network: the Dirichlet operators. For these the ‘forward’ transition rate H ij equals the ‘reverse’ rate H ji, so our graph can be undirected: no arrows on the edges. And for these the rates H ii are determined by the rest, so we can omit the edges from vertices to themselves:

And the result can be seen as an electrical circuit made of resistors! So we’re building up a little dictionary:

  • Stochastic mechanics: ψ i is a probability and H ij is a transition rate (probability per time).

  • Quantum mechanics: ψ i is an amplitude and H ij is a transition rate (amplitude per time).

  • Circuits made of resistors: ψ i is a voltage and H ij is a conductance.

This dictionary may seem rather odd. But that’s good: if it weren’t odd, it wouldn’t give us any new ideas.

While odd, it’s actually well-known. We’ve been looking at the discrete version, where we have a finite set of states. But in the continuum, the classic example of a Dirichlet operator is the Laplacian H= 2. And then we have:

ddtψ= 2ψ\frac{d}{d t} \psi = \nabla^2 \psi

is fundamental to stochastic mechanics.

ddtψ=i 2ψ\frac{d}{d t} \psi = -i \nabla^2 \psi

is fundamental to quantum mechanics.

2ψ=ρ\nabla^2 \psi = -\rho

is fundamental to electrostatics.

Briefly speaking, electrostatics is the study of how the electric potential ψ depends on the charge density ρ. The theory of electrical circuits made of resistors can be seen as a special case, at least when the current isn’t changing with time.

I’ll say a lot more about this… but not today! If you want to learn more, this is a great place to start:

This free online book explains, in a really fun informal way, how random walks on graphs, are related to electrical circuits made of resistors. To dig deeper into the continuum case, try:

  • M. Fukushima, Dirichlet Forms and Markov Processes, North-Holland, Amsterdam, 1980.

category: blog