Partial Differentiation - Theory & Concepts

Partial Differentiation

Learning Objectives

Define and compute partial derivatives for functions of multiple variables, identifying variables to hold constant.
Apply the Second Partials Test (Hessian matrix discriminant) to rigorously classify relative maxima, minima, and saddle points on 3D surfaces.
Employ the method of Lagrange Multipliers to solve constrained optimization problems commonly found in engineering design.
Utilize the multivariable Chain Rule and Implicit Function Theorem to differentiate complex, interdependent parameter systems.
Compute and geometrically interpret the Gradient Vector, understanding its relationship to steepest ascent and orthogonal level curves.
Apply Total Differentials to approximate multidimensional functional changes and estimate compound measurement errors.

Real-world civil engineering and physical science problems rarely involve just one isolated variable. The bending stress in a structural beam depends simultaneously on the applied load, beam length, and the geometric properties of its cross-section. The flow rate in a pipe depends on pressure, viscosity, and diameter. To rigorously analyze and optimize these multidimensional systems, we must transition from single-variable calculus to multivariable calculus, utilizing partial differentiation to isolate the effect of individual variables.

Functions of Several Variables

Multivariable Function

A function $z = f(x, y)$ assigns a unique output $z$ for every independent input pair $(x, y)$ in its domain. The geometric graph of such a function forms a surface in 3D Cartesian space.

Partial Derivatives

When we differentiate a function of multiple variables, we must specify which variable is changing while strictly holding all other independent variables constant. This isolated rate of change is called a partial derivative. Geometrically, taking the partial derivative with respect to

x

(

f_x

) represents the slope of the tangent line to the surface

z = f(x,y)

in a cross-section plane parallel to the xz-plane.

Notation

$\frac{\partial z}{\partial x}$ or $f_x$ : Partial derivative with respect to $x$ (treat $y$ as constant).
$\frac{\partial z}{\partial y}$ or $f_y$ : Partial derivative with respect to $y$ (treat $x$ as constant).
Note the use of the "curly d" symbol ( $\partial$ ).

Interactive Simulation

Use the simulation below to explore partial derivatives.

Partial Derivatives

Visualizing Surface: $z = 0.5(x^2 - y^2)$
Red Arrow: Slope along x-axis ( $\partial z / \partial x$ )
Green Arrow: Slope along y-axis ( $\partial z / \partial y$ )

x position0.50

y position0.50

z value:0.00

Slope X (

\partial z/\partial x

):0.50

Slope Y (

\partial z/\partial y

):-0.50

Drag to Rotate | Scroll to Zoom

Higher-Order Partial Derivatives

Just like single-variable functions, we can take second derivatives.

Second-Order Partial Derivatives:

$f_{xx} = \frac{\partial^2 z}{\partial x^2}$
$f_{yy} = \frac{\partial^2 z}{\partial y^2}$
$f_{xy} = \frac{\partial^2 z}{\partial x \partial y}$ (Mixed partial: differentiate w.r.t $x$ then $y$ )
$f_{yx} = \frac{\partial^2 z}{\partial y \partial x}$ (Mixed partial: differentiate w.r.t $y$ then $x$ )

Clairaut's Theorem

Clairaut's Theorem: If the mixed partial derivatives are continuous, then the order doesn't matter: $f_{xy} = f_{yx}$ .

Extrema of Functions of Two Variables (Second Partials Test)

To find the relative maxima and minima of a surface

z = f(x, y)

, we first find critical points where

f_x = 0

and

f_y = 0

. Then, we use the Second Partials Test (involving the Hessian determinant) to classify them.

The Second Partials Test

STEP-BY-STEP

Find all critical points $(a, b)$ such that $f_x(a, b) = 0$ and $f_y(a, b) = 0$ .
Compute the second partial derivatives: $f_{xx}$ , $f_{yy}$ , and $f_{xy}$ .
Evaluate the discriminant (Hessian determinant) at $(a, b)$ : $D = f_{xx}(a, b) f_{yy}(a, b) - [f_{xy}(a, b)]^2$

Classify the point based on $D$ :

If $D > 0$ and $f_{xx}(a, b) > 0$ , then $f(a, b)$ is a local minimum.
If $D > 0$ and $f_{xx}(a, b) < 0$ , then $f(a, b)$ is a local maximum.
If $D < 0$ , then $(a, b)$ is a saddle point (neither max nor min, looks like a horse saddle).
If $D = 0$ , the test is inconclusive.

Lagrange Multipliers

Optimization problems in engineering design almost always come with strict physical or economic constraints. For instance, determining the dimensions of a cylindrical water tank that maximizes storage volume given a fixed budget for surface area material. The method of Lagrange Multipliers is a powerful analytical technique to solve these constrained optimization problems without needing to explicitly parameterize the constraint.

Method of Lagrange Multipliers

To maximize or minimize $f(x, y, z)$ subject to the constraint $g(x, y, z) = c$ , we find the points where the gradient of $f$ is parallel to the gradient of $g$ . This introduces a scalar parameter $\lambda$ (lambda).

Method of Lagrange Multipliers

Gradient relationship for constrained optimization.

\nabla f = \lambda \nabla g

Variables

Symbol	Description	Unit
$\nabla f$	Gradient of the objective function	-
$\lambda$	Lagrange multiplier	-
$\nabla g$	Gradient of the constraint function	-

This expands into a system of equations:

f_x = \lambda g_x

f_y = \lambda g_y

f_z = \lambda g_z

, along with the original constraint

g(x,y,z) = c

. Solving this system yields the constrained critical points.

Chain Rule for Several Variables

z = f(x, y)

where

x

and

y

are themselves functions of another variable

t

, then the total derivative of

z

with respect to

t

is:

Chain Rule for Several Variables

Total derivative with respect to a parameter t.

\frac{dz}{dt} = \frac{\partial z}{\partial x}\frac{dx}{dt} + \frac{\partial z}{\partial y}\frac{dy}{dt}

Variables

Symbol	Description	Unit
$\frac{dz}{dt}$	Total derivative of z with respect to t	-
$\frac{\partial z}{\partial x}, \frac{\partial z}{\partial y}$	Partial derivatives of z	-
$\frac{dx}{dt}, \frac{dy}{dt}$	Derivatives of intermediate variables	-

Implicit Partial Differentiation

Often, an equation

F(x, y, z) = 0

defines

z

implicitly as a function of

x

and

y

. Instead of solving for

z

, we can find the partial derivatives using the Implicit Function Theorem.

To find the partial derivative of

z

with respect to

x

y

Implicit Partial Derivative (w.r.t x)

Finding partial derivative implicitly.

\frac{\partial z}{\partial x} = -\frac{F_x(x, y, z)}{F_z(x, y, z)}

Variables

Symbol	Description	Unit
$\frac{\partial z}{\partial x}$	Partial derivative of z with respect to x	-
$F_x, F_z$	Partial derivatives of implicit function F	-

Implicit Partial Derivative (w.r.t y)

Finding partial derivative implicitly.

\frac{\partial z}{\partial y} = -\frac{F_y(x, y, z)}{F_z(x, y, z)}

Variables

Symbol	Description	Unit
$\frac{\partial z}{\partial y}$	Partial derivative of z with respect to y	-
$F_y, F_z$	Partial derivatives of implicit function F	-

Where

F_x

F_y

, and

F_z

are the partial derivatives of the function

F

with respect to each variable, assuming

F_z \neq 0

The Gradient Vector

The gradient of a function

f(x, y)

is a vector consisting of its partial derivatives. It plays a crucial role in determining the direction of steepest ascent on a surface.

The Gradient

For a function $f(x, y)$ , the gradient, denoted by $\nabla f(x, y)$ (read "del f"), is the vector:

The Gradient Vector

Vector of partial derivatives.

\nabla f(x, y) = \left\langle f_x(x, y), f_y(x, y) \right\rangle

Variables

Symbol	Description	Unit
$\nabla f(x, y)$	Gradient vector of f	-
$f_x, f_y$	Partial derivatives of f	-

Properties of the Gradient Vector

Key Properties:

The gradient vector points in the direction of the maximum rate of increase of the function.
The magnitude of the gradient vector, $|\nabla f|$ , gives the maximum rate of increase in that direction.
The gradient vector is always perpendicular (orthogonal) to the level curves of the function.

Directional Derivatives

The gradient tells us the rate of change in the directions of the axes and the direction of maximum change. But what if we want to know the rate of change in an arbitrary direction? The directional derivative provides this.

Directional Derivative

The directional derivative of $f(x, y)$ in the direction of a unit vector $\mathbf{u} = \langle u_1, u_2 \rangle$ is defined as the dot product of the gradient and the unit vector:

Directional Derivative

Rate of change in an arbitrary direction.

D_{\mathbf{u}}f(x, y) = \nabla f(x, y) \cdot \mathbf{u} = f_x(x, y)u_1 + f_y(x, y)u_2

Variables

Symbol	Description	Unit
$D_{\mathbf{u}}f(x, y)$	Directional derivative in direction u	-
$\nabla f(x, y)$	Gradient vector	-
$\mathbf{u}$	Unit direction vector	-
$u_1, u_2$	Components of unit vector u	-

Interactive Simulation

Use the simulation below to explore directional derivatives and gradient vectors on a contour map, illustrating steepest ascent and orthogonal level curves.

Gradient Vector Visualization

Surface: f(x, y) = x² + y²

Current State

Position (x, y)(0.00, 0.00)

∇f = <2x, 2y><0.00, 0.00>

Magnitude |∇f|0.00

Move your mouse over the grid. Notice how the red gradient vector always points directly outward from the origin, perpendicular to the circular level curves. This shows the direction of steepest ascent on the paraboloid surface.

Total Differentials

The total differential

dz

approximates the total change in

z

due to small simultaneous changes in

x

(

dx

) and

y

(

dy

Total Differential

Approximate total change in z.

dz = \frac{\partial z}{\partial x} dx + \frac{\partial z}{\partial y} dy

Variables

Symbol	Description	Unit
$dz$	Total differential of z	-
$\frac{\partial z}{\partial x}, \frac{\partial z}{\partial y}$	Partial derivatives	-
$dx, dy$	Differentials of independent variables	-

This principle is fundamental in engineering error analysis for experiments or surveys involving multiple measured variables. For instance, in surveying, if land area is calculated from independent length and width measurements that both have associated tolerances, the total differential provides an explicit mathematical bound for the maximum expected error in the computed area.

Engineering Applications

Partial differentiation is foundational in solid mechanics and fluid dynamics. For example, the stress and strain on a structural element are described by tensors derived from partial derivatives of displacement fields. The gradient vector is also heavily used in optimization algorithms to find structural configurations that minimize weight while meeting safety constraints.

Key Takeaways

Partial Derivatives measure the rate of change with respect to one variable while holding others constant. Geometrically, they represent the slopes of tangent lines in the x and y directions.
The Second Partials Test classifies critical points on surfaces as local max, min, or saddle points using the Hessian discriminant.
Lagrange Multipliers optimize multivariable functions subject to constraint equations.
The Chain Rule for multivariable functions sums the contributions from each intermediate variable.
The Gradient Vector points in the direction of steepest ascent and its magnitude gives the maximum rate of change. It is orthogonal to level curves.
Total Differentials approximate changes in multivariable functions, useful for total error estimation.

Previous TopicDifferentials and Approximations - Examples & Applications

Quiz Me

Next TopicPartial Differentiation - Examples & Applications

Prev Next

Quiz Me