Density Functional Theory
This page is being developed in two layers. The first section is written as full instructional content, while the remaining sections are kept as a detailed outline so the larger chapter can grow in a consistent way. The long-term goal is a complete DFT chapter with formal derivations, practical examples, and software-facing guidance.
Scope and Learning Goals
This chapter should eventually explain:
- why DFT is formulated in terms of the electron density rather than the full many-electron wavefunction
- how the Hohenberg-Kohn and Kohn-Sham constructions define the modern DFT framework
- what exchange-correlation functionals do, how they are organized, and where they succeed or fail
- how DFT is implemented numerically for molecules and periodic solids
- how practical DFT workflows are designed, converged, and interpreted
1. Why Density Functional Theory Exists
Density Functional Theory exists because the electronic structure problem is too important to ignore and too expensive to solve exactly for most systems of chemical interest. The theory is built on a simple but profound shift in point of view: instead of treating the many-electron wavefunction as the only useful basic variable, it asks whether the ground-state electron density can serve as the central object of the theory. That shift is what makes DFT both powerful and practical.
1.1 The many-electron problem
Most electronic structure methods begin with the nonrelativistic electronic Schrodinger equation under the Born-Oppenheimer approximation. In that approximation, the nuclei are treated as fixed point charges, and the electrons move in the external electrostatic field generated by those nuclei. The electronic Hamiltonian can be written as
where
is the electronic kinetic energy,
is the electron-nuclear attraction, and
is the electron-electron repulsion. The stationary equation is then
where each \mathbf{x}_i includes both spatial and spin coordinates.
The key difficulty is not simply that there are many electrons. The real
difficulty is that the electron-electron repulsion term couples all of them.
Because of that coupling, the exact wavefunction is not a collection of
independent one-electron functions. It is a many-body object defined over a
high-dimensional space. For N electrons, the wavefunction depends on 3N
spatial variables plus spin labels, and it must encode how every electron
avoids every other electron while remaining bound to the nuclei.
This is why the exact many-electron problem becomes hard so quickly. Even when the Hamiltonian itself is compact, the state being solved for is information rich, correlated, and high dimensional. That is the central challenge from which the rest of electronic structure theory follows.
1.2 The cost barrier of wavefunction methods
Wavefunction methods confront this problem directly by approximating the
many-electron state \Psi. Full configuration interaction is formally exact
within a chosen one-particle basis, but the determinant expansion grows
combinatorially and rapidly becomes intractable. More practical methods such as
Moller-Plesset perturbation theory, truncated configuration interaction,
coupled cluster theory, and multireference approaches reduce that cost in
different ways, but they all inherit the same basic burden: they still work
with a high-dimensional wavefunction or quantities derived from it.
This is where cost becomes decisive. A method that is elegant and systematically improvable may still be unusable for the systems one actually wants to study. Even polynomial scaling can be prohibitive when the system contains many atoms, when the basis set is large, when periodic sampling is required, or when the calculation must be repeated many times inside a geometry optimization, molecular-dynamics simulation, defect study, or screening workflow. In practical computational chemistry, one rarely needs just one energy. One needs many energies, many forces, and many structures.
That pressure motivates a different question. If the exact wavefunction is too expensive to use directly, is there another basic variable that is much simpler but still sufficient to determine the ground-state energy? DFT becomes possible because the answer to that question is yes, at least in principle, for the ground state.
1.3 Why the electron density is appealing
The electron density is appealing because it is dramatically simpler than the wavefunction. Instead of depending on all electron coordinates at once, the ground-state density depends only on position in three-dimensional space:
No matter how many electrons are present, the density remains a function of only three spatial variables. That reduction is conceptually enormous. It turns an intractable object into one that can be visualized, integrated, compared between structures, and connected directly to chemical intuition.
The density is also physically meaningful. Bonding, charge accumulation, charge depletion, polarization, electron transfer, and shell structure all leave signatures in the density. Many of the qualitative pictures chemists use to describe molecules and materials are really informal interpretations of density redistribution. In that sense, the density is not just a mathematical shortcut; it is already close to the way we often think about electronic structure.
But usefulness alone is not enough. The real DFT question is stronger: can the exact ground-state energy be written as a functional of the electron density alone? If so, then the density is not just a helpful summary of the wavefunction. It is a complete ground-state variable in its own right. The formal answer to that question comes from the Hohenberg-Kohn theorems, but the intuitive appeal of the density is what makes those theorems worth caring about.
1.4 Domains where DFT became dominant
DFT became dominant because it occupies a uniquely useful middle ground between accuracy and cost. It is not exact in practice, because the exchange-correlation functional must be approximated, but it is far more affordable than high-level wavefunction methods and far more broadly applicable than empirical force fields. That combination made it the default electronic structure framework for a wide range of chemically and physically important problems.
In molecular chemistry, DFT became a standard tool for geometry optimization, reaction energetics, thermochemistry, spectroscopy support, and exploratory mechanistic studies. In surface science and catalysis, it enabled routine comparisons of adsorption configurations, intermediates, and reaction trends across candidate materials. In condensed matter and materials modeling, especially in plane-wave implementations, DFT became central to crystal structure prediction, defect energetics, band structure analysis, lattice dynamics, and bulk property calculations.
Just as importantly, DFT is affordable enough to be embedded inside larger workflows. Geometry optimization requires repeated energy and force evaluations. Ab initio molecular dynamics requires them at every time step. High-throughput materials screening requires them across large chemical spaces. A method that is accurate but too expensive cannot become the workhorse of computational chemistry. DFT became that workhorse because it is usually accurate enough for useful predictions and cheap enough to run repeatedly.
That success should not be mistaken for a claim that DFT is universally reliable. DFT is a framework, not a single approximation, and its performance depends strongly on the functional, the numerical setup, and the class of problem being studied. Still, the reason it exists is clear: it offers a route to realistic electronic structure calculations by replacing the impossible direct treatment of the full many-electron wavefunction with a theory built around the much simpler electron density.
2. The Electron Density as the Basic Variable
2.1 Definition of the electron density
- Define the one-particle density from the many-electron wavefunction.
- Emphasize normalization to the total electron count.
- Distinguish total density, spin density, and related reduced quantities.
2.2 Physical interpretation
- Probability-density interpretation.
- Density peaks near nuclei and in bonding regions.
- Relationship to observable charge redistribution.
2.3 Representability issues
- Introduce the ideas of
N-representability andv-representability. - Explain why not every positive function is a valid physical density.
- Flag where these formal constraints matter in practical DFT.
2.4 What the density can and cannot tell us directly
- Ground-state energy and external potential in principle.
- Derived observables such as forces and moments.
- Limitations for excited states, correlated response, and dynamical behavior.
3. Exact Formal Foundations
3.1 The first Hohenberg-Kohn theorem
- One-to-one mapping between the ground-state density and the external potential, up to a constant.
- Consequences for the Hamiltonian and all ground-state observables.
- Conditions under which the theorem is stated.
3.2 The second Hohenberg-Kohn theorem
- Variational principle for the density.
- Energy minimization over admissible densities.
- Interpretation of the exact ground-state density as the minimizing density.
3.3 The universal functional
- Define the formal universal functional
F[n]. - Separate universal and system-specific parts of the energy.
- Explain why the formal existence theorem does not yet give a practical method.
3.4 Levy constrained search formulation
- Reformulate DFT without relying on
v-representability subtleties. - Define the constrained minimization over wavefunctions yielding a chosen density.
- Clarify why this strengthens the conceptual foundation of DFT.
3.5 Lieb formulation and mathematical structure
- Mention convex analysis and rigorous functional definition.
- Introduce ensemble considerations and fractional particle number in the exact theory.
- Reserve this section for the mathematically precise treatment.
3.6 Limitations of the exact formalism
- Ground-state focus.
- Dependence on the unknown exact functional.
- Lack of direct constructive guidance for practical approximations.
4. The Kohn-Sham Construction
4.1 Why Kohn-Sham DFT is needed
- Explain why the exact kinetic energy of interacting electrons is hard to approximate directly from the density.
- Motivate the replacement by a noninteracting reference system.
4.2 Noninteracting reference system
- Define the fictitious noninteracting system with the same ground-state density.
- Explain the meaning and role of Kohn-Sham orbitals.
- Clarify that the orbitals are auxiliary quantities, not formally the true many-body wavefunction.
4.3 Energy decomposition
- Noninteracting kinetic energy.
- External potential energy.
- Classical Hartree energy.
- Exchange-correlation energy as the remainder.
4.4 Effective Kohn-Sham potential
- External potential contribution.
- Hartree contribution.
- Exchange-correlation potential as a functional derivative.
4.5 Kohn-Sham equations
- Introduce the one-electron eigenvalue problem.
- Define orbital occupations and density reconstruction.
- Explain the coupled nonlinear character of the equations.
4.6 Self-consistency
- Initial density guess.
- Build effective potential.
- Solve Kohn-Sham equations.
- Construct updated density.
- Repeat until convergence.
4.7 Total energy versus orbital eigenvalues
- Clarify why orbital eigenvalues are not generally observables.
- Explain the special role of the highest occupied eigenvalue in exact DFT.
- Flag common interpretive mistakes around HOMO-LUMO gaps and band gaps.
4.8 Spin-polarized Kohn-Sham DFT
- Separate alpha and beta densities.
- Spin-dependent exchange-correlation potentials.
- Open-shell systems and magnetic materials.
4.9 Fractional occupation and smearing
- Metallic systems and near-degenerate states.
- Thermal or numerical smearing in practical calculations.
- Relationship to convergence and free-energy-like quantities.
5. Exchange-Correlation Theory
5.1 What exchange-correlation collects
- Exchange effects from antisymmetry.
- Dynamic and static correlation effects beyond Hartree theory.
- Kinetic correlation contributions absorbed into the functional remainder.
5.2 Exact conditions for the exchange-correlation functional
- Uniform density scaling.
- Sum rules and normalization constraints.
- Spin scaling relations.
- Asymptotic potential behavior.
- Piecewise linearity with respect to particle number.
- Self-interaction freedom in the exact theory.
5.3 Why approximate functionals are needed
- The exact functional is unknown.
- Practical DFT rises or falls on the quality of the approximation.
- Functional choice becomes the central modeling decision.
6. Jacob's Ladder of Density Functional Approximations
6.1 Local Density Approximation (LDA / LSDA)
- Uniform electron gas as reference.
- Strengths for condensed matter and slowly varying densities.
- Typical overbinding tendencies and limitations for molecules.
6.2 Generalized Gradient Approximation (GGA)
- Dependence on density gradients.
- Improvement over local approximations for molecular chemistry.
- Representative families such as PBE and BLYP.
6.3 Meta-GGA functionals
- Dependence on kinetic energy density or Laplacian-like information.
- Better recognition of bonding environments.
- Representative examples such as SCAN and TPSS.
6.4 Global hybrid functionals
- Mixing exact exchange with semilocal exchange.
- Rationale from adiabatic connection or empirical fitting.
- Common examples such as B3LYP and PBE0.
6.5 Range-separated hybrids
- Short-range versus long-range exchange separation.
- Why long-range exact exchange matters for charge transfer and frontier orbital behavior.
- Representative examples such as HSE and omegaB97-type families.
6.6 Double hybrids
- Addition of perturbative correlation on top of hybrid DFT.
- Increased accuracy and increased cost.
- Relationship to wavefunction theory.
6.7 Empirical versus nonempirical functional design
- Constraint-based construction.
- Parameter fitting to benchmark sets.
- Transferability versus benchmark optimization.
6.8 Functional families to compare explicitly
- PBE, PBEsol, BLYP, B3LYP, PBE0, SCAN, HSE, omegaB97X, M06, and related families.
- Molecular versus solid-state use cases.
- Cost versus robustness tradeoffs.
7. Dispersion and Long-Range Correlation
7.1 Why semilocal DFT misses London dispersion
- Locality of the density ingredients.
- Nonlocal electron correlation at long range.
7.2 Empirical dispersion corrections
- DFT-D2, DFT-D3, DFT-D4.
- Parameterization philosophy.
- When pairwise corrections are sufficient or insufficient.
7.3 Nonlocal correlation functionals
- vdW-DF family.
- VV10-like nonlocal correlation.
- Tradeoffs relative to additive correction schemes.
7.4 Practical consequences
- Molecular crystals.
- Adsorption on surfaces.
- Layered materials and weak intermolecular complexes.
8. Numerical Representation of Kohn-Sham DFT
8.1 Basis-set choices for molecular DFT
- Gaussian basis functions.
- Contracted basis sets and basis hierarchies.
- Polarization and diffuse functions.
8.2 Basis-set choices for periodic DFT
- Plane waves.
- Energy cutoffs.
- Dual representations of orbitals and densities.
8.3 All-electron versus pseudopotential approaches
- Frozen-core approximation.
- Norm-conserving, ultrasoft, and PAW formalisms.
- Tradeoffs in accuracy and efficiency.
8.4 Numerical integration grids
- Radial and angular grids in molecular DFT.
- Grid sensitivity of meta-GGAs and some hybrids.
- Common artifacts from insufficient quadrature quality.
8.5 Brillouin-zone sampling
k-point meshes.- Metals versus insulators.
- Convergence with respect to reciprocal-space integration.
8.6 Boundary conditions and supercells
- Molecular vacuum boxes.
- Periodic replicas and finite-size artifacts.
- Charged systems under periodic boundary conditions.
9. Self-Consistent Field Algorithms and Convergence
9.1 Initial guesses
- Superposition of atomic densities.
- Core Hamiltonian or diagonalization-based guesses.
- Restart densities and wavefunction reuse.
9.2 Density mixing and acceleration
- Linear mixing.
- Pulay / DIIS mixing.
- Kerker-style preconditioning for periodic systems.
9.3 Convergence criteria
- Energy convergence.
- Density convergence.
- Force convergence for structure optimization.
9.4 Common convergence failures
- Charge sloshing.
- Near-degeneracy and metallic occupations.
- Spin-state instability.
- Poor initial geometry or bad basis/grid choices.
9.5 Strategies for robust convergence
- Smearing.
- Level shifting.
- Damping and mixing-parameter control.
- Symmetry reduction or symmetry disabling when necessary.
- Stepwise convergence from simpler to harder functionals.
10. Energies, Forces, and Response Properties
10.1 Total energies and energy differences
- Atomization energies.
- Reaction energies.
- Relative conformer and polymorph energies.
10.2 Forces and geometry optimization
- Hellmann-Feynman forces and Pulay corrections.
- Optimization algorithms and convergence thresholds.
- Vibrational analysis after optimization.
10.3 Electronic structure observables
- Orbital energies.
- Density of states.
- Band structure.
- Charge and spin density analysis.
10.4 Electric and magnetic properties
- Dipole moments and polarizabilities.
- NMR shielding and EPR-related properties.
- Magnetization and magnetic ordering in solids.
10.5 Vibrational and thermochemical quantities
- Harmonic frequencies.
- Zero-point energies.
- Thermal corrections and free-energy estimates.
10.6 Response theory and perturbative properties
- Linear response.
- Time-dependent extensions as a bridge to excited states.
- Phonons and density-functional perturbation theory for solids.
11. Molecular DFT Workflows
11.1 Single-point calculations
- Choosing a geometry source.
- Basis-set and functional selection.
- Interpreting total energies and orbital results.
11.2 Geometry optimization workflows
- Preoptimization strategies.
- Frequency validation for minima and transition states.
- Solvent or dispersion considerations.
11.3 Thermochemistry workflows
- Electronic energy plus vibrational corrections.
- Standard-state corrections.
- Practical limits of DFT thermochemistry.
11.4 Open-shell and spin-state workflows
- Restricted versus unrestricted formulations.
- Spin contamination and diagnostics.
- Spin-state ordering challenges in transition-metal chemistry.
11.5 Solvation models
- Continuum solvation.
- Explicit versus implicit solvent strategies.
- When solvent corrections qualitatively change conclusions.
12. Periodic and Materials DFT Workflows
12.1 Structure relaxation of crystals
- Cell and ion relaxation.
- Stress tensor and Pulay stress.
- Convergence with cutoff and
k-points.
12.2 Surface and slab calculations
- Slab thickness and vacuum spacing.
- Dipole corrections.
- Adsorption-energy protocols.
12.3 Electronic-structure analysis in solids
- Band structures.
- Projected density of states.
- Charge-density difference plots.
12.4 Metallic systems
- Occupation smearing.
- Fermi-surface sampling.
- Convergence challenges unique to metals.
12.5 Defects and supercells
- Finite-size error sources.
- Charge corrections.
- Supercell convergence strategies.
12.6 Phonons and lattice dynamics
- Finite-displacement versus perturbative approaches.
- Stability analysis and vibrational free energies.
- Coupling to thermodynamic and transport models.
13. Where DFT Works Well
13.1 Structural predictions
- Equilibrium bond lengths.
- Lattice parameters.
- Relative trends across related systems.
13.2 Broad energy trends
- Reaction trends within similar chemical spaces.
- Adsorption and binding trends with appropriate corrections.
- Screening studies where relative ranking matters more than chemical accuracy.
13.3 Large-system accessibility
- Why DFT became the default for medium-to-large electronic-structure simulations.
- Best use cases when a balance of cost and accuracy is required.
14. Known Failures and Diagnostic Red Flags
14.1 Self-interaction error
- Delocalization of charge.
- Fractional-charge pathologies.
- Overstabilized diffuse electron distributions.
14.2 Static correlation and multireference character
- Bond breaking.
- Near-degenerate states.
- Transition-metal and strongly correlated regimes.
14.3 Band-gap problem
- Kohn-Sham gap versus fundamental gap.
- Why semilocal functionals underestimate gaps.
- When hybrids or beyond-DFT methods are needed.
14.4 Charge-transfer problems
- Spurious low-energy charge-transfer states.
- Long-range exchange sensitivity.
- Importance of range separation.
14.5 Dispersion-sensitive systems
- Weak intermolecular binding.
- Layered materials.
- Adsorption without nonlocal corrections.
14.6 Spin-state and oxidation-state errors
- Transition-metal complexes.
- Functional sensitivity in spin ladders.
- Need for benchmarking against experiment or higher-level theory.
15. Beyond Standard Ground-State DFT
15.1 Time-Dependent DFT (TDDFT)
- Linear-response formulation.
- Excited states and spectra.
- Known TDDFT failure modes.
15.2 Constrained DFT and related embedding ideas
- Charge localization.
- Diabatic states.
- Fragment-based strategies.
15.3 DFT+U
- Correcting localized subspaces.
- Common use in transition-metal oxides and correlated materials.
- Parameter sensitivity and interpretation.
15.4 Orbital-dependent and self-interaction-corrected methods
- Exact exchange frameworks.
- Optimized effective potentials.
- Self-interaction correction ideas.
15.5 Multiscale and embedding approaches
- QM/MM.
- Density embedding.
- Subsystem DFT.
16. Choosing a Functional in Practice
16.1 Start from the scientific question
- Structure optimization.
- Thermochemistry.
- Spectroscopy.
- Bulk materials.
- Surfaces and adsorption.
16.2 Match the functional family to the problem class
- Semilocal choices for large screening workflows.
- Hybrids for improved orbital energetics and some molecular problems.
- Range-separated choices for charge transfer or long-range effects.
- Dispersion-corrected choices for noncovalent interactions.
16.3 Benchmarking strategy
- Compare against experiment where possible.
- Compare against higher-level theory on reduced models.
- Converge numerical parameters before blaming the functional.
16.4 Practical reproducibility checklist
- Functional and dispersion correction.
- Basis set or plane-wave cutoff.
- Pseudopotentials or PAW datasets.
- Integration grid.
k-point mesh and smearing.- Convergence thresholds and spin treatment.
17. Interpreting DFT Results Responsibly
17.1 Separate numerical error from model error
- Basis/grid convergence.
- SCF convergence.
- Finite-size and boundary-condition effects.
17.2 Distinguish robust trends from fragile absolute numbers
- Relative energies versus barrier heights.
- Molecular properties versus solid-state band gaps.
- Chemical trends versus quantitatively predictive claims.
17.3 Document assumptions and approximations
- Functional choice.
- Dispersion model.
- Solvent model.
- Temperature, pressure, and structural constraints.
18. Connections to Software and Workflows on This Site
18.1 DFT in VASP
- Plane waves, PAW, and periodic solids.
- Typical use cases in materials science and surface chemistry.
18.2 DFT in ORCA
- Molecular DFT with localized basis sets.
- Open-shell, spectroscopy, and thermochemistry workflows.
18.3 DFT in Quantum ESPRESSO
- Open-source periodic DFT.
- Structural, electronic, and vibrational-property workflows.
18.4 How this theory chapter should link outward
- Link to the software directory for implementation-specific details.
- Link to the Slurm guide for HPC deployment patterns.
- Link to future workflow pages on convergence and best practices.
19. Suggested End-State for This Chapter
The completed chapter should eventually contain:
- concise formal derivations where they clarify the theory
- intuition paragraphs for each major concept
- comparison tables for functional families
- practical convergence checklists
- worked molecular and periodic examples
- cross-links to software-specific execution guidance
20. Future Companion Pages
This outline is detailed enough that several subsections could later become standalone pages if the theory section expands:
- exchange-correlation functionals and Jacob's ladder
- self-consistent field convergence strategies
- molecular DFT workflows
- periodic DFT workflows
- DFT failure modes and diagnostics
- TDDFT and beyond-standard extensions