Structured Inference with Large Language Gibbs
This work proposes Large Language Gibbs, a scheme for structured probabilistic inference that uses conditional distributions of an LLM as transition operators, and iteratively resample individual variables conditioned on others using an LLM's next-token conditionals to produce a stationary distribution.