Tejaswi Gowda

Decompose, Don't Expand: Capability-Independent AI Systems by Construction

It is claimed that many tasks commonly delegated whole to a model are in fact deterministic tasks with a small generative core, and decomposing such a task yields a measurable and desirable property the authors call parity by construction: on the extracted sub-tasks the model-size performance curve becomes flat, becaus...