In search, why do we spend so much up front compute to ingest, process, and index all documents, only to generate an inverted index or maybe some embeddings?

There have been plenty of advancements in nlp and semantic representation.

But not so much innovation in novel indexes or ingestion time analysis and pre-compute.