So much capital and engineering work has been put into scaling transformer based LLMs. It seems like there are lots of opportunities left in the wake of that focused effort.