The main difference is (simple) calculators are deterministic and monotonic. Meaning it executes a set of instructions in a predetermined way to produce its output. Bringing LLMs to that level is a whole another ball game. But we'll see, perhaps the arithmetic nature of algorithms will be replaced by a whole lot of tensors in the near future.