"There. That's the moment that created a new universe."
- The Watcher in Episode 1 of What If...? when Peggy Carter decides to not go to the booth.
But this was stated by someone else explaining the Multiverse and Time Travel:
"This is what we saw in Marvel Studios’ What if…?. All of these universes had existed since the beginning of time and were following the same path as the main Marvel Cinematic Universe (Earth-199999), but they diverged from that path.
It is important to note that they were NOT CREATED then. A universe CANNOT be created after the Big Bang. That would violate the First Law of Thermodynamics. Instead, all universes were created from the Big Bang..."
Does this actually apply? When a new branch timeline is created, did the universe of that branch timeline already exist as an identical duplicate of the main universe until it's divergence? Or is it a paradoxical effect where a new divergent universe is born at the beginning of time when the branch timeline is created?