If (hypothetically) everybody was a vegetarian, what would keep the animals from overrunning us?

If we no longer killed m numbers of animals for anything other than essential material goods what would keep their population from overtaking human populations?