Dhimmi and the pact of Umar, I'm confused!?

I know they were non-muslims living in muslim territory, but were they all considered dhimmi or just part of them? In others words, were all non-muslims protected under the pact of Umar?