actually you were right...some companies such as Kemper Life, require to be licensed in each particular county you write business in. I've heard of other companies doing this as well...
Just ask you UPLINE what the procedure is, for each particular county
The registration by county for non-res is is supposed to be only if you're physically conducting business in that county. It isn't a separate license, but some carriers will require the fee anyway.
Your last sentence is the best advice.