When looking at different breeds of rabbits to start your rabbitry with (and I use the word rabbity as an all encompassing term, whether you have 2 rabbits or 50) there are several questions you should ask yourself.
What purpose are my rabbits to be used for - Food/Meat, Pet, Fur, Show Stock or just for fun?
Once you decide this you can start narrowing down breeds. Breeds like New Zealand, Californian, and Silver Fox are great for meat and show, but I would't recommend New Zealand or Californians for pets or for fur production. If you are only looking for pet, maybe consider a small breed that are easier to find homes for like Lionheads or Mini Rex.
How much time do I have to devote to my new hobby?
If you only have a few minutes a day then breeds that require additional care, like angora's for coat care, may be off the list for you. Consider the time you have available when considering the number of rabbits to get as well.
How far are you willing to drive to get your rabbits?
Some breeds, Silver Fox included, are harder to find quality stock for. You may drive several hours up to several states to find good quality stock. I regularly have people from 3+ hours out and surrounding states come to my for Silver Foxes. Visa versa I have gotten rabbits from NC, MI, AR and all over to get the best stock I could. Now a breed like New Zealand are much more common, so finding decent stock may be easier.
All together the main point is that it's important to do your research prior to getting your first rabbits. Having all your supplies ready is one thing, but starting out with a breed that isn't going to help you meet your goals or expectations can ruin the dream quickly.
And like with any animal, remember that starting with quality is key. Not everyone wants to show their rabbit, but show stock is premium quality, and I recommend starting with the best. It's much harder and more costly to improve quality on poorly bred rabbits then to start with good stock from the beginning.