we were originally going to shell out for a good new Zealand Buck and three California whites, but after some more digging into the colony vs cage ordeal, I'm reading some truly awful horror stories of Zealands' attitudes in and out of cages.

When I was a kid, I had about 100 New Zealand Whites (NZW) at one point, in wire cages. We kept them for meat, not as pets. I don't know what you expect from their attitude, but I never picked up my NZW without have on a long sleeve jacket. Even then, I would occasionally get a bad scratch or two. I was told that you really have to spend time with the baby rabbits, holding them often, if you want them to be more calm when you handle them as adults. But, that is not why I had rabbits. I would think that raising rabbits in a colony would be even more of a challenge to "taming" the rabbit's instinct to run away from you.
The last time I raised rabbits, I got a California White trio. Unfortunately, I was unsuccessful in breeding them and they all died during the winter. They were purebred rabbits, the most I ever paid for any rabbits, and they never had litters and just died when winter came. They sure were pretty rabbits, and in theory, should have made great meat rabbits for me. I am not convinced it was all the rabbit's fault, but I do think they needed more shelter from the winter cold than I was able to provide for them at the time.
Also, I would suggest trying to keep the pedigree lines pure. The New Zealand White is a great meat rabbit, but takes longer to reach harvest than the California White. If you plan on selling any of your rabbits for breeding, I don't think a NZW/California cross would be much of a selling point. And, thinking out loud, a NZW/California cross might only result in a smaller rabbit than the NZW that takes longer to reach harvest weight than the California White.
But, if that is what you decide, I hope it works out for you and you update this thread with your results. Again, I appreciate this discussion and the idea of colony rabbits - which I have never done, but am considering to try someday.