They will not pair up per color if you want them to breed true to color you will need to pair them up and keep them separated. I have had guineas for a long time and I can tell you it is difficult to know a lot about their breeding habits as they are quite private about it.
In my group there was one cock that was definitely the dominant one. I assumed he bred most of the females he wanted and the underlings took care of the rest. You should have one cock for every four to five females, at least that worked for me.
I had many cocks at one time and though they sort of got after each other, they are so quick and nimble they never seemed to do any damage to each other. I kept mine with my chickens for about a year with no problem, after that during the breeding season my cocks started beating the daylights out of my roosters and my hens.
They can get very aggressive that is for sure.
With guineas you should be prepared for just about anything. If you arent one to roll with the punches it could be a long relationship.
How close are you neighbors LOL
If you get all different colors they will breed in a very mixed up way and you can get just about anything. One pen per pair during breeding season if you want to keep colors intact