Most of the time when new chick parents lament their chicks are afraid of them or don't like to be held it's because of the way you are handling them.
If your brooder is the type with high sides that sits on the floor, and you are reaching down into the box from above the chicks, it seems to the chicks that you are a predator diving at them from above, and their instinct is to run away screeching.
If you could re-make your brooder into one that sits at table level and enables you to access the chicks from the side (cardboard boxes are great for this) you will see immediate results in the way your chicks relate to you.
If you can't do anything to change your brooder, then slipping your hand down slowly into the brooder and then moving your hand horizontally toward the chicks feet, allowing the chick to step onto your hand, will help tremendously.
Your chicks are close to being old enough to move into the coop and run. This will also change the way they view you since they will be able to see all of you when you approach. This will improve the way they relate to you.