I have handled mine from the very beginning, whether I hatched them or got them as chicks. They do go through at "teenage" stage where they freak out no matter what when you try to pick them up or hold them. Just keep it up, and give them treats like sweet corn and melon so they start to relate...
I got my first three silkies at TSC of all places! Simply pet quality, but just loved them! All three were taken be a hawk the following fall and I became somewhat preoccupied with getting more. I do have more now, and have been hatching eggs from my own silkies. Once again, pet quality but...