Yes. Don't use either of those.
Silicone Caulk is not gluing PVC pipe and fittings together.
Grey PVC Adhesive/Sealant is for gluing together the Grey PVC used for electrical conduit.
Use Purple Primer to clean your pipe. Then use either Christies "Wet & Dry" or "Hot Blue" from Oatey. I...