How are you fastening them? You should be using screws that have foam type washers under them. Are the fasteners pulling out of the wood or are holes being ripped in the panel and the fasteners still stuck in the wood?
Also, most of those panels also have closure strips that you use with...