Instead of the caulking could you use cement in those cracks? maybe something like grout they use tiling floors?
We had a problem with our hens pecking and eating the styrofoam forms used for the basement foundation, the styrofoam should have been covered years before but hubby never got...