If you are done with the garden for this year, go for it. If not, just stockpile it close and before you put the garden to bed for the winter, spread a good layer on top and till it in.
I hot compost my bedding with the idea of "cleaning" it. Then I till it in and wait a season.
It only requires some common sense. Whether or not you are growing root crops, there is a layer of mulch to protect from splash back, etc. Is the produce ever coming into contact with the amendments, etc.