Yes! Do get it out of there.
You can use pine shavings, aspen, and I've seen some use paper towels laid down over the bottom of the brooder too.
Any of those will do.
With shavings or anything small, just make sure they aren't eating lots of them.
I did start my chicks out with the larger...