Yes! Do get it out of there.
You can use pine shavings, aspen, and I've seen some use paper towels laid down over the bottom of the brooder too.
Any of those will do.
With shavings or anything small, just make sure they aren't eating lots of them.
I did start my chicks out with the larger pine shavings and watched closely until I was sure they were just eating the starter crumbles and not those.
You can also use the SEARCH on the bar on top of the page to find out anything you want to know about. If it's not been posted before, someone's always great to get a fast answer in.
Tons of stuff about raising chicks, feeding, housing etc.
I'd have had a nervous breakdown if not for this group! I was so nutso worrying about my chicks when I first started out last year!
Even though I'd read in books..what helped most was being able to read what was going on with other's chicks and how the problems were solved.
Good luck