I agree with sourland in blocking off the compost heap way before they choose nest sites. Once they've chosen, they're not likely to change their minds. Also, you could try giving them fake eggs or golf balls to encourage them to like the new nest site better.
My goose does lots of house shopping every spring. She'll inspect many possible sites, and she seems partial to smaller roofed structures, partially open with a good view of the premises. She'll stand in front of for instance a wood shed, look inside it, and say a whispered "hhhhaaaaf" a lot. If there's straw or hay she'll do a little nest-building tryout. Luckily, she's always ended up choosing the goose house to build her nest in.
When she starts showing the house shopping behavior - at least a month before she starts laying - I put straw in the goose house, arrange it roughly like a nest, and put a golf ball or two in it. She'll roll the golf balls and talk to them. Sometimes she'll even sit on them for a little while. She still spends most of her day doing normal goose stuff outside, but she'll check in on the nest and the golf ball eggs once or twice daily. Most days she just stays in the house a bit longer, maybe an hour after the door is opened. Up until she starts laying, she'll spend more and more time arranging the straw. The rest of the year she's only in the goose house at night, even though she always has access to it.