That's how I do it also.
@sunflour just put the bananas in the freezer with peel on. To thaw I just leave them overnight in the fridge on a plate. They turn to banana mush when thawed, but that is fine for baking.
