Switching when you did was fine. It is normal to see that reaction when switching feeds whether it is a different shape (crumbles to pellets) or a different brand. The grower that I use is 24% protein and is even finer than the starter crumbles.
Mine don't go on pellets until they are getting...