brakes

Hi i have a 2016 Honda CRF230F and recently while i was cleaning out the brakes i noticed that the front caliper was moving up and down as well as squeaking quite a lot . I know that the caliper is supposed to sideways to allow the disc to realign, but i am not sure if it is supposed to be...