To fix this, first power down the Osmo if it is on. Then, make sure your clamp is centered and level, as having it too far on one side makes the weight uneven and can cause shakiness.
Once that is checked, make sure your Osmo clamp's white dots are aligned with the stabilizer arm when you connect the two.
If the problems persist, please reach out to Rolla support.