Parts of a medieval castle's walls have become "damaged" and "unstable" following recent bad weather, a council has warned.