Some of those cliff edges are set to a higher height than the player, or the building, is. You can adjust the settings in Tilesets, or alter your maps, as you see fit.
Because altering the settings can create new problems, the last time I had to deal with a problem like this, I instead used invisible blocker squares to keep the player from wandering onto the edges of certain areas.