Have you tried deleting it with testingcheats enabled? If you ctrl+shift+click the object, some options should come up. That is how you can clone or delete objects that you normally can't. What about if you delete the stairs?
I haven't seen boxes near stairs, but I get a similar box inside a fountain from time to time.