Remove xref from the scene (an object that has entered the scene and is not movi