How to hide elements which go beyond the canvas in Sketch?
Found the answer.
All layers should be placed inside the "canvas" or "artboard" layer.
E.g. If you start the document with the iPad Landscape template, all of your objects should stay inside of that layer, otherwise they can bleed out.
Try using a mask to hide the parts you don't want.