You can put an axes as the background for your app and add a startup function to populate it with your image file.
myImage = imread('peppers.png');
You will want to set UIAxes title, xLabel, yLabel to blank in the Property Editor on the lower right. And XTick and YTicks = 
Best of luck.