Click the background of the graph area. In the Border group under the Presentation properties tab, you can adjust settings for the chart border. To remove the border, set the width to “None”.
You can add and remove grid lines from your chart under Presentation properties for the graph area. Click the background of the graph area to access the grid lines group under Presentation properties at the top of the window. Here you can uncheck horizontal/vertical lines.