You can add and remove grid lines from your chart under Presentation properties for the graph area. Click the background of the graph area to access the grid lines group under Presentation properties at the top of the window. Here you can uncheck horizontal/vertical lines.
