I spent half of yesterday figuring out this. So i am posting it here so that it will be reminder for me and for other’s 
. Here are the instructions…
- Select the worksheet.
- Goto Tools->Options->View tab – Windows Options section.
- Check or Uncheck Gridlines to show or hide them.