Changing it in your computer will work. But wont help other computers on your network. Its a good first step in troubleshooting though. If you are familiar with setting the DNS on your computer, do that first. Then you can use the internet (assuming it works) to find out how to input them into your router.