if it's an older router, then yeah, hook it straight up to a laptop or something via ethernet cable, and then go to the link provided above. should let you change any settings on it.
newer ones come with built in default network names and passwords, usually displayed on a sticker or something on the router itself.