I think Mud slap / Stone edge is the best Rhydon moveset for attack as well as for defence (if you ever use it for defence). So, YES, definitely worth powering up!
I keep mine (13,15,15) powered up all the time and is the one i use to wipe out Snorlax, Dragonite, Gyarados, and whoever else stand on the way!
Rhyhorn 100%
100% level 26 mud slap / stone edge
power up or not..??
have 1.3m dust and 100+ candy
Answers
Depends on what else you have.
For defense, no matter the moveset, it's a "bad defender", but since it has high CP, it will sit high in gyms. Having said that if you have a snorlax or a blissey those too will sit high in gyms AND are actually good defenders.
As an attacker, level 26 is already high enough that it will defeat most pokemon you want to pair up against him with some dodging and picking the right match ups, plus it having 2 different move types makes him really only good against fire (the only shared strenght) type pokemon, which is not a very prevalent type these days.
I wouldn't power him up, unless I have nothing better (Snorlax, Blissey and Dragonite to a lesser extent) to put in a gym.