There are some good INI file tweaks you can make, listed at
http://www.tweakguides.com/Oblivion_4.html, also on the Oblivion Wiki
http://www.uesp.net/wiki/Oblivion:Ini_Settings
Presumably you have set your Nehrim Launcher settings to use Multiple Cores and Multiple Threading ?
Also turn your 2 Nehrim launcher sliders all the way to maximum if you have at least 4Gb RAM.
Many sites say that this will cause crashing problems, and they are kind of right, it will crash more than before because Oblivion is a 32bit program, and after afew hours of running it meets the 3.2Gb limit for 32bit apps and crashes, but it really does help performance.
Also, I have an ATI Radeon card, so I used ATITray tools to create a profile for Nehrim whereas when it runs it turns on Automatic Overclocking for the GFX card, and turns it off again when it exits.
If you are an NVidia person, im sure there is an equivalent tool to do the same.
NB - Obviously overclocking can damage your hardware if you are unlucky.