head to head
Neither is simply harder - they are hard in different places. Portal 2 demands more optimization; The Elder Scrolls IV: Oblivion demands more variance.

Optimization · Pure Optimization
A first-person puzzle game where seeing the solution is the whole skill.

Optimization · Pure Optimization
A free-form fantasy RPG where skill-leveling and spell-craft builds dominate.
Portal 2 leans Optimization (Pure Optimization); The Elder Scrolls IV: Oblivion leans Optimization (Pure Optimization).
Same score on execution - which means the number cannot separate them. The difference is in what each one asks of you.
Portal 2
Portal placement requires some precision but timing is lenient.
The Elder Scrolls IV: Oblivion
Real-time swing and block, modest demand
The Elder Scrolls IV: Oblivion leans a little harder on reads, though the gap is small.
Portal 2
No opponent; puzzles are static.
The Elder Scrolls IV: Oblivion
Scripted enemies
The Elder Scrolls IV: Oblivion leans clearly harder on variance.
Portal 2
Puzzles are deterministic with no randomness.
The Elder Scrolls IV: Oblivion
Loot and level-scaling rolls
Portal 2 leans clearly harder on optimization.
Portal 2
Solving the puzzle's logic IS the entire game.
The Elder Scrolls IV: Oblivion
Skill leveling, spell crafting, exploit-prone builds
A matching score does not mean a matching test. Two games can both sit at 10 on execution and demand completely different things of you - which is why the reasoning above matters more than the number beside it.