Also, I just want to mention, I really don't like the first-person weapon controls in the N64 versions of OoT and MM. They feel really stiff, and it's hard to do things like shooting galleries that were really easy on the 3DS.
Are you playing with an actual N64 controller with an official Nintendo branded analog stick? If not, you're either going to have a terrible experience or a sub-par experience. Pretty much the N64 controller (or the console, no one has figured out the precise workings of the mechanic yet) does something weird with the sensitivity of the analog stick, resulting in a very wide degree of sensitivity and a excellent sensitivity slope (You have excellent control over your characters movements, aiming etc).
I have yet to see an emulator (including Nintendo's various Virtual Consoles) that can imitate the original analog stick experience when using a different gamepad. The typical result with other controllers (Xbox360 controller, Wii Classic Pro Controller, Wii Classic Controller, Wii U Gamepad, Wii U Pro Controller etc.) is hyper sensitivity where small adjustments to the analog stick result in big adjustments in the game making it difficult to aim things (Banjo Tooie's flight aiming is an excellent demonstration of this, as is aiming the Bow, slingshot, boomerang etc. in the Zelda games), hard to walk & tiptoe in Mario 64, Banjo Kazooie/Tooie etc. and hard to get your character to face the exact direction you want to face.
I assume you're playing on the virtual console, so you're going to experience hyper sensitivity with the analog stick, resulting in a very sub par experience which isn't at all representative of how the game controls on an actual N64.
Edited by Nicholas Steel, 04 February 2017 - 09:18 AM.