Looking at the schematics, the left and right mouse buttons go to Alice and the CIA (U350), but the POT_0X, and 0Y (as well as _1X and 1Y) signals go to Paula for the movement of the mouse (pins 35 & 36, and 38 & 39).
The joystick signals (forward, back, left, and right) however go through U975.