If you dont need backward compatibilty (eg, with some older addins or supporting apps), then definitely use 64bit MS Office given a 64bit compatible machine.
The narrative is that 64bit programs, in generlal, will exhibit better performance & memory uses, particulary when involving large data...