Instead, you need to use a third party application. PowerPoint 2004 does not natively have this capability. PowerPoint 2008 and PowerPoint 2011 both include support for Apple’s remote. Here are some instructions for getting this set up.
You can use Apple’s infrared (IR) remote control to control slideshows in PowerPoint 2004, PowerPoint 2008 and PowerPoint 2011.