After doing some final tests today, I've decided to call sound "finished" on the Raspberry Pi. It is playing fine now with no stuttering. Occasional stuttering is still possible if serial communication has random errors; this is still rare though.
Next step is getting the Dexter USB port working without performance penalties on the Raspberry Pi. After that, then I would say the Pi is ready for people to start testing with Dexter.