So you are recording from one device (your Amp) via USB and playing your backing track through another audio device?
I'll have to give Reaper another try. Adobe Audition won't let me do this and I have to monitor through my Zoom G5 through my amp. Basically, recording and playback have to be through the same device. It's not too big of a deal, but not ideal.
Are you using a Windows PC?