One thing I havent tried. Unfortunately ladybugs cost money and I don't
have any

A batch of ladybugs would be less expensive than most of the solutions
you've already tried. :-( I bought a batch online a couple seasons back --
they cleared up the aphid problem right quick and I can't say as I saw many
other pest insects. We also bought some other insects while we were at it
(mantids, silver lacewings, etc.) that have hung around. I think the total
on the order was something like 30 bucks including shipping. I tried to
find where I bought them but it looks like I did not bookmark it. :-(

Have you found any ladybugs floating about the yard? You could always catch
a few and "relocate" them to your moss rose.

With colder weather coming on I'd imagine this will not be much of an issue
(unless you're in a warm climate of course).

Good luck!!

James