My 'small' camera is a Canon 770IS. It's about as small as they get, and IIRC, it was about $200. Doesn't take AA's, though, so for bikepacking you'd have to carry the charger or be limited to a few days of pics. I've used it on ~3 day trips with a single battery.
Pic from this weekend's ride: