I've only had one convenience store manager ask me to leave my bike outside. Other than that, the small grocery and c-stores have never had a problem with me walking in with my bike. When I do lock it outside, I look for areas clearly visible from the window, lots of passersby, and/or security camera coverage. I like to use restaurants with walk-up windows or table service and outdoor seating. One of my favorites doesn't allow me to bring my bike into the seating area but I can chain it to the railing near an empty table and take a seat literally an arm's length away while food and drink are brought to me. The bike is out of sight and reach for only about a minute while I walk in through the front door.
BTW, small towns being safer is a myth. I know of several people who have lost their bikes or had attempted thefts in rural communities. I caught an individual trying to get a bike off of my hitch rack at a gas station in a town with a population of about 1,200. He had the two straps undone and had lifted the bike out of the cradles. If it hadn't been for the cable lock to the truck frame, he'd have been gone with the bike. Stupid thing was that it wasn't even my bike, it was a donation I was taking to a bike co-op in a larger town about 15 miles away, where the would-be thief could have earned a bike legitimately with a couple evenings' work (the co-op asks for 5 volunteer hours to earn a bike and helps the patron put it back into good working order, usually taking about another evening or two).