Apparently, portraits of ladies tying their garters and/or with their shoes falling off were considered quite the saucy thing in this era.
You can find a discussion of the construction of these stays, and many of the other undies featured in these pics, in Leimomi's costuming blog, The Dreamstress.com.