I pick up o rings in the plumbing section of my local hardware store. The big box stores don't have bins of hardware. They carry a very limited selection all barcoded and such. Avoid them. Find a hardware store with bins of screws, bolts, nails, and o rings.
Another place to try is a Hydraulic supply house. A place that has repair parts for hydraulic systems and makes replacement hoses and such is another good source.
If in the US, the 1-1/16 inch ring fits my marshmallow cannon. You may need a slightly smaller size for the PVC instead of iron pipe. At about 20 cents US per small ring, I generally pick up the several near sizes and use one that fits best.
The size I have trouble finding is one to fit the 2 inch ABS pipe of my DWV cannon. They are either too small or too big.
You can order from here if you don't find a local supplier.
http://www.marcorubber.com/sizingchart.htm