I pick up o rings in the plumbing section of my local hardware store.  The big box stores don't have bins of hardware.  They carry a very limited selection all barcoded and such.  Avoid them.  Find a hardware store with bins of screws, bolts, nails, and o rings.
Another place to try is a Hydraulic supply house.  A place that has repair parts for hydraulic systems and makes replacement hoses and such is another good source.
If in the US, the 1-1/16 inch ring fits my marshmallow cannon.  You may need a slightly smaller size for the PVC instead of iron pipe.  At about 20 cents US per small ring, I generally pick up the several near sizes and use one that fits best.
The size I have trouble finding is one to fit the 2 inch ABS pipe of my DWV cannon.  They are either too small or too big.
You can order from here if you don't find a local supplier.
http://www.marcorubber.com/sizingchart.htm