You can also cast your own bullets. This works especially well for pistol bullets. Generally, cast pistol bullets are as accurate as jacketed bullets. Getting into casting is not cheap, You can look at Powder Valley, Midway, Cabelas to get an idea of prices. Once the equipment is bought, the expense is slight. Lead can be scrounged usually. Sources? Fired bullets from a fireing range, damaged wheel weights from a tire store(not free), or wheel weights from the sides of roads. There are a surprising number of wheel weights lost. Don't use old car batteries, they contain arsenic, I'm told, but anyway the trouble of breaking down batteries is not worth it.
You can also buy cast or swaged bullets commercially, maybe a nickle each, again, look at power valley. You can use cast bullets in rifles but at reduced velocities since friction from the air starts to melt lead bullets and make them inaccurate at about 2000 fet per second.