Did you use a rifled barrel, and what size and type of balls do you shoot with it? Muzzle loader balls come in .310, .315, and .321, normally.
On that note, I really want one of those Remington Beals pocket revolvers to go with my 1858 in .44, but the little buggers are kinda pricey for what they are, they cost more than my .44 did. But they are sooooooo cuuuuute!!