I use a 1% sulfite solution with 1/2% citric acid in a spray bottle to
finish up my cleaning regime before I bottle. I just wash, swab the
bottle with a bottle brush, rinse with a jet rinser 3 times to be sure
my cleaner is out and a final spritz with the sulfite solution. That
goes on the bottle rack and is used as is.

There is no down side either way, you don't need the sulfite rinsed
out or you can eliminate it's use and rinse with any water you can
drink.

I don't think your sulfite smell is coming from that unless your
solution was REALLY strong. Time will help, a little hydrogen peroxide
is used at times to pull it down too.

Joe