First of all, don't panic – there is no reason to banish your cat if you become pregnant.
Toxoplasmosis has been around for a very long time and, as you will note, cats are only one of the sources. You can happily continue to handle your cat as usual. However, cats can excrete toxoplasma eggs in their faeces if they pick up an infection from eating wild birds, mice or raw meat so it is important to take relevant precautions. If you are pregnant and thinking of getting your first cat, have a word with a vet and your doctor first.