I installed a switch-based region mod and have resigned myself to never removing the memory cartridge from the console. That means I'll never play the games that use the 1M or 4M carts, but that's okay. I can play other versions of Capcom 4M games, and I have a consolized Neo Geo MVS, so I'll never need to play the Saturn ports. Even if I didn't have a CMVS, I would probably still use other ports and emulation to play Neo Geo games.
My Saturn was bought new at K-Mart in August 1999, and the cart port always gave me issues. I had serious problems with losing data on the memory cartridge from day one. Eventually, I got it positioned just right, and I haven't lost a save in years. It was some sort of combination of pushing the cart all the way in, pulling one end up slightly, pushing it back down, etc. When I need to replace the console's battery, I leave the cart in there.
I've heard that the US console got the short end of the stick. It has something like tin-plated contacts. The Japanese version has some sort of higher quality contacts. Maybe gold-plated.
If things get bad enough with my console, I'll seriously consider soldering my cartridge into it.