Fishing weight size

I was out this past Sunday(9/8) in about 40 feet of water with maybe 10-15 mph winds and what seemed like a strong undercurrent. Was targeting perch at the bottom with perch rigs and noticed my weights were taking a long time to get to the bottom with a lot of line. I was using 1/2 oz weights and eventually loaded up to probably close to 2oz weights which was still giving me a lot of drift. I guess my question goes, is there too much weight to put on a line? I've read that you want less than a 45 degree angle on your line but also don't want it to go straight down. I feel like I was probably going to need 4oz+ to get in that range with my line.