Really depends on how far you got into it. I will note I really don't like the first 13 or so episodes of the series. I was a big fan of the 03 anime, and having the first 25-ish episodes condensed into 12-ish was awful. And it wasn't until episode 19 that I finally got on board with the series, as the episode ends with what is still one of the most bad-ass moments I've ever seen in anime. It sounds like you've gotten to that point (I don't want to spoil on the off chance you haven't but it involved Lust) and if you loved that moment, stuff like that does become more common the further into the series you get. If you haven't, definitely go back to it.
I'm not sure how Brotherhood is broken up into Seasons but I'm assuming it's just by cour, you said Season 2 or 3, which I'm guessing means you've seen up to either episode 26 or 39? Either way if you've seen that much, I'm not sure I would bother tbh. Less so if you've only seen up to 26, since you haven't even met Olivier Mira Armstrong at that point (she's my second favourite character after Roy Mustang). The only real shift in the series at that point is the final act of the series is heavily action-orientated, far more than the rest of the series.
I'd say if you only gave up on Brotherhood because there wasn't enough action then go back to it. Brotherhood is structured to make the climax this lengthy, massive-scaled, series of dramatic pay-offs and action highlights but to accomplish that fights have to be more sparse for the rest of the series. But if that's not the only or main reason you dropped it, meh. I loved it but at 30-ish episodes if the series didn't work for you on some level it might not just be for you.