Your father will likely hang on to the business well past his prime, begin making shitty decisions and your frustration level will increase, affecting your family life.

Your wife is probably already way sick of the shit and may be setting up her next big adventure already. Women get restless easily.

Your bro sounds like a tool as well.

When I do the math, this sounds like a shit deal. I would push the old man to give you majority share of the company and make you president or you bounce. He will likely say no but at least you don't look like a pussy. If you are as important as you say to the company, it will begin going downhill and he will have to come crawling back. If it does well, you were delusional and really weren't that important.

Either way you get a reality check.