Need help connecting with guys?

Im a 29 year-old straight male who has difficulty connecting with other men. This is more often with alpha male types. I have alot going for me, I'd say i'm attractive, out-going and have a nice personality. It's just that when it comes to speaking with other guys I really struggle, I don't really know what to say, especially if it is within a group. General guy banter seems to be just making jokes about each other all the time. I think the problem is due to my childhood because my dad was an alcoholic and abusive to us and my mum. From a very young age I think I lived in fear of him and never had a good male role model when growing up. The upside is that I grew up with my mum and two sisters and find it really easy to connect, talk and even flirt with women. I know alot of guys have the opposite problem to me but I wish I could find it easy to speak to other guys because it makes me look like abit of a weirdo at times. I have few males friends and all the guys I seem to get on with seem to have had issues with their dads as well. I read somewhere that if I didn't learn who to connect with men from a young age I will never really be able to learn how to behave and speak with them now. Can anybody shed some light on this for me? Any advice would be gratefully appreciated!