It is never too late honestly! I have only just really started getting into it the past few months! I sometimes get a hiatus where I stop watching for a while but then I get back into it. I only own like one manga collection and personally I prefer anime over manga. Like someone else said, there are so many different genres, just pick one you like most.
Enjoy!