It's a bit like learning to read in general. You can get by without it but you're reliant on what you hear, are shown or are told.

Reading TAB is like learning to read to comic book level, so you rely less on being shown things.

If you learn enough about reading sheet music to understand at minimum what the different dots and squiggles mean, then you would be able to learn to play something just from seeing it on paper if both TAB and MS are shown (as with everything on this site).

If you want full freedom to tackle anything, then learn to read manuscript, but not if it takes away the enjoyment of playing.