With regards to physics in particular (my specialty), I think it's important to understand what part of physics you want to learn, and in what depth.

If you want a good, basic introduction to mechanics and E&M, I would point you towards Serway. The problem is that Serway is a very basic book, and not really written like physicists think.

A step up from Serway is The Mechanical Universe.

The best intro physics book on E&M for physicists is Purcell.

The Feynman Lectures are great, but you have to be willing to devote serious time and effort to studying them. Especially if you're new to physics, and thinking like a physicist.

If you want another step up past the Feynman lectures, and you're willing to devote a serious amount of time to it, the Landau and Lifshitz series is incredible, though very advanced. If you can make it through all of those, you're among a rare group indeed.