Is it? I don't know about the construction of crime in America, but it surprises me.
In Germany there are three prongs to a crime, all of which must be fulfilled: elements of the crime, lawlessness and guilt.
Self-defense voids the lawlessness, thus the property of being a crime.
If you do it differently, how do you handle ancillary legal question, like civil compensations and damages? Are there special rules for that?