Yes. You must be licensed in each state you do work in. California has "reciprocal" arrangements with some states that border it which allow an out-of-state license to be valid in California, but...
if my memory is correct / for a handyman contractor-- you will need to register as a sole business proprietor with the county clerks office and you will need a 1/2 million $ business insurance policy...