Lee was born in Chinatown, San Francisco, on November 27, 1940, to parents from Hong Kong and was raised in Kowloon.