In order to tell if we have a problem, we must differentiate obsession from fantasy and compulsion from desire. This is often problematic because when we are uncomfortable with our wants and wishes we tend to assume that they are things to be ashamed of. The issue is further complicated because one size does not fit all. There is tremendous diversity in every aspect of sexuality. The degree to which we are secure in ourselves impacts our perception and guides our behavior.
Source: The Blurry Lines of Sex Addiction: Differentiating between Normal and Problematic Sexual Behaviors