For me, I seek certain peppers for the taste & heat is a bonus... especially fresh chiles. A mild habanero, however, I don't know if that would fly.
IANANM, but my college roommate was. We roasted+peeled pounds of red & green chiles when his mom sent the fresh crop. Tasty times.