I run into this same thing in the comic book world. When I tell people I write comics, they are sometimes a little confused. Most people reply, "So you do the art then?"

"No. I create the characters, worlds, plots, and write the dialogue."

Then they look at me like I just explained a principle of quantum mechanics.