There are definitely a few ways you could describe that. Agender is one that might feel good, the people I know who identify that way have a very "I do not want to participate in this gender business" sort of attitude about it.