It could be completely normal. Chins groom themselves, and male chins go that extra mile. They also clean their penis to remove hair rings. If you notice that he's working at his genitalia a lot, he may have a hair ring he can't remove and you may need to step in and help out. If you do a quick search, you'll find several threads relating to hair ring checks.
If he acts as if he's in pain, is not acting like himself, not eating, etc., then you have cause for concern.
As far as swiping at his nose, chins do that normally as well. They may do one side or both, something I call the Fu Man Chu. If he's eating, drinking, peeing, pooping, and active - he's most likely fine.
Are you new to chins or have you had him for a while?