Should I talk to him again or let it be?

If your talking to him like that your obiously slightly interested in him... if you don't want things to get complicated don't lead him on... just tell him your unconfortable talking to him like that and stop... just talk to him casually because you do work with him after all.... pretty much talk to him when its needed...