Don't worry. A lot of people think we (men) are kinda careless and don't really fret about stuff but we are actually mostly emotional train wrecks. He might just be dealing with some stuff or maybe he just likes you and knows you don't feel the same way so he's trying to respect that. Either way don't worry too much. If he talks to you more you could become really great friends. It'll be alright!