GUYS: what does this guy want from me?

Ok so there's this guy who I met through facebook and he's mutual friends with other mutual friends of mine. I met up with him once and I admit we did get abit physical, nothing serious just kissing and abit of fondaling. I'm still quite hung up on my ex but this guy seemed really nice and something to take my mind off my ex. So weeks have gone by and for about a week after we met he seemed really into me, saying really sweet things saying he wants to get closer to me etc. I really let him in and started to like him. However recently he's been acting really distant, and when I ask him he just makes up excuses. He also brang up his ex a few times for no reason. Eg, he text me asking how iam just normal stuff, I then asked him what he was up too and he replied at my ex's giving her her birthday present. I was very shocked by this as he told me he doesn't like his ex at all and that she was a bi***. I let it slide. Then today we were meant to meet up but he kinda blew me off becuase he had to go into town. I offered to meet up tomorrow and he accepted. However he text me just a minute ago saying are you going to have a free house tomorrow? I think I will so I said yes I thinkso. He then randomly came out with I don't think I want a relationship etc etc blah blah. Why has he suddenly changed his mind? He was soooo into me not that long ago, and then it just stopped. But he's still wanting to meet up. Does he just want me as a fu** buddy or what? Did he bbring up the whole I don't want a relationship speech because he's sneakly trying to make it clear he doesn't want anything serious, just some fun? He used to be so sweet and seemed like a lovely boy abd potential boyfrind. Now I'm not so sure. How do I act tomorrow and what do I do?!? Help please?