Is my boyfrien being sketchy or am I paranoid?

Just have a serious conversation with him on the phone one night or in the afternoon, after he's done working and ask, "Why don't you have room for me anymore," or, "You say you want to hang out with him, and we never end up hanging out, what's up? I miss you!" Maybe that will make him think twice of ditching you.