By Nick Romano
Updated August 14, 2016 at 12:00 PM EDT
Jun Sato/GC Images

Justin Bieber is over all the negative comments directed at his maybe-girlfriend Sofia Richie. In a message addressed to his legion of Beliebers over the weeked, the singer threatened to make his Instagram account private if the haters don’t stop their tirade.

“I’m gonna make my Instagram private if you guys don’t stop the hate,” he wrote after a series of black-and-white pics of him and Richie together. “This is getting out of hand, if you guys are really fans you wouldn’t be so mean to people that I like.”

Since the pair started being photographed together, fans have been leaving comments on Bieber’s account calling Richie all manner of names. “I’m not telling you to leave Sofia or you’re not happy with it, just that you should not leave your family Beliebers for a girl,” one commenter wrote in part, while another called his ex Hailey Baldwin a better girlfriend.

Richie, the daughter of Lionel Richie and sister to Nicole Richie, recently posted a photo of her and Biebs in Japan. See photos of them below.