Being a celebrity’s kid isn’t always all it’s cracked up to be. John Owen Lowe, the son of ’80s icon Rob Lowe, opened up about how he had to be much more careful than his non-famous peers as he grew up in the public eye.

John, who appeared on today’s episode of Andy Cohen‘s Sirius XM radio show Andy Cohen Live to promote the new season of his show Unstable, said it was a “strange feeling” to grow up having everything he does “under a microscope” due to his father’s celebrity status.

“Meaning that you’re Rob Lowe’s son and if you do something bad or you get arrested or whatever it’s going to be in the press?” Cohen clarified.

The television writer confirmed as much, telling Cohen that he faced different repercussions than his friends for doing “stupid” things when he was young.

“When you get drunk with your friends and you do something stupid, my friends come home and everything’s fine for them,” he said. “I come home and my parents are like, ‘What the hell do you think you’re doing? Do you know what happens if x, y, or z occurs?'”

John specifically recalled one story from a family trip to Hawaii when he was 16.

“I was drinking, I was a dumb kid, or at least did a lot of dumb stuff, and I think I did like an upside-down beer bong and I thought it was really cool and someone had taken a video,” he said.

“The next day, I remember waking up, and [my parents] were like, ‘Come sit with us,’” John continued. “They’re like, ‘Would you like to know how much money we just spent to have this story killed about you doing an upside-down beer bong at this party yesterday?’”

He added, “That kind of experience is very strange and I would say, like, frightening.”

The actor also admitted that he used to “hate” when his school friends would gush over his “hot” dad.

Andy Cohen Live airs every weekday at 10/9c on Sirius XM’s Radio Andy station.