Owen Wilson knows golf "doesn't come easy," but that hasn't stopped his kids from learning the sport. The actor and father caught up with PEOPLE on Thursday, May 29, at the Los Angeles premiere of Stick — his new sports comedy on Apple TV+ — and revealed that he's already helped his children get a grasp of the sport. Wilson, 56, is dad to 14-year-old son Robert, 11-year-old son Finn and 6-year-old daughter Lyla. "I'm trying, it's hard sometimes with kids because it's like me, as a kid, you want to play soccer or football and stuff. Golf does not come easily," Wilson says of his hopes of golfing with his children. "What's been kind of nice is going to Topgolf with them, and they love Topgolf. And so that's the way I'm kind of sneaking them into sort of learning a swing." Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. As Wilson reveals, both of his boys have their own strengths when it comes to the sport, with his older son having a "good swing" already. "Ford, my 14-year-old, he really does have a good swing. And then Finn, his grandfather was actually apparently the town champion in Sweden where he lives, so he's got it in him," Wilson says. "So I would hope that would be a great thing if one day we're all in Ireland together playing golf." Nowadays, Wilson golfs with basketball Hall of Famer Don Nelson, according to Golf Digest, which notes that the actor's late dad, Robert, was a friend of the athlete. “Nelly said, ‘Your dad would be really happy to see you getting into this game because he loved it,’ ” Wilson told Golf Digest. “It’s funny because I think about my dad playing. My dad’s gone, but this game that he was always telling me, ‘Oh, you’ve got to learn this game,’ I finally have." "That’s a nice feeling to be connected with him in that way," he added. Wilson's latest series, executive produced by the actor and created by Jason Keller, follows ex-golf pro Pryce Cahill (played by Wilson) as he joins forces with a teenage golf up-and-comer Santi (played by Peter Dager). Per a synopsis, the series is a "heartfelt, feel-good sports comedy about a found family and their relationships set within the world of golf as it has never been shown before." It also stars Marc Maron, Mariana Treviño, Lilli Kay, Judy Greer and Timothy Olyphant. As for Wilson's family life, the actor made a rare appearance with his boys last April at another kind of sporting event — the Los Angeles Football Club's game against the New York Red Bulls at BMO Stadium in L.A. Wilson has also previously opened up about his blended family in past interviews. He shares Ford with his ex-girlfriend Jade Duell, Finn with his once-trainer Caroline Lindqvist, and Lyla with Varunie Vongsvirates. shared with Esquire in 2021 that he lives near his two sons and everyone "gets along." Stick premieres on June 4 on Apple TV+.