BALTIMORE — Earlier on this road trip, Aaron Boone described José Caballero as someone who could “wreak havoc” on the bases, but also “make you hold your breath sometimes.” 

Join Post Sports+ for exciting subscriber-only features, including real-time texting with Greg Joyce about the inside buzz on the Yankees.

That was after a game in which his aggressive baserunning paid off.

On Thursday, the potential downside revealed itself again. 

Caballero was picked off for the second time in four games after getting too big of a lead, this time off first base by left-hander Cade Povich in the second inning of the Yankees’ 7-0 win over the Orioles at Camden Yards. 

On Monday night against the Twins, Caballero doubled but then got picked off between second and third. 

“You got to live with some of it,” manager Aaron Boone said. “When you’re running a lot and you’re stealing a lot of bases, there’s some risk that goes with that, so there’s going to be some outs along the way. You try to do your homework and prepare as best you can to limit those things. As much as we’re pushing the envelope in the running game, those things are going to happen from time to time.” 

Caballero, who started at third base, leads the majors with 48 steals. 

Jazz Chisholm Jr. was also caught stealing after doubling in the sixth inning — his 200th career extra-base hit – with righty reliever Yennier Cano stepping off the mound as Chisholm broke for third and nailing him there. 

Devin Williams has had other encouraging stretches earlier this season, only for a few brutal outings to wreck his momentum. 

But the maligned Yankees reliever is in the midst of another strong run, this one at a critical time as the Yankees try to get the back end of their bullpen on track heading into October. 

“He’s pitching with a lot of confidence,” Boone said. “I feel like his mix, he’s unpredictable right now. A two-pitch guy, but the fastball’s been good. I feel like there’s real life to it, so it’s keeping you off the changeup enough. I feel like he’s pitching with a lot of confidence with the changeup, too. ” 

Paul Blackburn threw two hitless frames to close out the win. 

The Orioles entered Thursday having won 12 of their prior 17 games despite spending most of the season in last place of the AL East. 

“I don’t see them that way [last place],” Boone said. “It’s a team that’s played pretty well for a few months, probably more in line with who everyone expected them to be at the start of the year and over the last month, they’ve gotten healthier in the starting rotation, so their starting pitching’s been good. We know it’s a good team, we know it’s a formidable team and not anywhere close to a last place-caliber team.”