HOUSTON (AP) — The Cincinnati Reds are starting to believe in themselves.

Joey Votto’s two-run double in the seventh inning lifted the Reds to a 4-3 victory over the Houston Astros on Monday night.

Trailing 3-2, Paul Janish and Willy Taveras singled before Votto’s hit. It was the third time in the last four games that the Reds rallied late to win.

‘‘I feels great to beat a team in our division and to win on the road,’’ Votto said. ‘‘But the best part of it was I don’t think a single player on the bench was concerned when we were behind.

‘‘They just believe in us now. I didn’t get the feeling that anyone had their heads down.’’

Bronson Arroyo (2-1) allowed three runs and nine hits in seven innings.

‘‘Things are really rolling for us now,’’ Arroyo said. ‘‘Everything is just falling into place for us. I just want to keep riding this wave.’’

Manager Dusty Baker agreed.

‘‘Arroyo pitched really well,’’ Baker said. ‘‘And (Ryan) Hanigan and Janis and everyone contributed. His is a really big win. It’s early but they all count the same.’’

Arthur Rhodes got out of a bases-loaded jam in the eighth by striking out Hunter Pence. Francisco Cordero then pitched the ninth for his fifth save in five tries.

‘‘We still haven’t gotten the big hit,’’ Pence said. ‘‘You don’t have a lot of opportunities. I think everyone has and once again we didn’t get it done. I’m going to be a winner, I’m going to find a way in those times I’m up at bat, this time I didn’t get them.’’

Geoff Geary (0-2) took the loss.

Lance Berkman and Carlos Lee hit consecutive homers in the sixth inning to give the Astros the lead. Arroyo was the pitcher who broke Lee’s hand last Aug. 9 ending his season when he was leading the league in RBIs.

Mike Hampton gave up three runs and eight hits in 6 1-3 innings for Houston. He struck out five and walked one. It was his first start against the Reds since May 26, 2003.

‘‘I know I sound like a broken record, but we got good starting pitching and couldn’t come up with a big hit when we needed one,’’ Astros manager Cecil Cooper said. ‘‘All we needed was one big hit in the eighth and that would’ve given us the big, big inning for us but we just couldn’t get it.’’

Edwin Encarnacion had a two-run single in the first to give the Reds a 2-0 lead.

Houston cut the deficit to one in the second on Ivan Rodriguez’s RBI groundout.

Notes: Berkman tied Craig Biggio for second on the Astros all-time home run list with 291. … Houston increased its NL-leading total of double plays to 18 with one in the fourth inning. … Kaz Matsui was back in the lineup for the first time in six games after sitting out with a sore back. … Jay Bruce missed his third straight game with a bruise on his right hand, although he did pinch run in Sunday’s game. … Cincinnati has trailed in 10 of its 12 games this season.

Reds 4, Astros 3

Cincinnati Houston

ab r h bi ab r h bi

Taveras cf 5 2 2 0 KMatsu 2b 3 0 1 0

HrstnJr lf 4 0 0 0 Tejada ss 3 0 0 0

Votto 1b 5 1 2 2 Brkmn 1b 4 1 1 1

Phillips 2b 4 0 0 0 Ca.Lee lf 3 1 1 1

Encrncion 3b 4 0 2 2 Pence rf 4 1 2 0

DMcDnld rf 2 0 1 0 Blum 3b 4 0 3 0

Dickrsn ph-rf 0 0 0 0 IRdrgz c 4 0 1 1

Hanign c 4 0 1 0 JaSmth pr 0 0 0 0

Janish ss 3 1 2 0 Bourn cf 4 0 1 0

Arroyo p 1 0 0 0 Hmptn p 1 0 0 0

Nix ph 1 0 0 0 Geary p 0 0 0 0

Rhodes p 0 0 0 0 Byrdak p 0 0 0 0

Corder p 0 0 0 0 Hwkns p 0 0 0 0

Michals ph 1 0 1 0

Valvrd p 0 0 0 0

Erstad ph 1 0 0 0

Totals 33 4 10 4 Totals 32 3 11 3

Cincinnati 200 000 200 — 4

Houston 010 002 000 — 3

DP—Cincinnati 2, Houston 1. LOB—Cincinnati 8, Houston 6. 2B—Votto (4), Michaels (1). HR—Berkman (3), Ca.Lee (2). CS—I.Rodriguez (1). S—Arroyo 2, K.Matsui, Hampton.

IP H R ER BB SO

Cincinnati

Arroyo W,3-0 7 9 3 3 0 2

Rhodes H,4 1 1 0 0 2 1

Cordero S,5-5 1 1 0 0 0 0

Houston

Hampton 6 1-3 8 3 3 1 5

Geary L,0-2 0 1 1 1 1 0

Byrdak BS,1-1 2-3 1 0 0 0 1

Hawkins 1 0 0 0 1 1

Valverde 1 0 0 0 0 1

Geary pitched to 2 batters in the 7th. HBP—by Hawkins (Janish). Umpires—Home, Paul Nauert; First, Joe West; Second, Ed Rapuano; Third, Paul Schrieber.T—2:53. A—23,308 (40,976).