Authorities believe the suspect robber a bank in Rochester, then tried to do the same in Pine Island.
Police were in a standoff with him at the Wells Fargo bank for more than 8 hours.
The suspect has been arrested and all five hostages are safe.
They robbed a Wells Fargo last Sunday.
The suspect walked into a bank, pulled out a gun and demanded money.
The suspect was convicted of armed robbery of the same bank back in 2007.
The Deerwood Bank in Garrison was held up yesterday.