The inmate was found hours after walking away from the facility on Sunday.
Three other inmates who contracted the virus are hospitalized in critical condition.
An inmate died in custody in Fargo on the same day.
The virus has killed at least six Minnesota inmates.
The man is the fifth incarcerated person in Minnesota to die from COVID-19.
He becomes the fourth prison inmate to die from the virus.
Keith Cochise Bellanger has a prior conviction for burglary.
All three inmates survived.
He died on Thursday, almost a week after being found unresponsive.
More than 200 inmates at the prison have tested positive.
It's the first prison death due to COVID-19 in Minnesota.
It happened at Stearns County Jail.
He's fortunately going to make a full recovery.
He had been arrested on an outstanding warrant.
This follows a rash of similar incidents at Minnesota prisons throughout 2018.