The 42-year-old performed with the backing of a choir, and then moved on to another facility across the street where a smaller selection of female inmates were treated to a show.
Kanye West has followed the Johnny Cash route and performed for inmates at a Houston jail.
Kanye has attracted his own share of criticism that his new religious phase is more about his own enrichment than a higher power.
However, the Church's Sunday service also has an 11:00 a.m. service, wherein Kanye will be walking to the pulpit and will have a short talk with Joel.
The free e-tickets are required for admission to the evening performance at 7. It is unclear whether the tickets are legitimate as online ticket scams run rampant.
The venue only has seating for 16,800 people, but Kanye will perform in an overflow area that can accommodate many more. "This is a mission, not a show", the rapper repeatedly told his audiences, the Houston Chronicle reports.
West had earlier performed a gig for the prisoners in Texas and this time he made a decision to bring the soulful sounds to Houston jail.
"The devil stole all the good producers, the devil stole all the good musicians, all the good artists, all the good designers, all the good businesspeople, and said you've got to come work for me", West said.
Towards the end of his team onstage, Osteen encouraged the crowd to welcome the rapper's wife Kim Kardashian West as well as their daughter North, both of whom were sitting in the front row.