The New England Patriots not only lost the Super Bowl, but it seems they will not lose their offensive coordinator as well.

 Josh McDaniels will remain in New England, after informing the Indianapolis Colts he wouldn’t be their new head coach, according to ESPN’s Adam Schefter.

The Colts released a statement on Tuesday night, stating that McDaniels informed them he was not joining the organization and despite being surprised by his decision, they will continue their head coaching search.

On Tuesday morning, the Colts announced that McDaniels accepted the role that became available when the team fired Chuck Pagano after a 4-12 season. It was the confirmation of rumors that had been swirling for weeks. So McDaniels’ decision to stay with the Patriots is a surprising one. The team even had a press conference scheduled for Wednesday to introduce its new leader.

McDaniels has settled in nicely in New England with his wife and four children since coming over in 2012. He has also established plenty of relationships with those who work within the Patriots organization. As a result, the reality of having to settle into a completely new home after bouncing around the league for several years was too much to bear.

Colts general manager Chris Ballard now faces the unenviable task of trying to find a coach with the prime pool of coaching candidates no longer available. Getting a new coach into Indy before the start of the NFL Scouting Combine likely will be a priority for Ballard in the weeks ahead.