Dale Caldwell, the former New Jersey lieutenant governor who resigned last month, has been suspended from his duties as a pastor while the United Methodist Church investigates allegations against him.