The South American side has never won the tournament but they did make it to the quarter-finals at the last World Cup four years ago.
As for England, confidence will be high in the camp despite a much changed side losing 1-0 to Belgium.
Returning to the England side after a rest for the dead rubber with Belgium is Harry Kane, who will face up to Tottenham Hotspur teammate Davinson Sanchez in the Colombian penalty box.
Measure Kane's five goals against Rodriguez's uneven, injury-interrupted play, and it's easy to see why England has been a darling of the World Cup and Colombia has yet to impose its will upon the tournament.
England trained on Saturday with two players from their 23-man squad missing from the session as Ruben Loftus-Cheek did "individual recovery" while Fabian Delph flew home for the birth of his child.
He said: "There's some big teams gone out of the World Cup and this could be the year England can go far and hopefully win it".
"This gives us an important opportunity because we have played very tough, decisive matches until now", Pekerman said.
Meanwhile, midfielder Ruben Loftus-Cheek says the Three Lions squad has a point to prove in the knockout stages.More news: Rahul targets Modi on black money
More news: Stocks mixed as investors keep eyes on US-China tensions
More news: Warriors to consider run at DeAndre Jordan
"We have to go out and put on a good display and performance and get ourselves through".
Dozens of fans crowd around televisions in bars, and one hostel owner in Palomino, a poor town and popular tourist spot on the Caribbean coast, expects the England game to be no different at her Oasis Hostel. We should keep an eye on him.
"We're a team that doesn't carry any passengers", Southgate said.
- Since 1939, no English player has been able to score a goal in six consecutive games for England.
Coach Jose Pekerman is now fretting over the fitness of key playmaker James Rodriguez who was withdrawn in last Thursday's 1-0 win over Senegal as "Los Cafeteros" secured qualification to the knock-out stages as group winners.
"I thought he was never at full fitness" in England due to an earlier knee injury, Southgate said.
The popular tabloid, known for its provocative headlines, ran with a front-page picture of England captain Harry Kane and the words "Go Kane!", a pun on Colombia's reputation as a drug exporter. Defeated Poland, 3-0. Defeated Senegal, 1-0. With an aim to book a quarter-final berth, England will take on Colombia on Tuesday in Moscow.