During a heated exchange, Khan asked his bitter rival why he had made remarks about knocking out his 'poppadom chin'.
However, Brook denied such claims and told Planet Sport that Khan is just attempting to 'rattle' him ahead of fight night.
"I just think that he's taken it into the wrong context - he's put it into the wrong context," Brook told Planet Sport.
"He's trying to make everyone think that I'm a racist and listen if I offended anyone then I'm sorry but there are no intentions (of being racist).
"He's just trying to rattle me and get under my skin, at the end of the day he's trying his best but I'm just going to be me and do what I do best," Brook added.
The pair collide on Saturday night and while there will be no titles on the line, it is regarded as the biggest British grudge match since the days of Chris Eubank and Nigel Benn.
The rivalry started in 2005 but for one reason or another, a fight could never get made when both were at the peak of their powers.
Khan and Brook will fight at a catchweight of 149lbs with a rehydration clause at 163.5lbs on fight night.
"I think that he thinks because I've got broken eye sockets that I'm a half-broken man and that I've got nothing left and that it's easy but he's also trying to drag me down to a weight we were at 18 or 19 years old," Brook said.
"He's the same age as me (35) but he knows how much I struggle to make the weight but he's going to be shocked when I do all of his demands and still knock him out.
"It's irrelevant because the people who were with me aren't involved in this fight and it sold out in seven or eight minutes so it's hit him hard," Brook added when asked about his thoughts on Eddie Hearn criticising the fight.
"It is what it is I don't really care what people have said. It's sold out because it's that great of a fight."