Three young men accused of what police believe was a racially-motivated attack on a black man in Courtenay, B.C. say they are now outcasts in their own Vancouver Island community.

CTV News caught up with the three on Thursday at a Courtenay residence they said the attention is getting to be too much and they are moving out of town.

"I can't answer, I'm in the middle of moving, my wife and kid are in danger, seriously," one of the men told CTV British Columbia's Lisa Rossington.

Meanwhile, just a few blocks away, Jay Phillips, the man who was seen on video being attacked, was cheered by hundreds of people in Courtenay's town square, who had gathered to applaud Phillips and denounce racism.

"It wasn't just Jay they beat up, it was the town, it was the people, everyone here is feeling like we took a hit,'' Courtenay's Mayor Greg Phelps said.

The incident, which was captured on amateur video, was posted on YouTube and has been viewed more than 100,000 times right around the world.

It shows 38-year-old Phillips being surrounded, then kicked and punched by three men in a parking lot. All three were arrested and released.  The men are aged from 19 to 25.

Racial slurs can be clearly heard on the video, sparking outrage in a community where residents say they are embarrassed by what happened.

"What happened was so unacceptable," said a resident, who spoke to CTV News.

"I don't see how those kids can live with themselves," said another.

But the young men whose actions are the focus of intense scrutiny had this to say about the beating incident.

"We've already apologized, we don't like racism, crime. It all started with a friggen cheese burger being thrown,'' one said.

"We've been to the cop shop."

For his part, Jay Phillips said the incident is something that everyone can learn from.

"We have to educate people with this,'' Phillips said while pointing to his head, "not this," he added, pointing to his fist.

With a report by CTV British Columbia's Lisa Rossington