South Korean navy fired warning shots at a North Korean patrol boat near the rivals' disputed maritime border, where sailors on both sides have been killed in past exchanges of fire, the two sides said on Sunday.
The incident, which took place on Saturday, coincided with the holding reunions of families separated during the 1950-53 Korean War under an August accord that ended an earlier standoff and called for better ties.
South Korea's navy fired several shots at a North Korean patrol boat that crossed the disputed maritime border on Saturday, forcing it to retreat, a South Korean defence official in Seoul said by telephone, asking not to be named.
The North did not return fire or take other action, the official said.
North Korea has rejected the so-called Northern Limit Line (NLL), which was drawn up at the end of the Korean War, as the maritime border, insisting on a line further to the south.
The two Koreas remain technically at war because no peace treaty has been signed after the war, and despite several moves to normalise ties, the peninsula is tensely divided.
A North Korean spokesman said the South fired at its vessel conducting "routine" operation, calling it a "serious provocation," and warned such action could spark military confrontation and refuel tensions on the Korean peninsula.
"There will be only a war disaster, far from the improvement of the North-South relations, as long as the South Korean military warmongers go reckless," the unnamed spokesman said in comments carried by the official KCNA news agency.
Naval clashes in the region since 1999 killed dozens of sailors on both sides. In 2010, a South Korean navy vessel was sunk in a torpedo attack that killed 46 sailors. The South blames the North for the attack but Pyongyang denies any role.
In August, the two sides agreed to work for better ties, ending a tense confrontation at the land border that involved trading of artillery fire. The family reunions were seen as one step in improving ties.