Previously, we introduced a method for estimating the linguistic direction of motion of an object in a scene by processing a temporal sequence of linguistic descriptions of its position relative to a stationary object. This method relies on the observation of “regular” descriptions generated through a fuzzy logic system based on the histogram of forces. These descriptions may not exist if the distance between the two objects is too close. In this paper, we use fuzzy sets to generate degrees of activation for the estimated directions of motion. Temporal fusion is applied on these values over a fixed time window using weights calculated from linguistic information on the distance between the objects. The new dynamic linguistic descriptions are determined based on the present as well as the past estimates.