Relative position encoding based networks for action recognition

The present disclosure provides a method of recognising a first action. The method comprises determining a weighted combination of a first plurality of feature responses associated with a sequence of second actions over a period of time using a set of weights at a particular time instance in the period of time. The method then recognises the first action by processing, using a neural network, the weighted combination of the first plurality of feature responses and temporal position values of each of the first plurality of feature responses associated with the sequence of second actions.