Alternatively, you can think of everything that could impact you as something of a now light cone. The second view has the universe existing as a 3D surface in 4D space time which means objects have a temporal width for each observer. That can be a really useful mathematical model.
PS: Edited the above several times for clarity.