Continuity of an entire user session (including the primary content stream, secondary content streams, and user context) is preserved so that the user can resume the session at a later time, at a different place, and, possibly, using different equipment. When a user pauses a session, the context of that session is automatically preserved. Upon resumption, the session begins where the user left off, resuming the primary media stream at the point where the user stopped, knowing what secondary content items the user has already seen, and re-establishing any user-set parameters for the session (e.g., playback volume, allocation of streams to particular screen real estate, whether closed captioning is turned on, and the like). For time-shifted content consumption, the system intelligently selects, filters, and processes contextual information (such as characteristics of the primary media) in order to present companion streams that are relevant and engaging to the user.