3D tele-immersion (3DTI) has the potential of enabling virtual reality interaction among remote people with real-time 3D video. However, today's 3DTI systems still su?er from various performance issues, limiting their broader deployment, due to the enormous demand on temporal (computing) and spatial (networking) resources. Past research focused on system-centric approaches for technical optimization, without taking human users into the loop. We argue that human factors (including user preferences, semantics, limitations, etc.) are an important and integral part of the cyber-physical 3DTI systems, and should not be neglected. This thesis proposes a comprehensive, human-centric framework for managing video data and functions across the 3DTI pipeline. Our approach is comprehensive because it involves all components of the video function pipeline. It is also comprehensive in the sense that both temporal and spatial resource challenges are considered and tackled.