Neuro-endoscopic surgeries are minimally invasive neurosurgery and is reported to reduce the post-operative recovery time, morbidity, hospitalization time, and cost of patient care. The basic systems required for neuro-endoscopic surgery include: Endoscope, Visualization systems and Instrumentation for manipulation. Neuro-endoscopy demands independent visual and manual skills and combined psychomotor skills. The depth cue and 3-Dimension are obtained by moving the endoscope, forwards and backward. The reflection of the light on different surfaces helps in identifying the distance. The neurosurgeon forms a 3-D mental picture of the surgical site. The automatic localization of endoscopic camera and the manipulating tool with respect to the global CT/ MRI can help the surgeon to navigate the brain/ structure easily. There are neuro-navigation systems available based on optical tracking and magnetic tracking methods. Neuro-endoscopy videos involve random movements while manipulation. The standard reconstruction techniques based on brightness constancy and feature matching is violated due to the moving illumination and feature-less tissue structures. The localization of the endoscopic camera from the neuro-endoscopy videos is an interesting challenge from computer vision perspective.