Walking distance from Shinjuku is the Meiji shrine, built in the 20s, burned to the ground, and rebuilt. So not exactly ancient history, but still very pretty. This is a torii (gate), and a pretty good-sized one too.