Visual processing transforms the complexities of the visual world into useful information. Ciona, an invertebrate chordate and close relative of the vertebrates, has one of the simplest nervous systems known, yet has a range of visuomotor behaviors. This simplicity has facilitated studies linking behavior and neural circuitry. Ciona larvae have two distinct visuomotor behaviors – a looming shadow response and negative phototaxis. These are mediated by separate neural circuits that initiate from different clusters of photoreceptors, with both projecting to a CNS structure called the posterior brain vesicle (pBV). We report here that inputs from both circuits are processed to generate fold change detection (FCD) outputs. In FCD, the behavioral response scales with the relative fold change in input, but is invariant to the overall magnitude of the stimulus. Moreover, the two visuomotor behaviors have fundamentally different stimulus/response relationships – indicative of differing circuit strategies, with the looming shadow response showing a power relationship to fold change, while the navigation behavior responds linearly. Pharmacological modulation of the FCD response points to the FCD circuits lying outside of the visual organ (the ocellus), with the pBV being the most likely location. Consistent with these observations, the connectivity and properties of pBV interneurons conform to known FCD circuit motifs, but with different circuit architectures for the two circuits. The negative phototaxis circuit forms a putative incoherent feedforward loop that involves interconnecting cholinergic and GABAergic interneurons. The looming shadow circuit uses the same cholinergic and GABAergic interneurons, but with different synaptic inputs to create a putative non-linear integral feedback loop. These differing circuit architectures are consistent with the behavioral outputs of the two circuits. Finally, while some reports have highlighted parallels between the pBV and the vertebrate midbrain, suggesting a common origin for the two, others reports have disputed this, suggesting that invertebrate chordates lack a midbrain homolog. The convergence of visual inputs at the pBV, and its putative role in visual processing reported here and in previous publications, lends further support to the proposed common origin of the pBV and the vertebrate midbrain.