The Seymour family consisted of eight children, three girls and five boys. Records do not show the exact age that young Edward went to Radley Hall, but going by history of children starting school it was most likely to have been six years old. Radley was a very strict Church of England school, with daily services in the school Chapel. At the age of twelve he left Radley and entered into the Royal Navy at Portsmouth as a Cadet. In 1854-55 the record shows him on a paddle-wheel frigate with the rank of Midshipman.