Shortly after being promoted to 1st Lieutenant in Company G, Conger was detached in November 1862 joining the staff of General Ammon as Acting Assistant Adjutant General. In June 1863 Conger was appointed Provost Marshall at Newport, Kentucky and never returned to the regiment, serving for the duration in various staff assignments, notably as Assistant Inspector of Railroad Defenses at Nashville. A pre-printed document being General Order No 4, dated March 10, 1865 cites Lieutenant H.H. Glosser, 115th OVI for resolute bravery in defending block-house No 7…from the attacks of the enemy and is signed by fellow Lt. Conger as official in his staff capacity. Conger mustered out at Murfreesboro in June 1865.