Jefferson believed in a small , limited federal government although the government had the to levy taxes Jefferson chose to eliminate most federal taxes . His government focused on collecting