For anyone having trouble with the horizontal tabs not hiding, Anonymous user 099626's advice worked for me. Create a folder chrome/ in your firefox profile and then in that directory a userChrome.css file containing the following rules

/* Remove horizontal tabs */
#tabbrowser-tabs {
visibility: collapse;
}

If you want to get rid of the sidebar header, add this to the file:

/* Remove sidebar header */
#sidebar-header {
visibility: collapse;
}

You will have to restart Firefox to enact the changes.